2024-05-10T03:59:22.943 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-10T03:59:22.944 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi --owner scheduled_pdonnell@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/acls} --archive /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700532 -- /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700532/orig.config.yaml 2024-05-10T03:59:22.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T03:59:23.086 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700532 branch: wip-pdonnell-testing-20240509.171335-reef-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/acls} email: pdonnell@redhat.com first_in_suite: false job_id: '7700532' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-pdonnell-testing-20240509.171335-reef-debug ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Reduced data availability - Degraded data redundancy sha1: 50174015a7e79f951b988949abe236791f52d4da ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 50174015a7e79f951b988949abe236791f52d4da kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240509.171335-reef-debug sha1: 50174015a7e79f951b988949abe236791f52d4da owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4933 sha1: 50174015a7e79f951b988949abe236791f52d4da sleep_before_teardown: 0 subset: 420/512 suite: fs suite_branch: wip-pdonnell-testing-20240509.171335-reef-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 50174015a7e79f951b988949abe236791f52d4da syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCh2FomEvssRNqMzLCB3fmgTTzFffpg7e5Vf3OcGQ4j+Epq71LxJr1yeTgq3ElIZ74w0hZH+odJ4zPHylD4ttB8= smithi106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNgzKKP0QCQ0EFVoXY4vOvlRoJNXjX9cyALOQydkr+R3/L4WJbqWlClgl7faeLi9Kwvld1xoJwI3fonNTvFGFic= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_acls teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-10_02:33:39 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-10T03:59:23.087 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa; will attempt to use it 2024-05-10T03:59:23.087 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa/tasks 2024-05-10T03:59:23.087 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-10T03:59:23.089 INFO:teuthology.task.internal:Checking packages... 2024-05-10T03:59:23.113 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '50174015a7e79f951b988949abe236791f52d4da' 2024-05-10T03:59:23.113 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-10T03:59:23.114 INFO:teuthology.packaging:ref: None 2024-05-10T03:59:23.114 INFO:teuthology.packaging:tag: None 2024-05-10T03:59:23.114 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240509.171335-reef-debug 2024-05-10T03:59:23.114 INFO:teuthology.packaging:sha1: 50174015a7e79f951b988949abe236791f52d4da 2024-05-10T03:59:23.114 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20240509.171335-reef-debug 2024-05-10T03:59:23.337 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1330.g50174015 2024-05-10T03:59:23.339 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-10T03:59:23.346 INFO:teuthology.task.internal:no buildpackages task found 2024-05-10T03:59:23.347 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-10T03:59:23.371 INFO:teuthology.task.internal:Saving configuration 2024-05-10T03:59:23.390 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-10T03:59:23.397 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T03:59:23.420 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700532', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 03:53:32.699102', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCh2FomEvssRNqMzLCB3fmgTTzFffpg7e5Vf3OcGQ4j+Epq71LxJr1yeTgq3ElIZ74w0hZH+odJ4zPHylD4ttB8='} 2024-05-10T03:59:23.441 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700532', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 03:53:32.700628', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNgzKKP0QCQ0EFVoXY4vOvlRoJNXjX9cyALOQydkr+R3/L4WJbqWlClgl7faeLi9Kwvld1xoJwI3fonNTvFGFic='} 2024-05-10T03:59:23.441 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-10T03:59:23.449 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-10T03:59:23.449 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-10T03:59:23.450 INFO:teuthology.run_tasks:Running task console_log... 2024-05-10T03:59:23.526 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f67895190d0>, signals=[15]) 2024-05-10T03:59:23.527 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-10T03:59:23.537 INFO:teuthology.task.internal:Opening connections... 2024-05-10T03:59:23.537 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2024-05-10T03:59:23.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T03:59:23.629 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2024-05-10T03:59:23.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T03:59:23.702 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-10T03:59:23.711 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-05-10T03:59:23.732 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-05-10T03:59:23.733 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-05-10T03:59:23.793 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Red Hat Enterprise Linux" 2024-05-10T03:59:23.793 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8.6 (Ootpa)" 2024-05-10T03:59:23.793 INFO:teuthology.orchestra.run.smithi080.stdout:ID="rhel" 2024-05-10T03:59:23.793 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="fedora" 2024-05-10T03:59:23.793 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8.6" 2024-05-10T03:59:23.793 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2024-05-10T03:59:23.793 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-10T03:59:23.793 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-05-10T03:59:23.794 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-10T03:59:23.794 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.redhat.com/" 2024-05-10T03:59:23.794 INFO:teuthology.orchestra.run.smithi080.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-10T03:59:23.794 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T03:59:23.794 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T03:59:23.794 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-10T03:59:23.794 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-10T03:59:23.794 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-10T03:59:23.794 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-10T03:59:23.795 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-05-10T03:59:23.816 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-05-10T03:59:23.838 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-05-10T03:59:23.838 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-05-10T03:59:23.898 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Red Hat Enterprise Linux" 2024-05-10T03:59:23.898 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="8.6 (Ootpa)" 2024-05-10T03:59:23.898 INFO:teuthology.orchestra.run.smithi106.stdout:ID="rhel" 2024-05-10T03:59:23.898 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="fedora" 2024-05-10T03:59:23.898 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="8.6" 2024-05-10T03:59:23.899 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el8" 2024-05-10T03:59:23.899 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-10T03:59:23.899 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-05-10T03:59:23.899 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-10T03:59:23.899 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.redhat.com/" 2024-05-10T03:59:23.899 INFO:teuthology.orchestra.run.smithi106.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-10T03:59:23.899 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T03:59:23.899 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T03:59:23.899 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-10T03:59:23.899 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-10T03:59:23.899 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-10T03:59:23.899 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-10T03:59:23.900 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-05-10T03:59:23.925 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-10T03:59:23.935 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-10T03:59:23.946 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-10T03:59:23.946 DEBUG:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2024-05-10T03:59:23.950 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2024-05-10T03:59:23.969 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-10T03:59:23.978 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-10T03:59:23.978 DEBUG:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2024-05-10T03:59:24.008 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2024-05-10T03:59:24.044 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-10T03:59:24.105 INFO:teuthology.run_tasks:Running task kernel... 2024-05-10T03:59:24.121 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-10T03:59:24.121 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-05-10T03:59:24.121 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-05-10T03:59:24.121 DEBUG:teuthology.orchestra.run.smithi080:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T03:59:24.122 DEBUG:teuthology.orchestra.run.smithi106:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T03:59:24.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:59:24.141 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2024-05-10T03:59:24.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:59:24.144 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2024-05-10T03:59:24.302 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T03:59:24.302 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-10T03:59:24.303 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-05-10T03:59:24.324 INFO:teuthology.orchestra.run.smithi080.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-05-10T03:59:24.325 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-513.9.1.el8_9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T03:59:24.325 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-10T03:59:24.326 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum upgrade -y linux-firmware 2024-05-10T03:59:24.389 DEBUG:teuthology.task.kernel:sha1 for client.1 is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T03:59:24.389 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-10T03:59:24.390 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-05-10T03:59:24.409 INFO:teuthology.orchestra.run.smithi106.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-05-10T03:59:24.410 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-513.9.1.el8_9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T03:59:24.410 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-10T03:59:24.410 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum upgrade -y linux-firmware 2024-05-10T03:59:25.842 INFO:teuthology.orchestra.run.smithi080.stdout:Updating Subscription Management repositories. 2024-05-10T03:59:25.842 INFO:teuthology.orchestra.run.smithi080.stdout:Unable to read consumer identity 2024-05-10T03:59:25.978 INFO:teuthology.orchestra.run.smithi106.stdout:Updating Subscription Management repositories. 2024-05-10T03:59:25.979 INFO:teuthology.orchestra.run.smithi106.stdout:Unable to read consumer identity 2024-05-10T03:59:26.060 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T03:59:26.060 INFO:teuthology.orchestra.run.smithi080.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-10T03:59:26.060 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T03:59:26.233 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T03:59:26.233 INFO:teuthology.orchestra.run.smithi106.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-10T03:59:26.233 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T03:59:27.819 INFO:teuthology.orchestra.run.smithi080.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-05-10T03:59:28.103 INFO:teuthology.orchestra.run.smithi106.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-05-10T03:59:29.138 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 14 MB/s | 14 MB 00:00 2024-05-10T03:59:30.998 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 4.3 MB/s | 14 MB 00:03 2024-05-10T03:59:32.529 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 311 kB/s | 24 kB 00:00 2024-05-10T03:59:33.350 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-10T03:59:33.487 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2024-05-10T03:59:33.487 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-10T03:59:33.507 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-05-10T03:59:33.507 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T03:59:33.668 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/ 2024-05-10T03:59:33.669 DEBUG:teuthology.orchestra.run.smithi106:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/ --input-file=- 2024-05-10T03:59:33.671 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi106.front.sepia.ceph.com to complete... 2024-05-10T03:59:34.314 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 418 kB/s | 24 kB 00:00 2024-05-10T03:59:35.118 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-10T03:59:35.120 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-05-10T03:59:35.121 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-10T03:59:35.258 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-05-10T03:59:35.258 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T03:59:35.496 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/ 2024-05-10T03:59:35.496 DEBUG:teuthology.orchestra.run.smithi080:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/ --input-file=- 2024-05-10T03:59:35.499 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi080.front.sepia.ceph.com to complete... 2024-05-10T03:59:50.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10 03:59:50 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [425099368/425099368] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-10T03:59:50.034 INFO:teuthology.orchestra.run.smithi106.stderr:FINISHED --2024-05-10 03:59:50-- 2024-05-10T03:59:50.035 INFO:teuthology.orchestra.run.smithi106.stderr:Total wall clock time: 16s 2024-05-10T03:59:50.035 INFO:teuthology.orchestra.run.smithi106.stderr:Downloaded: 1 files, 405M in 16s (25.2 MB/s) 2024-05-10T03:59:50.038 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-05-10T03:59:50.038 DEBUG:teuthology.orchestra.run.smithi106:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-10T03:59:51.947 INFO:teuthology.orchestra.run.smithi106.stdout:Verifying... ######################################## 2024-05-10T03:59:52.033 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing... ######################################## 2024-05-10T03:59:52.197 INFO:teuthology.orchestra.run.smithi106.stdout:Updating / installing... 2024-05-10T04:00:05.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10 04:00:05 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [425099368/425099368] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-10T04:00:05.361 INFO:teuthology.orchestra.run.smithi080.stderr:FINISHED --2024-05-10 04:00:05-- 2024-05-10T04:00:05.361 INFO:teuthology.orchestra.run.smithi080.stderr:Total wall clock time: 30s 2024-05-10T04:00:05.362 INFO:teuthology.orchestra.run.smithi080.stderr:Downloaded: 1 files, 405M in 30s (13.7 MB/s) 2024-05-10T04:00:05.364 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-05-10T04:00:05.365 DEBUG:teuthology.orchestra.run.smithi080:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-10T04:00:07.281 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying... ######################################## 2024-05-10T04:00:07.641 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing... ######################################## 2024-05-10T04:00:08.534 INFO:teuthology.orchestra.run.smithi080.stdout:Updating / installing... 2024-05-10T04:00:34.873 INFO:teuthology.orchestra.run.smithi106.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-10T04:00:36.435 INFO:teuthology.orchestra.run.smithi106.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-05-10T04:00:51.257 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-10T04:00:52.734 INFO:teuthology.orchestra.run.smithi080.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-05-10T04:01:01.000 INFO:teuthology.orchestra.run.smithi106.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-05-10T04:01:16.033 INFO:teuthology.orchestra.run.smithi080.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-05-10T04:03:19.155 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi106.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-10T04:03:19.155 DEBUG:teuthology.orchestra.run.smithi106:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-10T04:03:19.209 INFO:teuthology.orchestra.run.smithi106.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-10T04:03:19.209 INFO:teuthology.orchestra.run.smithi106.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-10T04:03:19.209 INFO:teuthology.orchestra.run.smithi106.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-10T04:03:19.209 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-10T04:03:19.210 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-10T04:03:19.210 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-10T04:03:19.210 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-10T04:03:19.210 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-10T04:03:19.210 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-10T04:03:19.210 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-10T04:03:19.210 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-10T04:03:19.210 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-10T04:03:19.210 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-10T04:03:19.210 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-10T04:03:19.210 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-10T04:03:19.210 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-10T04:03:19.210 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-10T04:03:19.211 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-10T04:03:19.211 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-10T04:03:19.211 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-10T04:03:19.211 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-10T04:03:19.211 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-10T04:03:19.211 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-10T04:03:19.211 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-10T04:03:19.211 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-10T04:03:19.211 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-10T04:03:19.211 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-10T04:03:19.211 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-10T04:03:19.211 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-10T04:03:19.211 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-10T04:03:19.212 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-10T04:03:19.212 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-10T04:03:19.212 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-10T04:03:19.212 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-10T04:03:19.212 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-10T04:03:19.212 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-10T04:03:19.212 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-10T04:03:19.212 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-10T04:03:19.212 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-10T04:03:19.212 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-10T04:03:19.212 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-10T04:03:19.212 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-10T04:03:19.212 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-10T04:03:19.213 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-10T04:03:19.213 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-10T04:03:19.213 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-10T04:03:19.213 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-10T04:03:19.213 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-10T04:03:19.213 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-10T04:03:19.213 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-10T04:03:19.213 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-10T04:03:19.213 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-10T04:03:19.213 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-10T04:03:19.213 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-10T04:03:19.213 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-10T04:03:19.213 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-10T04:03:19.214 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-10T04:03:19.214 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-10T04:03:19.214 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-10T04:03:19.214 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-10T04:03:19.214 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-10T04:03:19.214 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-10T04:03:19.214 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-10T04:03:19.214 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-10T04:03:19.214 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-10T04:03:19.214 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-10T04:03:19.214 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-10T04:03:19.214 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-10T04:03:19.215 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-10T04:03:19.215 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-10T04:03:19.215 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-10T04:03:19.215 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-10T04:03:19.215 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-10T04:03:19.215 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-10T04:03:19.215 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-10T04:03:19.215 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-10T04:03:19.215 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-10T04:03:19.215 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-10T04:03:19.215 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-10T04:03:19.215 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-10T04:03:19.215 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-10T04:03:19.215 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-10T04:03:19.216 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-10T04:03:19.216 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-10T04:03:19.216 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-10T04:03:19.216 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-10T04:03:19.216 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-10T04:03:19.216 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-10T04:03:19.216 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-10T04:03:19.216 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-10T04:03:19.216 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-10T04:03:19.216 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-10T04:03:19.216 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-10T04:03:19.216 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-10T04:03:19.216 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-10T04:03:19.216 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-10T04:03:19.217 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-10T04:03:19.217 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-10T04:03:19.217 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-10T04:03:19.217 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-10T04:03:19.217 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-10T04:03:19.217 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-10T04:03:19.217 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-10T04:03:19.217 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-10T04:03:19.217 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-10T04:03:19.217 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-10T04:03:19.217 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-10T04:03:19.217 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-10T04:03:19.217 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-10T04:03:19.217 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-10T04:03:19.218 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-10T04:03:19.218 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-10T04:03:19.218 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-10T04:03:19.218 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-10T04:03:19.218 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-10T04:03:19.218 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-10T04:03:19.218 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-10T04:03:19.218 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-10T04:03:19.218 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-10T04:03:19.218 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-10T04:03:19.218 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-10T04:03:19.218 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-10T04:03:19.218 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-10T04:03:19.219 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-10T04:03:19.219 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-10T04:03:19.219 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-10T04:03:19.219 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-10T04:03:19.219 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-10T04:03:19.219 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-10T04:03:19.219 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-10T04:03:19.219 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-10T04:03:19.219 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-10T04:03:19.219 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-10T04:03:19.219 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-10T04:03:19.219 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-10T04:03:19.219 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-10T04:03:19.219 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-10T04:03:19.220 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-10T04:03:19.220 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-10T04:03:19.220 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-10T04:03:19.220 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-10T04:03:19.220 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-10T04:03:19.220 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-10T04:03:19.220 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-10T04:03:19.220 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-10T04:03:19.220 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-10T04:03:19.220 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-10T04:03:19.220 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-10T04:03:19.220 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-10T04:03:19.220 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-10T04:03:19.221 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-10T04:03:19.221 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-10T04:03:19.221 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-10T04:03:19.221 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-10T04:03:19.221 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-10T04:03:19.221 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-10T04:03:19.221 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-10T04:03:19.221 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-10T04:03:19.221 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-10T04:03:19.221 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-10T04:03:19.221 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-10T04:03:19.221 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-10T04:03:19.221 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-10T04:03:19.221 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-10T04:03:19.222 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-10T04:03:19.222 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-10T04:03:19.222 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-10T04:03:19.222 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-10T04:03:19.222 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-10T04:03:19.222 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-10T04:03:19.222 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-10T04:03:19.222 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-10T04:03:19.222 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-10T04:03:19.222 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-10T04:03:19.222 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-10T04:03:19.222 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-10T04:03:19.222 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-10T04:03:19.223 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-10T04:03:19.223 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-10T04:03:19.223 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-10T04:03:19.223 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-10T04:03:19.223 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-10T04:03:19.223 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-10T04:03:19.223 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-10T04:03:19.223 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-10T04:03:19.223 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-10T04:03:19.223 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-10T04:03:19.223 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-10T04:03:19.223 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-10T04:03:19.223 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-10T04:03:19.223 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-10T04:03:19.224 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-10T04:03:19.224 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-10T04:03:19.224 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-10T04:03:19.224 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-10T04:03:19.224 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-10T04:03:19.224 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-10T04:03:19.224 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-10T04:03:19.224 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-10T04:03:19.224 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-10T04:03:19.224 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-10T04:03:19.224 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-10T04:03:19.224 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-10T04:03:19.225 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-10T04:03:19.225 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-10T04:03:19.225 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-10T04:03:19.225 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-10T04:03:19.225 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-10T04:03:19.225 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-10T04:03:19.225 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-10T04:03:19.225 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-10T04:03:19.225 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-10T04:03:19.225 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-10T04:03:19.225 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-10T04:03:19.225 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-10T04:03:19.225 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-10T04:03:19.225 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-10T04:03:19.226 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-10T04:03:19.226 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-10T04:03:19.226 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-10T04:03:19.226 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-10T04:03:19.226 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-10T04:03:19.226 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-10T04:03:19.226 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-10T04:03:19.226 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-10T04:03:19.226 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-10T04:03:19.226 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-10T04:03:19.226 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-10T04:03:19.226 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-10T04:03:19.226 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-10T04:03:19.227 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-10T04:03:19.227 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-10T04:03:19.227 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-10T04:03:19.227 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-10T04:03:19.227 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-10T04:03:19.227 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-10T04:03:19.227 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-10T04:03:19.227 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-10T04:03:19.227 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-10T04:03:19.227 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-10T04:03:19.227 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-10T04:03:19.227 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-10T04:03:19.227 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-10T04:03:19.227 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-10T04:03:19.228 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-10T04:03:19.228 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-10T04:03:19.228 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-10T04:03:19.228 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-10T04:03:19.228 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-10T04:03:19.228 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-10T04:03:19.228 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-10T04:03:19.228 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-10T04:03:19.228 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-10T04:03:19.228 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-10T04:03:19.228 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-10T04:03:19.228 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-10T04:03:19.228 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-10T04:03:19.228 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-10T04:03:19.229 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-10T04:03:19.229 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-10T04:03:19.229 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-10T04:03:19.229 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-10T04:03:19.229 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-10T04:03:19.229 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-10T04:03:19.229 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-10T04:03:19.229 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-10T04:03:19.229 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-10T04:03:19.229 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-10T04:03:19.229 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-10T04:03:19.229 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-10T04:03:19.229 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-10T04:03:19.229 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-10T04:03:19.230 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-10T04:03:19.230 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-10T04:03:19.230 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-10T04:03:19.230 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-10T04:03:19.230 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-10T04:03:19.230 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-10T04:03:19.230 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-10T04:03:19.230 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-10T04:03:19.230 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-10T04:03:19.230 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-10T04:03:19.230 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-10T04:03:19.230 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-10T04:03:19.230 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-10T04:03:19.230 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-10T04:03:19.231 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-10T04:03:19.231 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-10T04:03:19.231 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-10T04:03:19.231 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-10T04:03:19.231 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-10T04:03:19.231 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-10T04:03:19.231 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-10T04:03:19.231 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-10T04:03:19.231 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-10T04:03:19.231 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-10T04:03:19.231 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-10T04:03:19.231 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-10T04:03:19.231 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-10T04:03:19.231 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-10T04:03:19.232 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-10T04:03:19.232 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-10T04:03:19.232 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-10T04:03:19.232 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-10T04:03:19.232 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-10T04:03:19.232 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-10T04:03:19.232 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-10T04:03:19.232 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-10T04:03:19.232 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-10T04:03:19.232 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-10T04:03:19.232 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-10T04:03:19.232 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-10T04:03:19.232 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-10T04:03:19.232 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-10T04:03:19.233 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-10T04:03:19.233 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-10T04:03:19.233 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-10T04:03:19.233 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-10T04:03:19.233 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-10T04:03:19.233 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-10T04:03:19.233 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-10T04:03:19.233 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-10T04:03:19.233 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-10T04:03:19.233 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-10T04:03:19.233 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-10T04:03:19.233 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-10T04:03:19.233 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-10T04:03:19.233 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-10T04:03:19.234 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-10T04:03:19.234 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-10T04:03:19.234 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-10T04:03:19.234 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-10T04:03:19.234 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-10T04:03:19.234 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-10T04:03:19.234 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-10T04:03:19.234 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-10T04:03:19.234 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-10T04:03:19.234 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-10T04:03:19.234 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-10T04:03:19.234 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-10T04:03:19.234 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-10T04:03:19.234 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-10T04:03:19.235 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-10T04:03:19.235 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-10T04:03:19.235 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-10T04:03:19.235 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-10T04:03:19.235 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-10T04:03:19.235 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-10T04:03:19.235 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-10T04:03:19.235 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-10T04:03:19.235 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-10T04:03:19.235 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-10T04:03:19.235 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-10T04:03:19.235 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-10T04:03:19.235 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-10T04:03:19.236 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-10T04:03:19.236 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-10T04:03:19.236 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-10T04:03:19.236 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-10T04:03:19.236 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-10T04:03:19.236 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-10T04:03:19.236 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-10T04:03:19.236 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-10T04:03:19.236 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-10T04:03:19.236 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-10T04:03:19.236 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-10T04:03:19.236 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-10T04:03:19.236 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-10T04:03:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-10T04:03:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-10T04:03:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-10T04:03:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-10T04:03:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-10T04:03:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-10T04:03:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-10T04:03:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-10T04:03:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-10T04:03:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-10T04:03:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-10T04:03:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-10T04:03:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-10T04:03:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-10T04:03:19.238 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-10T04:03:19.238 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-10T04:03:19.238 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-10T04:03:19.238 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-10T04:03:19.238 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-10T04:03:19.238 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-10T04:03:19.238 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-10T04:03:19.238 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-10T04:03:19.238 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-10T04:03:19.238 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-10T04:03:19.238 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-10T04:03:19.238 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-10T04:03:19.238 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-10T04:03:19.239 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-10T04:03:19.239 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-10T04:03:19.239 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-10T04:03:19.239 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-10T04:03:19.239 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-10T04:03:19.239 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-10T04:03:19.239 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-10T04:03:19.239 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-10T04:03:19.239 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-10T04:03:19.239 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-10T04:03:19.239 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-10T04:03:19.239 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-10T04:03:19.239 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-10T04:03:19.240 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-10T04:03:19.240 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-10T04:03:19.240 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-10T04:03:19.240 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-10T04:03:19.240 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-10T04:03:19.240 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-10T04:03:19.240 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-10T04:03:19.240 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-10T04:03:19.240 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-10T04:03:19.240 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-10T04:03:19.240 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-10T04:03:19.240 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-10T04:03:19.240 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-10T04:03:19.240 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-10T04:03:19.241 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-10T04:03:19.241 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-10T04:03:19.241 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-10T04:03:19.241 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-10T04:03:19.241 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-10T04:03:19.241 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-10T04:03:19.241 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-10T04:03:19.241 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-10T04:03:19.241 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-10T04:03:19.241 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-10T04:03:19.241 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-10T04:03:19.241 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-10T04:03:19.241 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-10T04:03:19.241 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-10T04:03:19.242 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-10T04:03:19.242 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-10T04:03:19.242 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-10T04:03:19.242 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-10T04:03:19.242 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-10T04:03:19.242 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-10T04:03:19.242 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-10T04:03:19.242 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-10T04:03:19.242 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-10T04:03:19.242 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-10T04:03:19.242 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-10T04:03:19.242 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-10T04:03:19.242 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-10T04:03:19.242 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-10T04:03:19.243 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-10T04:03:19.243 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-10T04:03:19.243 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-10T04:03:19.243 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-10T04:03:19.243 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-10T04:03:19.243 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-10T04:03:19.243 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-10T04:03:19.243 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-10T04:03:19.243 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-10T04:03:19.243 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-10T04:03:19.243 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-10T04:03:19.243 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-10T04:03:19.243 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-10T04:03:19.243 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-10T04:03:19.244 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-10T04:03:19.244 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-10T04:03:19.244 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-10T04:03:19.244 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-10T04:03:19.244 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-10T04:03:19.244 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-10T04:03:19.244 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-10T04:03:19.244 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-10T04:03:19.244 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-10T04:03:19.244 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-10T04:03:19.244 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-10T04:03:19.244 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-10T04:03:19.244 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-10T04:03:19.245 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-10T04:03:19.245 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-10T04:03:19.245 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-10T04:03:19.245 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-10T04:03:19.245 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-10T04:03:19.245 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-10T04:03:19.245 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-10T04:03:19.245 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-10T04:03:19.245 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-10T04:03:19.245 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-10T04:03:19.245 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-10T04:03:19.245 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-10T04:03:19.245 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-10T04:03:19.245 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-10T04:03:19.246 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-10T04:03:19.246 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-10T04:03:19.246 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-10T04:03:19.246 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-10T04:03:19.246 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-10T04:03:19.246 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-10T04:03:19.246 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-10T04:03:19.246 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-10T04:03:19.246 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-10T04:03:19.246 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-10T04:03:19.246 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-10T04:03:19.246 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-10T04:03:19.246 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-10T04:03:19.246 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-10T04:03:19.247 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-10T04:03:19.247 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-10T04:03:19.247 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-10T04:03:19.247 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-10T04:03:19.247 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-10T04:03:19.247 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-10T04:03:19.247 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-10T04:03:19.247 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-10T04:03:19.247 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-10T04:03:19.247 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-10T04:03:19.247 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-10T04:03:19.247 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-10T04:03:19.247 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-10T04:03:19.247 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-10T04:03:19.248 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-10T04:03:19.248 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-10T04:03:19.248 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-10T04:03:19.248 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-10T04:03:19.248 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-10T04:03:19.248 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-10T04:03:19.248 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-10T04:03:19.248 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-10T04:03:19.248 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-10T04:03:19.248 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-10T04:03:19.248 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-10T04:03:19.248 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-10T04:03:19.248 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-10T04:03:19.248 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-10T04:03:19.249 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-10T04:03:19.249 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-10T04:03:19.249 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-10T04:03:19.249 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-10T04:03:19.249 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-10T04:03:19.249 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-10T04:03:19.249 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-10T04:03:19.249 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-10T04:03:19.249 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-10T04:03:19.249 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-10T04:03:19.249 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-10T04:03:19.249 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-10T04:03:19.249 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-10T04:03:19.250 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-10T04:03:19.250 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-10T04:03:19.250 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-10T04:03:19.250 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-10T04:03:19.250 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-10T04:03:19.250 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-10T04:03:19.250 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-10T04:03:19.250 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-10T04:03:19.250 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-10T04:03:19.250 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-10T04:03:19.250 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-10T04:03:19.250 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-10T04:03:19.250 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-10T04:03:19.251 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-10T04:03:19.251 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-10T04:03:19.251 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-10T04:03:19.251 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-10T04:03:19.251 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-10T04:03:19.251 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-10T04:03:19.251 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-10T04:03:19.251 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-10T04:03:19.251 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-10T04:03:19.251 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-10T04:03:19.251 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-10T04:03:19.251 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-10T04:03:19.251 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-10T04:03:19.252 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-10T04:03:19.252 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-10T04:03:19.252 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-10T04:03:19.252 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-10T04:03:19.252 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-10T04:03:19.252 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-10T04:03:19.252 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-10T04:03:19.252 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-10T04:03:19.252 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-10T04:03:19.252 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-10T04:03:19.252 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-10T04:03:19.252 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-10T04:03:19.252 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-10T04:03:19.252 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-10T04:03:19.253 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-10T04:03:19.253 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-10T04:03:19.253 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-10T04:03:19.253 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-10T04:03:19.253 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-10T04:03:19.253 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-10T04:03:19.253 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-10T04:03:19.253 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-10T04:03:19.253 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-10T04:03:19.253 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-10T04:03:19.253 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-10T04:03:19.253 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-10T04:03:19.253 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-10T04:03:19.254 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-10T04:03:19.254 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-10T04:03:19.254 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-10T04:03:19.254 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-10T04:03:19.254 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-10T04:03:19.254 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-10T04:03:19.254 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-10T04:03:19.254 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-10T04:03:19.254 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-10T04:03:19.254 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-10T04:03:19.254 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-10T04:03:19.254 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-10T04:03:19.254 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-10T04:03:19.255 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-10T04:03:19.255 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-10T04:03:19.255 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-10T04:03:19.255 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-10T04:03:19.255 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-10T04:03:19.255 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-10T04:03:19.255 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-10T04:03:19.255 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-10T04:03:19.255 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-10T04:03:19.255 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-10T04:03:19.255 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-10T04:03:19.255 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-10T04:03:19.255 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-10T04:03:19.255 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-10T04:03:19.256 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-10T04:03:19.256 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-10T04:03:19.256 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-10T04:03:19.256 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-10T04:03:19.256 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-10T04:03:19.256 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-10T04:03:19.256 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-10T04:03:19.256 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-10T04:03:19.256 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-10T04:03:19.256 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-10T04:03:19.256 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-10T04:03:19.256 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-10T04:03:19.256 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-10T04:03:19.256 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-10T04:03:19.256 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-10T04:03:19.257 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-10T04:03:19.257 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-10T04:03:19.257 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-10T04:03:19.257 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-10T04:03:19.257 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-10T04:03:19.257 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-10T04:03:19.257 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-10T04:03:19.257 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-10T04:03:19.257 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-10T04:03:19.257 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-10T04:03:19.257 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-10T04:03:19.257 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-10T04:03:19.257 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-10T04:03:19.257 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-10T04:03:19.258 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-10T04:03:19.258 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-10T04:03:19.258 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-10T04:03:19.258 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-10T04:03:19.258 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-10T04:03:19.258 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-10T04:03:19.258 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-10T04:03:19.258 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-10T04:03:19.258 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-10T04:03:19.258 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-10T04:03:19.258 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-10T04:03:19.258 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-10T04:03:19.258 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-10T04:03:19.259 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-10T04:03:19.259 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-10T04:03:19.259 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-10T04:03:19.259 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-10T04:03:19.259 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-10T04:03:19.259 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-10T04:03:19.259 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-10T04:03:19.259 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-10T04:03:19.259 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-10T04:03:19.259 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-10T04:03:19.259 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-10T04:03:19.259 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-10T04:03:19.259 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-10T04:03:19.259 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-10T04:03:19.260 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-10T04:03:19.260 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-10T04:03:19.260 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-10T04:03:19.260 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-10T04:03:19.260 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-10T04:03:19.260 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-10T04:03:19.260 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-10T04:03:19.260 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-10T04:03:19.260 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-10T04:03:19.260 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-10T04:03:19.260 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-10T04:03:19.260 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-10T04:03:19.260 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-10T04:03:19.261 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-10T04:03:19.261 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-10T04:03:19.261 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-10T04:03:19.261 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-10T04:03:19.261 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-10T04:03:19.261 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-10T04:03:19.261 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-10T04:03:19.261 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-10T04:03:19.261 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-10T04:03:19.261 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-10T04:03:19.261 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-10T04:03:19.261 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-10T04:03:19.261 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-10T04:03:19.261 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-10T04:03:19.261 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-10T04:03:19.262 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-10T04:03:19.262 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-10T04:03:19.262 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-10T04:03:19.262 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-10T04:03:19.262 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-10T04:03:19.262 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-10T04:03:19.262 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-10T04:03:19.262 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-10T04:03:19.262 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-10T04:03:19.262 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-10T04:03:19.262 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-10T04:03:19.262 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-10T04:03:19.262 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-10T04:03:19.263 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-10T04:03:19.263 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-10T04:03:19.263 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-10T04:03:19.263 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-10T04:03:19.263 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-10T04:03:19.263 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-10T04:03:19.263 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-10T04:03:19.263 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-10T04:03:19.263 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-10T04:03:19.263 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-10T04:03:19.263 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-10T04:03:19.263 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-10T04:03:19.263 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-10T04:03:19.264 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-10T04:03:19.264 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-10T04:03:19.264 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-10T04:03:19.264 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-10T04:03:19.264 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-10T04:03:19.264 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-10T04:03:19.264 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-10T04:03:19.264 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-10T04:03:19.264 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-10T04:03:19.264 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-10T04:03:19.264 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-10T04:03:19.264 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-10T04:03:19.264 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-10T04:03:19.264 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-10T04:03:19.265 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-10T04:03:19.265 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-10T04:03:19.265 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-10T04:03:19.265 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-10T04:03:19.265 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-10T04:03:19.265 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-10T04:03:19.265 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-10T04:03:19.265 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-10T04:03:19.265 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-10T04:03:19.265 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-10T04:03:19.265 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-10T04:03:19.265 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-10T04:03:19.265 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-10T04:03:19.266 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-10T04:03:19.266 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-10T04:03:19.266 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-10T04:03:19.266 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-10T04:03:19.266 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-10T04:03:19.266 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-10T04:03:19.266 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-10T04:03:19.266 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-10T04:03:19.266 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-10T04:03:19.266 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-10T04:03:19.266 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-10T04:03:19.266 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-10T04:03:19.266 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-10T04:03:19.267 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-10T04:03:19.267 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-10T04:03:19.267 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-10T04:03:19.267 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-10T04:03:19.267 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-10T04:03:19.267 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-10T04:03:19.267 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-10T04:03:19.267 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-10T04:03:19.267 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-10T04:03:19.267 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-10T04:03:19.267 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-10T04:03:19.267 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-10T04:03:19.267 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-10T04:03:19.267 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-10T04:03:19.267 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-10T04:03:19.268 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-10T04:03:19.268 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-10T04:03:19.268 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-10T04:03:19.268 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-10T04:03:19.268 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-10T04:03:19.268 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-10T04:03:19.268 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-10T04:03:19.268 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-10T04:03:19.268 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-10T04:03:19.268 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-10T04:03:19.268 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-10T04:03:19.268 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-10T04:03:19.268 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-10T04:03:19.269 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-10T04:03:19.269 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-10T04:03:19.269 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-10T04:03:19.269 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-10T04:03:19.269 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-10T04:03:19.269 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-10T04:03:19.269 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-10T04:03:19.269 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-10T04:03:19.269 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-10T04:03:19.269 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-10T04:03:19.270 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-10T04:03:19.270 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-10T04:03:19.270 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-10T04:03:19.270 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-10T04:03:19.270 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-10T04:03:19.270 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-10T04:03:19.270 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-10T04:03:19.270 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-10T04:03:19.270 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-10T04:03:19.270 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-10T04:03:19.270 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-10T04:03:19.270 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-10T04:03:19.270 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-10T04:03:19.271 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-10T04:03:19.271 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-10T04:03:19.271 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-10T04:03:19.271 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-10T04:03:19.271 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-10T04:03:19.271 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-10T04:03:19.271 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-10T04:03:19.271 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-10T04:03:19.271 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-10T04:03:19.271 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-10T04:03:19.271 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-10T04:03:19.271 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-10T04:03:19.271 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-10T04:03:19.271 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-10T04:03:19.272 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-10T04:03:19.272 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-10T04:03:19.272 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-10T04:03:19.272 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-10T04:03:19.272 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-10T04:03:19.272 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-10T04:03:19.272 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-10T04:03:19.272 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-10T04:03:19.272 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-10T04:03:19.272 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-10T04:03:19.272 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-10T04:03:19.272 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-10T04:03:19.272 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-10T04:03:19.273 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-10T04:03:19.273 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-10T04:03:19.273 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-10T04:03:19.273 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-10T04:03:19.273 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-10T04:03:19.273 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-10T04:03:19.273 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-10T04:03:19.273 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-10T04:03:19.273 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-10T04:03:19.273 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-10T04:03:19.273 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-10T04:03:19.273 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-10T04:03:19.273 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-10T04:03:19.273 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-10T04:03:19.274 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-10T04:03:19.274 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-10T04:03:19.274 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-10T04:03:19.274 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-10T04:03:19.274 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-10T04:03:19.274 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-10T04:03:19.274 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-10T04:03:19.274 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-10T04:03:19.274 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-10T04:03:19.274 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-10T04:03:19.274 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-10T04:03:19.274 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-10T04:03:19.274 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-10T04:03:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-10T04:03:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-10T04:03:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-10T04:03:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-10T04:03:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-10T04:03:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-10T04:03:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-10T04:03:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-10T04:03:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-10T04:03:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-10T04:03:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-10T04:03:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-10T04:03:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-10T04:03:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-10T04:03:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-10T04:03:19.276 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-10T04:03:19.276 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-10T04:03:19.276 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-10T04:03:19.276 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-10T04:03:19.276 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-10T04:03:19.276 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-10T04:03:19.276 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-10T04:03:19.276 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-10T04:03:19.276 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-10T04:03:19.276 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-10T04:03:19.276 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-10T04:03:19.276 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-10T04:03:19.277 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-10T04:03:19.277 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-10T04:03:19.277 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-10T04:03:19.277 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-10T04:03:19.277 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-10T04:03:19.277 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-10T04:03:19.277 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-10T04:03:19.277 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-10T04:03:19.277 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-10T04:03:19.277 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-10T04:03:19.277 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-10T04:03:19.277 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-10T04:03:19.277 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-10T04:03:19.277 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-10T04:03:19.277 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-10T04:03:19.278 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-10T04:03:19.278 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-10T04:03:19.278 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-10T04:03:19.278 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-10T04:03:19.278 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-10T04:03:19.278 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-10T04:03:19.278 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-10T04:03:19.278 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-10T04:03:19.278 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-10T04:03:19.279 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-10T04:03:19.279 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-10T04:03:19.279 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-10T04:03:19.279 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-10T04:03:19.279 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-10T04:03:19.279 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-10T04:03:19.279 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-10T04:03:19.279 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-10T04:03:19.279 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-10T04:03:19.279 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-10T04:03:19.279 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-10T04:03:19.279 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-10T04:03:19.279 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-10T04:03:19.279 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-10T04:03:19.279 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-10T04:03:19.280 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-10T04:03:19.280 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-10T04:03:19.280 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-10T04:03:19.280 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-10T04:03:19.280 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-10T04:03:19.280 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-10T04:03:19.280 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-10T04:03:19.280 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-10T04:03:19.280 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-10T04:03:19.280 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-10T04:03:19.280 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-10T04:03:19.280 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-10T04:03:19.280 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-10T04:03:19.280 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-10T04:03:19.281 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-10T04:03:19.281 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-10T04:03:19.281 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-10T04:03:19.281 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-10T04:03:19.281 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-10T04:03:19.281 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-10T04:03:19.281 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-10T04:03:19.281 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-10T04:03:19.281 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-10T04:03:19.281 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-10T04:03:19.281 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-10T04:03:19.281 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-10T04:03:19.281 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-10T04:03:19.281 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-10T04:03:19.282 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-10T04:03:19.282 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-10T04:03:19.282 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-10T04:03:19.282 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-10T04:03:19.282 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-10T04:03:19.282 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-10T04:03:19.282 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-10T04:03:19.282 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-10T04:03:19.282 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-10T04:03:19.282 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-10T04:03:19.282 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-10T04:03:19.282 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-10T04:03:19.282 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-10T04:03:19.282 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-10T04:03:19.283 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-10T04:03:19.283 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-10T04:03:19.283 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-10T04:03:19.283 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-10T04:03:19.283 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-10T04:03:19.283 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-10T04:03:19.283 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-10T04:03:19.283 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-10T04:03:19.283 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-10T04:03:19.283 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-10T04:03:19.283 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-10T04:03:19.283 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-10T04:03:19.283 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-10T04:03:19.283 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-10T04:03:19.284 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-10T04:03:19.284 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-10T04:03:19.284 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-10T04:03:19.284 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-10T04:03:19.284 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-10T04:03:19.284 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-10T04:03:19.284 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-10T04:03:19.284 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-10T04:03:19.284 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-10T04:03:19.284 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-10T04:03:19.284 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-10T04:03:19.284 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-10T04:03:19.284 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-10T04:03:19.284 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-10T04:03:19.284 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-10T04:03:19.285 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-10T04:03:19.285 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-10T04:03:19.285 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-10T04:03:19.285 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-10T04:03:19.285 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-10T04:03:19.285 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-10T04:03:19.285 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-10T04:03:19.285 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-10T04:03:19.285 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-10T04:03:19.285 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-10T04:03:19.285 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-10T04:03:19.285 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-10T04:03:19.286 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-10T04:03:19.286 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-10T04:03:19.286 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-10T04:03:19.286 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-10T04:03:19.286 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-10T04:03:19.286 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-10T04:03:19.286 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-10T04:03:19.286 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-10T04:03:19.286 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-10T04:03:19.286 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-10T04:03:19.286 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-10T04:03:19.286 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-10T04:03:19.286 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-10T04:03:19.286 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-10T04:03:19.287 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-10T04:03:19.287 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-10T04:03:19.287 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-10T04:03:19.287 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-10T04:03:19.287 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-10T04:03:19.287 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-10T04:03:19.287 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-10T04:03:19.287 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-10T04:03:19.287 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-10T04:03:19.287 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-10T04:03:19.287 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-10T04:03:19.287 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-10T04:03:19.287 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-10T04:03:19.287 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-10T04:03:19.288 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-10T04:03:19.288 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-10T04:03:19.288 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-10T04:03:19.288 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-10T04:03:19.288 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-10T04:03:19.288 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-10T04:03:19.288 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-10T04:03:19.288 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-10T04:03:19.288 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-10T04:03:19.288 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-10T04:03:19.288 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-10T04:03:19.288 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-10T04:03:19.288 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-10T04:03:19.289 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-10T04:03:19.289 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-10T04:03:19.289 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-10T04:03:19.289 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-10T04:03:19.289 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-10T04:03:19.289 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-10T04:03:19.289 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-10T04:03:19.289 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-10T04:03:19.289 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-10T04:03:19.289 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-10T04:03:19.289 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-10T04:03:19.289 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-10T04:03:19.289 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-10T04:03:19.289 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-10T04:03:19.290 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-10T04:03:19.290 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-10T04:03:19.290 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-10T04:03:19.290 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-10T04:03:19.290 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-10T04:03:19.290 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-10T04:03:19.290 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-10T04:03:19.290 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-10T04:03:19.290 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-10T04:03:19.290 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-10T04:03:19.290 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-10T04:03:19.290 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-10T04:03:19.290 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-10T04:03:19.290 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-10T04:03:19.291 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-10T04:03:19.291 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-10T04:03:19.291 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-10T04:03:19.291 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-10T04:03:19.291 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-10T04:03:19.291 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-10T04:03:19.291 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-10T04:03:19.291 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-10T04:03:19.291 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-10T04:03:19.291 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-10T04:03:19.291 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-10T04:03:19.291 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-10T04:03:19.291 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-10T04:03:19.291 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-10T04:03:19.291 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-10T04:03:19.292 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-10T04:03:19.292 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-10T04:03:19.292 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-10T04:03:19.292 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-10T04:03:19.292 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-10T04:03:19.292 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-10T04:03:19.292 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-10T04:03:19.292 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-10T04:03:19.292 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-10T04:03:19.292 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-10T04:03:19.292 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-10T04:03:19.292 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-10T04:03:19.292 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-10T04:03:19.292 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-10T04:03:19.293 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-10T04:03:19.293 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-10T04:03:19.293 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-10T04:03:19.293 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-10T04:03:19.293 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-10T04:03:19.293 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-10T04:03:19.293 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-10T04:03:19.293 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-10T04:03:19.293 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-10T04:03:19.293 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-10T04:03:19.293 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-10T04:03:19.293 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-10T04:03:19.293 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-10T04:03:19.294 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-10T04:03:19.294 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-10T04:03:19.294 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-10T04:03:19.294 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-10T04:03:19.294 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-10T04:03:19.294 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-10T04:03:19.294 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-10T04:03:19.294 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-10T04:03:19.294 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-10T04:03:19.294 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-10T04:03:19.294 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-10T04:03:19.294 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-10T04:03:19.294 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-10T04:03:19.294 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-10T04:03:19.295 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-10T04:03:19.295 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-10T04:03:19.295 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-10T04:03:19.295 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-10T04:03:19.295 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-10T04:03:19.295 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-10T04:03:19.295 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-10T04:03:19.295 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-10T04:03:19.295 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-10T04:03:19.295 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-10T04:03:19.295 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-10T04:03:19.295 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-10T04:03:19.295 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-10T04:03:19.295 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-10T04:03:19.296 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-10T04:03:19.296 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-10T04:03:19.296 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-10T04:03:19.296 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-10T04:03:19.296 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-10T04:03:19.296 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-10T04:03:19.296 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-10T04:03:19.296 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-10T04:03:19.296 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-10T04:03:19.296 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-10T04:03:19.296 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-10T04:03:19.296 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-10T04:03:19.296 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-10T04:03:19.296 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-10T04:03:19.297 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-10T04:03:19.297 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-10T04:03:19.297 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-10T04:03:19.297 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-10T04:03:19.297 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-10T04:03:19.297 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-10T04:03:19.297 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-10T04:03:19.297 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-10T04:03:19.297 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-10T04:03:19.297 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-10T04:03:19.297 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-10T04:03:19.297 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-10T04:03:19.297 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-10T04:03:19.297 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-10T04:03:19.298 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-10T04:03:19.298 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-10T04:03:19.298 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-10T04:03:19.298 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-10T04:03:19.298 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-10T04:03:19.298 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-10T04:03:19.298 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-10T04:03:19.298 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-10T04:03:19.298 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-10T04:03:19.298 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-10T04:03:19.298 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-10T04:03:19.298 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-10T04:03:19.298 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-10T04:03:19.298 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-10T04:03:19.299 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-10T04:03:19.299 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-10T04:03:19.299 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-10T04:03:19.299 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-10T04:03:19.299 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-10T04:03:19.299 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-10T04:03:19.299 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-10T04:03:19.299 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-10T04:03:19.299 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-10T04:03:19.299 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-10T04:03:19.299 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-10T04:03:19.299 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-10T04:03:19.299 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-10T04:03:19.299 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-10T04:03:19.300 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-10T04:03:19.300 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-10T04:03:19.300 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-10T04:03:19.300 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-10T04:03:19.300 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-10T04:03:19.300 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-10T04:03:19.300 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-10T04:03:19.300 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-10T04:03:19.300 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-10T04:03:19.300 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-10T04:03:19.300 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-10T04:03:19.300 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-10T04:03:19.300 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-10T04:03:19.300 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-10T04:03:19.301 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-10T04:03:19.301 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-10T04:03:19.301 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-10T04:03:19.301 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-10T04:03:19.301 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-10T04:03:19.301 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-10T04:03:19.301 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-10T04:03:19.301 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-10T04:03:19.301 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-10T04:03:19.301 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-10T04:03:19.301 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-10T04:03:19.301 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-10T04:03:19.301 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-10T04:03:19.301 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-10T04:03:19.302 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-10T04:03:19.302 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-10T04:03:19.302 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-10T04:03:19.302 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-10T04:03:19.302 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-10T04:03:19.302 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-10T04:03:19.302 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-10T04:03:19.302 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-10T04:03:19.302 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-10T04:03:19.302 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-10T04:03:19.302 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-10T04:03:19.302 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-10T04:03:19.302 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-10T04:03:19.303 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-10T04:03:19.303 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-10T04:03:19.303 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-10T04:03:19.303 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-10T04:03:19.303 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-10T04:03:19.303 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-10T04:03:19.303 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-10T04:03:19.303 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-10T04:03:19.303 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-10T04:03:19.303 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-10T04:03:19.303 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-10T04:03:19.303 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-10T04:03:19.303 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-10T04:03:19.304 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-10T04:03:19.304 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-10T04:03:19.304 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-10T04:03:19.304 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-10T04:03:19.304 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-10T04:03:19.304 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-10T04:03:19.304 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-10T04:03:19.304 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-10T04:03:19.304 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-10T04:03:19.304 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-10T04:03:19.304 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-10T04:03:19.304 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-10T04:03:19.304 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-10T04:03:19.304 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-10T04:03:19.304 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-10T04:03:19.305 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-10T04:03:19.305 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-10T04:03:19.305 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-10T04:03:19.305 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-10T04:03:19.305 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-10T04:03:19.305 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-10T04:03:19.305 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-10T04:03:19.305 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-10T04:03:19.305 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-10T04:03:19.305 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-10T04:03:19.305 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-10T04:03:19.305 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-10T04:03:19.305 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-10T04:03:19.306 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-10T04:03:19.306 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-10T04:03:19.306 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-10T04:03:19.306 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-10T04:03:19.306 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-10T04:03:19.306 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-10T04:03:19.306 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-10T04:03:19.306 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-10T04:03:19.306 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-10T04:03:19.306 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-10T04:03:19.306 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-10T04:03:19.306 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-10T04:03:19.306 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-10T04:03:19.306 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-10T04:03:19.307 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-10T04:03:19.307 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-10T04:03:19.307 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-10T04:03:19.307 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-10T04:03:19.307 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-10T04:03:19.307 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-10T04:03:19.307 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-10T04:03:19.307 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-10T04:03:19.307 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-10T04:03:19.307 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-10T04:03:19.307 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-10T04:03:19.307 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-10T04:03:19.307 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-10T04:03:19.307 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-10T04:03:19.308 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-10T04:03:19.308 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-10T04:03:19.308 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-10T04:03:19.308 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-10T04:03:19.308 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-10T04:03:19.308 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-10T04:03:19.308 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-10T04:03:19.308 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-10T04:03:19.308 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-10T04:03:19.308 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-10T04:03:19.308 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-10T04:03:19.308 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-10T04:03:19.308 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-10T04:03:19.308 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-10T04:03:19.309 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-10T04:03:19.309 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-10T04:03:19.309 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-10T04:03:19.309 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-10T04:03:19.309 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-10T04:03:19.309 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-10T04:03:19.309 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-10T04:03:19.309 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-10T04:03:19.309 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-10T04:03:19.309 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-10T04:03:19.309 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-10T04:03:19.309 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-10T04:03:19.309 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-10T04:03:19.309 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-10T04:03:19.310 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-10T04:03:19.310 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-10T04:03:19.310 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-10T04:03:19.310 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-10T04:03:19.310 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-10T04:03:19.310 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-10T04:03:19.310 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-10T04:03:19.310 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-10T04:03:19.310 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-10T04:03:19.310 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-10T04:03:19.310 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-10T04:03:19.310 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-10T04:03:19.310 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-10T04:03:19.311 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-10T04:03:19.311 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-10T04:03:19.311 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-10T04:03:19.311 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-10T04:03:19.311 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-10T04:03:19.311 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-10T04:03:19.311 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-10T04:03:19.311 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-10T04:03:19.311 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-10T04:03:19.311 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-10T04:03:19.311 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-10T04:03:19.311 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-10T04:03:19.311 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-10T04:03:19.311 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-10T04:03:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-10T04:03:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-10T04:03:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-10T04:03:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-10T04:03:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-10T04:03:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-10T04:03:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-10T04:03:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-10T04:03:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-10T04:03:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-10T04:03:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-10T04:03:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-10T04:03:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-10T04:03:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-10T04:03:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-10T04:03:19.313 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-10T04:03:19.313 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-10T04:03:19.313 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-10T04:03:19.313 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-10T04:03:19.313 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-10T04:03:19.313 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-10T04:03:19.313 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-10T04:03:19.313 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-10T04:03:19.313 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-10T04:03:19.313 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-10T04:03:19.313 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-10T04:03:19.313 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-10T04:03:19.313 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-10T04:03:19.313 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-10T04:03:19.314 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-10T04:03:19.314 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-10T04:03:19.314 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-10T04:03:19.314 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-10T04:03:19.314 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-10T04:03:19.314 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-10T04:03:19.314 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-10T04:03:19.314 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-10T04:03:19.314 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-10T04:03:19.314 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-10T04:03:19.314 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-10T04:03:19.314 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-10T04:03:19.314 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-10T04:03:19.314 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-10T04:03:19.315 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-10T04:03:19.315 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-10T04:03:19.315 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-10T04:03:19.315 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-10T04:03:19.315 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-10T04:03:19.315 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-10T04:03:19.315 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-10T04:03:19.315 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-10T04:03:19.315 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-10T04:03:19.315 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-10T04:03:19.315 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-10T04:03:19.315 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-10T04:03:19.315 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-10T04:03:19.315 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-10T04:03:19.316 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-10T04:03:19.316 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-10T04:03:19.316 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-10T04:03:19.316 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-10T04:03:19.316 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-10T04:03:19.316 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-10T04:03:19.316 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-10T04:03:19.316 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-10T04:03:19.316 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-10T04:03:19.316 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-10T04:03:19.316 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-10T04:03:19.316 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-10T04:03:19.316 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-10T04:03:19.316 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-10T04:03:19.317 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-10T04:03:19.317 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-10T04:03:19.317 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-10T04:03:19.317 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-10T04:03:19.317 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-10T04:03:19.317 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-10T04:03:19.317 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-10T04:03:19.317 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-10T04:03:19.317 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-10T04:03:19.317 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-10T04:03:19.317 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-10T04:03:19.317 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-10T04:03:19.317 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-10T04:03:19.317 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-10T04:03:19.318 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-10T04:03:19.318 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-10T04:03:19.318 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-10T04:03:19.318 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-10T04:03:19.318 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-10T04:03:19.318 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-10T04:03:19.318 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-10T04:03:19.318 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-10T04:03:19.318 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-10T04:03:19.318 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-10T04:03:19.318 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-10T04:03:19.318 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-10T04:03:19.318 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-10T04:03:19.318 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-10T04:03:19.319 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-10T04:03:19.319 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-10T04:03:19.319 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-10T04:03:19.319 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-10T04:03:19.319 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-10T04:03:19.319 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-10T04:03:19.319 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-10T04:03:19.319 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-10T04:03:19.319 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-10T04:03:19.319 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-10T04:03:19.319 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-10T04:03:19.319 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-10T04:03:19.319 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-10T04:03:19.320 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-10T04:03:19.320 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-10T04:03:19.320 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-10T04:03:19.320 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-10T04:03:19.320 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-10T04:03:19.320 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-10T04:03:19.320 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-10T04:03:19.320 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-10T04:03:19.320 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-10T04:03:19.320 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-10T04:03:19.320 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-10T04:03:19.320 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-10T04:03:19.320 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-10T04:03:19.320 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-10T04:03:19.320 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-10T04:03:19.321 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-10T04:03:19.321 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-10T04:03:19.321 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-10T04:03:19.321 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-10T04:03:19.321 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-10T04:03:19.321 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-10T04:03:19.321 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-10T04:03:19.321 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-10T04:03:19.321 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-10T04:03:19.321 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-10T04:03:19.321 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-10T04:03:19.321 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-10T04:03:19.321 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-10T04:03:19.321 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-10T04:03:19.322 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-10T04:03:19.322 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-10T04:03:19.322 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-10T04:03:19.322 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-10T04:03:19.322 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-10T04:03:19.322 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-10T04:03:19.322 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-10T04:03:19.322 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-10T04:03:19.322 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-10T04:03:19.322 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-10T04:03:19.322 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-10T04:03:19.322 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-10T04:03:19.322 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-10T04:03:19.322 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-10T04:03:19.323 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-10T04:03:19.323 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-10T04:03:19.323 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-10T04:03:19.323 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-10T04:03:19.323 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-10T04:03:19.323 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-10T04:03:19.323 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-10T04:03:19.323 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-10T04:03:19.323 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-10T04:03:19.323 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-10T04:03:19.323 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-10T04:03:19.323 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-10T04:03:19.323 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-10T04:03:19.323 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-10T04:03:19.324 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-10T04:03:19.324 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-10T04:03:19.324 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-10T04:03:19.324 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-10T04:03:19.324 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-10T04:03:19.324 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-10T04:03:19.324 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-10T04:03:19.324 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-10T04:03:19.324 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-10T04:03:19.324 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-10T04:03:19.324 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-10T04:03:19.324 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-10T04:03:19.324 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-10T04:03:19.324 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-10T04:03:19.325 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-10T04:03:19.325 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-10T04:03:19.325 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-10T04:03:19.325 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-10T04:03:19.325 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-10T04:03:19.325 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-10T04:03:19.325 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-10T04:03:19.325 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-10T04:03:19.325 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-10T04:03:19.325 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-10T04:03:19.325 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-10T04:03:19.325 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-10T04:03:19.325 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-10T04:03:19.325 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-10T04:03:19.325 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-10T04:03:19.326 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-10T04:03:19.326 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-10T04:03:19.326 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-10T04:03:19.326 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-10T04:03:19.326 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-10T04:03:19.326 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-10T04:03:19.326 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-10T04:03:19.326 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-10T04:03:19.326 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-10T04:03:19.326 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-10T04:03:19.326 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-10T04:03:19.326 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-10T04:03:19.326 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-10T04:03:19.326 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-10T04:03:19.327 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-10T04:03:19.327 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-10T04:03:19.327 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-10T04:03:19.327 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-10T04:03:19.327 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-10T04:03:19.327 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-10T04:03:19.327 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-10T04:03:19.327 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-10T04:03:19.327 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-10T04:03:19.327 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-10T04:03:19.327 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-10T04:03:19.327 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-10T04:03:19.327 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-10T04:03:19.327 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-10T04:03:19.327 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-10T04:03:19.328 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-10T04:03:19.328 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-10T04:03:19.328 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-10T04:03:19.328 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-10T04:03:19.328 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-10T04:03:19.328 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-10T04:03:19.328 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-10T04:03:19.328 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-10T04:03:19.328 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-10T04:03:19.328 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-10T04:03:19.328 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-10T04:03:19.328 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-10T04:03:19.328 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-10T04:03:19.329 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-10T04:03:19.329 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-10T04:03:19.329 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-10T04:03:19.329 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-10T04:03:19.329 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-10T04:03:19.329 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-10T04:03:19.329 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-10T04:03:19.329 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-10T04:03:19.329 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-10T04:03:19.329 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-10T04:03:19.329 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-10T04:03:19.329 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-10T04:03:19.329 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-10T04:03:19.329 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-10T04:03:19.330 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-10T04:03:19.330 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-10T04:03:19.330 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-10T04:03:19.330 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-10T04:03:19.330 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-10T04:03:19.330 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-10T04:03:19.330 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-10T04:03:19.330 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-10T04:03:19.330 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-10T04:03:19.330 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-10T04:03:19.330 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-10T04:03:19.330 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-10T04:03:19.330 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-10T04:03:19.330 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-10T04:03:19.331 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-10T04:03:19.331 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-10T04:03:19.331 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-10T04:03:19.331 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-10T04:03:19.331 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-10T04:03:19.331 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-10T04:03:19.331 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-10T04:03:19.331 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-10T04:03:19.331 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-10T04:03:19.331 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-10T04:03:19.331 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-10T04:03:19.331 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-10T04:03:19.331 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-10T04:03:19.331 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-10T04:03:19.332 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-10T04:03:19.332 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-10T04:03:19.332 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-10T04:03:19.332 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-10T04:03:19.332 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-10T04:03:19.332 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-10T04:03:19.332 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-10T04:03:19.332 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-10T04:03:19.332 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-10T04:03:19.332 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-10T04:03:19.332 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-10T04:03:19.332 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-10T04:03:19.332 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-10T04:03:19.332 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-10T04:03:19.333 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-10T04:03:19.333 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-10T04:03:19.333 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-10T04:03:19.333 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-10T04:03:19.333 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-10T04:03:19.333 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-10T04:03:19.333 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-10T04:03:19.333 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-10T04:03:19.333 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-10T04:03:19.333 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-10T04:03:19.333 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-10T04:03:19.333 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-10T04:03:19.333 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-10T04:03:19.333 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-10T04:03:19.334 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-10T04:03:19.334 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-10T04:03:19.334 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-10T04:03:19.334 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-10T04:03:19.334 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-10T04:03:19.334 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-10T04:03:19.334 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-10T04:03:19.334 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-10T04:03:19.334 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-10T04:03:19.334 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-10T04:03:19.334 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-10T04:03:19.334 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-10T04:03:19.334 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-10T04:03:19.334 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-10T04:03:19.335 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-10T04:03:19.335 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-10T04:03:19.335 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-10T04:03:19.335 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-10T04:03:19.335 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-10T04:03:19.335 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-10T04:03:19.335 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-10T04:03:19.335 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-10T04:03:19.335 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-10T04:03:19.335 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-10T04:03:19.335 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-10T04:03:19.335 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-10T04:03:19.335 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-10T04:03:19.335 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-10T04:03:19.336 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-10T04:03:19.336 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-10T04:03:19.336 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-10T04:03:19.336 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-10T04:03:19.336 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-10T04:03:19.336 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-10T04:03:19.336 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-10T04:03:19.336 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-10T04:03:19.337 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-10T04:03:19.337 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-10T04:03:19.337 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-10T04:03:19.337 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-10T04:03:19.337 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-10T04:03:19.337 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-10T04:03:19.337 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-10T04:03:19.337 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-10T04:03:19.337 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-10T04:03:19.338 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-10T04:03:19.338 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-10T04:03:19.338 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-10T04:03:19.338 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-10T04:03:19.338 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-10T04:03:19.338 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-10T04:03:19.338 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-10T04:03:19.338 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-10T04:03:19.338 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-10T04:03:19.338 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-10T04:03:19.338 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-10T04:03:19.338 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-10T04:03:19.339 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-10T04:03:19.339 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-10T04:03:19.339 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-10T04:03:19.339 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-10T04:03:19.339 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-10T04:03:19.339 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-10T04:03:19.339 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-10T04:03:19.339 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-10T04:03:19.339 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-10T04:03:19.339 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-10T04:03:19.339 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-10T04:03:19.339 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-10T04:03:19.340 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-10T04:03:19.340 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-10T04:03:19.340 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-10T04:03:19.340 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-10T04:03:19.340 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-10T04:03:19.340 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-10T04:03:19.340 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-10T04:03:19.340 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-10T04:03:19.340 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-10T04:03:19.340 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-10T04:03:19.340 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-10T04:03:19.340 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-10T04:03:19.341 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-10T04:03:19.341 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-10T04:03:19.341 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-10T04:03:19.341 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-10T04:03:19.341 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-10T04:03:19.341 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-10T04:03:19.341 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-10T04:03:19.341 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-10T04:03:19.341 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-10T04:03:19.341 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-10T04:03:19.341 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-10T04:03:19.341 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-10T04:03:19.342 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-10T04:03:19.342 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-10T04:03:19.342 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-10T04:03:19.342 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-10T04:03:19.342 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-10T04:03:19.342 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-10T04:03:19.342 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-10T04:03:19.342 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-10T04:03:19.342 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-10T04:03:19.342 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-10T04:03:19.342 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-10T04:03:19.342 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-10T04:03:19.343 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-10T04:03:19.343 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-10T04:03:19.343 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-10T04:03:19.343 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-10T04:03:19.343 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-10T04:03:19.343 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-10T04:03:19.343 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-10T04:03:19.343 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-10T04:03:19.343 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-10T04:03:19.343 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-10T04:03:19.343 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-10T04:03:19.343 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-10T04:03:19.343 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-10T04:03:19.344 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-10T04:03:19.344 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-10T04:03:19.344 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-10T04:03:19.344 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-10T04:03:19.344 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-10T04:03:19.344 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-10T04:03:19.344 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-10T04:03:19.344 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-10T04:03:19.344 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-10T04:03:19.344 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-10T04:03:19.344 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-10T04:03:19.344 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-10T04:03:19.345 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-10T04:03:19.345 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-10T04:03:19.345 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-10T04:03:19.345 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-10T04:03:19.345 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-10T04:03:19.345 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-10T04:03:19.345 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-10T04:03:19.345 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-10T04:03:19.345 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-10T04:03:19.345 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-10T04:03:19.345 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-10T04:03:19.345 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-10T04:03:19.345 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-10T04:03:19.346 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-10T04:03:19.346 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-10T04:03:19.346 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-10T04:03:19.346 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-10T04:03:19.346 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-10T04:03:19.346 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-10T04:03:19.346 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-10T04:03:19.346 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-10T04:03:19.346 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-10T04:03:19.346 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-10T04:03:19.346 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-10T04:03:19.346 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-10T04:03:19.347 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-10T04:03:19.347 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-10T04:03:19.347 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-10T04:03:19.347 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-10T04:03:19.347 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-10T04:03:19.347 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-10T04:03:19.347 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-10T04:03:19.347 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-10T04:03:19.347 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-10T04:03:19.347 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-10T04:03:19.348 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-10T04:03:19.348 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-10T04:03:19.348 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-10T04:03:19.348 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-10T04:03:19.348 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-10T04:03:19.348 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-10T04:03:19.348 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-10T04:03:19.348 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-10T04:03:19.348 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-10T04:03:19.348 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-10T04:03:19.348 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-10T04:03:19.348 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-10T04:03:19.349 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-10T04:03:19.349 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-10T04:03:19.349 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-10T04:03:19.349 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-10T04:03:19.349 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-10T04:03:19.349 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-10T04:03:19.349 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-10T04:03:19.349 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-10T04:03:19.349 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-10T04:03:19.349 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-10T04:03:19.349 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-10T04:03:19.349 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-10T04:03:19.349 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-10T04:03:19.350 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-10T04:03:19.350 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-10T04:03:19.350 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-10T04:03:19.350 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-10T04:03:19.350 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-10T04:03:19.350 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-10T04:03:19.350 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-10T04:03:19.350 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-10T04:03:19.350 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-10T04:03:19.350 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-10T04:03:19.350 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-10T04:03:19.351 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-10T04:03:19.351 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-10T04:03:19.351 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-10T04:03:19.351 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-10T04:03:19.351 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-10T04:03:19.351 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-10T04:03:19.351 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-10T04:03:19.351 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-10T04:03:19.351 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-10T04:03:19.351 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-10T04:03:19.351 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-10T04:03:19.351 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-10T04:03:19.351 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-10T04:03:19.352 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-10T04:03:19.352 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-10T04:03:19.352 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-10T04:03:19.352 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-10T04:03:19.352 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-10T04:03:19.352 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-10T04:03:19.352 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-10T04:03:19.352 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-10T04:03:19.352 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-10T04:03:19.352 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-10T04:03:19.352 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-10T04:03:19.352 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-10T04:03:19.352 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-10T04:03:19.352 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-10T04:03:19.353 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-10T04:03:19.353 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-10T04:03:19.353 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-10T04:03:19.353 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-10T04:03:19.353 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-10T04:03:19.353 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-10T04:03:19.353 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-10T04:03:19.353 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-10T04:03:19.353 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-10T04:03:19.353 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-10T04:03:19.353 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-10T04:03:19.353 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-10T04:03:19.353 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-10T04:03:19.354 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-10T04:03:19.354 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-10T04:03:19.354 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-10T04:03:19.354 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-10T04:03:19.354 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-10T04:03:19.354 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-10T04:03:19.358 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-10T04:03:19.358 DEBUG:teuthology.orchestra.run.smithi106:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-10T04:03:19.382 INFO:teuthology.orchestra.run.smithi106.stdout:postinstall scriptlet (using /bin/sh): 2024-05-10T04:03:19.382 INFO:teuthology.orchestra.run.smithi106.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-10T04:03:19.382 INFO:teuthology.orchestra.run.smithi106.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-10T04:03:19.383 INFO:teuthology.orchestra.run.smithi106.stdout:fi 2024-05-10T04:03:19.383 INFO:teuthology.orchestra.run.smithi106.stdout:for file in vmlinuz System.map config; do 2024-05-10T04:03:19.383 INFO:teuthology.orchestra.run.smithi106.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-10T04:03:19.383 INFO:teuthology.orchestra.run.smithi106.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:03:19.383 INFO:teuthology.orchestra.run.smithi106.stdout: fi 2024-05-10T04:03:19.383 INFO:teuthology.orchestra.run.smithi106.stdout:done 2024-05-10T04:03:19.383 INFO:teuthology.orchestra.run.smithi106.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-10T04:03:19.383 INFO:teuthology.orchestra.run.smithi106.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-10T04:03:19.383 INFO:teuthology.orchestra.run.smithi106.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:03:19.383 INFO:teuthology.orchestra.run.smithi106.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:03:19.383 INFO:teuthology.orchestra.run.smithi106.stdout:fi 2024-05-10T04:03:19.383 INFO:teuthology.orchestra.run.smithi106.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-10T04:03:19.383 INFO:teuthology.orchestra.run.smithi106.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-10T04:03:19.384 INFO:teuthology.orchestra.run.smithi106.stdout:fi 2024-05-10T04:03:19.384 INFO:teuthology.orchestra.run.smithi106.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-10T04:03:19.384 INFO:teuthology.orchestra.run.smithi106.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-10T04:03:19.384 INFO:teuthology.orchestra.run.smithi106.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-10T04:03:19.384 INFO:teuthology.orchestra.run.smithi106.stdout:fi 2024-05-10T04:03:19.384 DEBUG:teuthology.orchestra.run.smithi106:> sudo rpm -qi grub2-tools 2024-05-10T04:03:19.456 INFO:teuthology.orchestra.run.smithi106.stdout:Name : grub2-tools 2024-05-10T04:03:19.457 INFO:teuthology.orchestra.run.smithi106.stdout:Epoch : 1 2024-05-10T04:03:19.457 INFO:teuthology.orchestra.run.smithi106.stdout:Version : 2.02 2024-05-10T04:03:19.457 INFO:teuthology.orchestra.run.smithi106.stdout:Release : 123.el8 2024-05-10T04:03:19.457 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: x86_64 2024-05-10T04:03:19.457 INFO:teuthology.orchestra.run.smithi106.stdout:Install Date: Thu 14 Dec 2023 12:39:42 AM UTC 2024-05-10T04:03:19.457 INFO:teuthology.orchestra.run.smithi106.stdout:Group : System Environment/Base 2024-05-10T04:03:19.457 INFO:teuthology.orchestra.run.smithi106.stdout:Size : 9265450 2024-05-10T04:03:19.457 INFO:teuthology.orchestra.run.smithi106.stdout:License : GPLv3+ 2024-05-10T04:03:19.458 INFO:teuthology.orchestra.run.smithi106.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2024-05-10T04:03:19.458 INFO:teuthology.orchestra.run.smithi106.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2024-05-10T04:03:19.458 INFO:teuthology.orchestra.run.smithi106.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2024-05-10T04:03:19.458 INFO:teuthology.orchestra.run.smithi106.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2024-05-10T04:03:19.458 INFO:teuthology.orchestra.run.smithi106.stdout:Relocations : (not relocatable) 2024-05-10T04:03:19.458 INFO:teuthology.orchestra.run.smithi106.stdout:Packager : Red Hat, Inc. 2024-05-10T04:03:19.458 INFO:teuthology.orchestra.run.smithi106.stdout:Vendor : Red Hat, Inc. 2024-05-10T04:03:19.458 INFO:teuthology.orchestra.run.smithi106.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-10T04:03:19.458 INFO:teuthology.orchestra.run.smithi106.stdout:Summary : Support tools for GRUB. 2024-05-10T04:03:19.458 INFO:teuthology.orchestra.run.smithi106.stdout:Description : 2024-05-10T04:03:19.458 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:03:19.458 INFO:teuthology.orchestra.run.smithi106.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-10T04:03:19.458 INFO:teuthology.orchestra.run.smithi106.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-10T04:03:19.458 INFO:teuthology.orchestra.run.smithi106.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-10T04:03:19.459 INFO:teuthology.orchestra.run.smithi106.stdout:hardware devices. 2024-05-10T04:03:19.459 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:03:19.459 INFO:teuthology.orchestra.run.smithi106.stdout:This subpackage provides tools for support of all platforms. 2024-05-10T04:03:19.460 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-10T04:03:19.460 INFO:teuthology.task.kernel:Updating grub on smithi106 to boot 6.9.0-rc3-g806ec36b2112 2024-05-10T04:03:19.460 DEBUG:teuthology.orchestra.run.smithi106:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-10T04:03:20.247 INFO:teuthology.orchestra.run.smithi106.stderr:Generating grub configuration file ... 2024-05-10T04:03:22.130 INFO:teuthology.orchestra.run.smithi106.stderr:done 2024-05-10T04:03:22.132 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-05-10T04:03:22.148 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.H104OvinfM 2024-05-10T04:03:22.149 DEBUG:teuthology.orchestra.run.smithi106:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.H104OvinfM 2024-05-10T04:03:22.223 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.H104OvinfM 2024-05-10T04:03:22.386 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.H104OvinfM is 6KB 2024-05-10T04:03:22.435 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.H104OvinfM 2024-05-10T04:03:22.451 DEBUG:teuthology.orchestra.run.smithi106:> sudo /bin/ls /boot/loader/entries || true 2024-05-10T04:03:22.515 INFO:teuthology.orchestra.run.smithi106.stdout:2db68f91c8f90721a6596efe657a5324-0-rescue.conf 2024-05-10T04:03:22.515 INFO:teuthology.orchestra.run.smithi106.stdout:2db68f91c8f90721a6596efe657a5324-6.9.0-rc3-g806ec36b2112.conf 2024-05-10T04:03:22.515 INFO:teuthology.orchestra.run.smithi106.stdout:963f8b6c99184de696879b3f7da9ecce-0-rescue.conf 2024-05-10T04:03:22.516 INFO:teuthology.orchestra.run.smithi106.stdout:963f8b6c99184de696879b3f7da9ecce-4.18.0-372.9.1.el8.x86_64.conf 2024-05-10T04:03:22.516 INFO:teuthology.orchestra.run.smithi106.stdout:963f8b6c99184de696879b3f7da9ecce-4.18.0-513.9.1.el8_9.x86_64.conf 2024-05-10T04:03:22.517 DEBUG:teuthology.orchestra.run.smithi106:> sudo grub2-set-default 2db68f91c8f90721a6596efe657a5324-6.9.0-rc3-g806ec36b2112 2024-05-10T04:03:22.683 DEBUG:teuthology.orchestra.run.smithi106:> sudo shutdown -r now 2024-05-10T04:03:34.583 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi080.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-10T04:03:34.583 DEBUG:teuthology.orchestra.run.smithi080:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-10T04:03:34.641 INFO:teuthology.orchestra.run.smithi080.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-10T04:03:34.641 INFO:teuthology.orchestra.run.smithi080.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-10T04:03:34.641 INFO:teuthology.orchestra.run.smithi080.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-10T04:03:34.641 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-10T04:03:34.641 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-10T04:03:34.641 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-10T04:03:34.641 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-10T04:03:34.641 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-10T04:03:34.641 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-10T04:03:34.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-10T04:03:34.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-10T04:03:34.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-10T04:03:34.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-10T04:03:34.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-10T04:03:34.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-10T04:03:34.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-10T04:03:34.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-10T04:03:34.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-10T04:03:34.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-10T04:03:34.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-10T04:03:34.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-10T04:03:34.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-10T04:03:34.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-10T04:03:34.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-10T04:03:34.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-10T04:03:34.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-10T04:03:34.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-10T04:03:34.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-10T04:03:34.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-10T04:03:34.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-10T04:03:34.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-10T04:03:34.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-10T04:03:34.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-10T04:03:34.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-10T04:03:34.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-10T04:03:34.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-10T04:03:34.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-10T04:03:34.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-10T04:03:34.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-10T04:03:34.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-10T04:03:34.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-10T04:03:34.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-10T04:03:34.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-10T04:03:34.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-10T04:03:34.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-10T04:03:34.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-10T04:03:34.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-10T04:03:34.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-10T04:03:34.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-10T04:03:34.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-10T04:03:34.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-10T04:03:34.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-10T04:03:34.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-10T04:03:34.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-10T04:03:34.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-10T04:03:34.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-10T04:03:34.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-10T04:03:34.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-10T04:03:34.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-10T04:03:34.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-10T04:03:34.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-10T04:03:34.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-10T04:03:34.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-10T04:03:34.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-10T04:03:34.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-10T04:03:34.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-10T04:03:34.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-10T04:03:34.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-10T04:03:34.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-10T04:03:34.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-10T04:03:34.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-10T04:03:34.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-10T04:03:34.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-10T04:03:34.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-10T04:03:34.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-10T04:03:34.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-10T04:03:34.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-10T04:03:34.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-10T04:03:34.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-10T04:03:34.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-10T04:03:34.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-10T04:03:34.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-10T04:03:34.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-10T04:03:34.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-10T04:03:34.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-10T04:03:34.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-10T04:03:34.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-10T04:03:34.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-10T04:03:34.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-10T04:03:34.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-10T04:03:34.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-10T04:03:34.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-10T04:03:34.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-10T04:03:34.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-10T04:03:34.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-10T04:03:34.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-10T04:03:34.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-10T04:03:34.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-10T04:03:34.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-10T04:03:34.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-10T04:03:34.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-10T04:03:34.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-10T04:03:34.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-10T04:03:34.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-10T04:03:34.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-10T04:03:34.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-10T04:03:34.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-10T04:03:34.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-10T04:03:34.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-10T04:03:34.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-10T04:03:34.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-10T04:03:34.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-10T04:03:34.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-10T04:03:34.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-10T04:03:34.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-10T04:03:34.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-10T04:03:34.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-10T04:03:34.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-10T04:03:34.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-10T04:03:34.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-10T04:03:34.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-10T04:03:34.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-10T04:03:34.650 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-10T04:03:34.650 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-10T04:03:34.650 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-10T04:03:34.650 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-10T04:03:34.650 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-10T04:03:34.650 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-10T04:03:34.650 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-10T04:03:34.650 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-10T04:03:34.650 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-10T04:03:34.650 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-10T04:03:34.650 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-10T04:03:34.650 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-10T04:03:34.650 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-10T04:03:34.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-10T04:03:34.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-10T04:03:34.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-10T04:03:34.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-10T04:03:34.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-10T04:03:34.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-10T04:03:34.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-10T04:03:34.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-10T04:03:34.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-10T04:03:34.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-10T04:03:34.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-10T04:03:34.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-10T04:03:34.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-10T04:03:34.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-10T04:03:34.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-10T04:03:34.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-10T04:03:34.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-10T04:03:34.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-10T04:03:34.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-10T04:03:34.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-10T04:03:34.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-10T04:03:34.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-10T04:03:34.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-10T04:03:34.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-10T04:03:34.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-10T04:03:34.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-10T04:03:34.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-10T04:03:34.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-10T04:03:34.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-10T04:03:34.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-10T04:03:34.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-10T04:03:34.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-10T04:03:34.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-10T04:03:34.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-10T04:03:34.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-10T04:03:34.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-10T04:03:34.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-10T04:03:34.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-10T04:03:34.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-10T04:03:34.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-10T04:03:34.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-10T04:03:34.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-10T04:03:34.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-10T04:03:34.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-10T04:03:34.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-10T04:03:34.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-10T04:03:34.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-10T04:03:34.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-10T04:03:34.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-10T04:03:34.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-10T04:03:34.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-10T04:03:34.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-10T04:03:34.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-10T04:03:34.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-10T04:03:34.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-10T04:03:34.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-10T04:03:34.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-10T04:03:34.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-10T04:03:34.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-10T04:03:34.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-10T04:03:34.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-10T04:03:34.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-10T04:03:34.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-10T04:03:34.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-10T04:03:34.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-10T04:03:34.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-10T04:03:34.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-10T04:03:34.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-10T04:03:34.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-10T04:03:34.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-10T04:03:34.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-10T04:03:34.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-10T04:03:34.656 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-10T04:03:34.656 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-10T04:03:34.656 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-10T04:03:34.656 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-10T04:03:34.656 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-10T04:03:34.656 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-10T04:03:34.656 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-10T04:03:34.656 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-10T04:03:34.656 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-10T04:03:34.657 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-10T04:03:34.658 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-10T04:03:34.658 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-10T04:03:34.658 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-10T04:03:34.658 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-10T04:03:34.658 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-10T04:03:34.658 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-10T04:03:34.658 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-10T04:03:34.658 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-10T04:03:34.658 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-10T04:03:34.658 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-10T04:03:34.658 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-10T04:03:34.658 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-10T04:03:34.658 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-10T04:03:34.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-10T04:03:34.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-10T04:03:34.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-10T04:03:34.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-10T04:03:34.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-10T04:03:34.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-10T04:03:34.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-10T04:03:34.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-10T04:03:34.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-10T04:03:34.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-10T04:03:34.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-10T04:03:34.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-10T04:03:34.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-10T04:03:34.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-10T04:03:34.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-10T04:03:34.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-10T04:03:34.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-10T04:03:34.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-10T04:03:34.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-10T04:03:34.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-10T04:03:34.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-10T04:03:34.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-10T04:03:34.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-10T04:03:34.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-10T04:03:34.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-10T04:03:34.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-10T04:03:34.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-10T04:03:34.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-10T04:03:34.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-10T04:03:34.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-10T04:03:34.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-10T04:03:34.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-10T04:03:34.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-10T04:03:34.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-10T04:03:34.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-10T04:03:34.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-10T04:03:34.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-10T04:03:34.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-10T04:03:34.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-10T04:03:34.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-10T04:03:34.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-10T04:03:34.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-10T04:03:34.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-10T04:03:34.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-10T04:03:34.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-10T04:03:34.662 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-10T04:03:34.662 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-10T04:03:34.662 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-10T04:03:34.662 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-10T04:03:34.662 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-10T04:03:34.662 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-10T04:03:34.662 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-10T04:03:34.662 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-10T04:03:34.662 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-10T04:03:34.662 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-10T04:03:34.662 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-10T04:03:34.662 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-10T04:03:34.662 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-10T04:03:34.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-10T04:03:34.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-10T04:03:34.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-10T04:03:34.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-10T04:03:34.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-10T04:03:34.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-10T04:03:34.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-10T04:03:34.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-10T04:03:34.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-10T04:03:34.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-10T04:03:34.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-10T04:03:34.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-10T04:03:34.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-10T04:03:34.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-10T04:03:34.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-10T04:03:34.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-10T04:03:34.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-10T04:03:34.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-10T04:03:34.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-10T04:03:34.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-10T04:03:34.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-10T04:03:34.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-10T04:03:34.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-10T04:03:34.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-10T04:03:34.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-10T04:03:34.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-10T04:03:34.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-10T04:03:34.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-10T04:03:34.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-10T04:03:34.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-10T04:03:34.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-10T04:03:34.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-10T04:03:34.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-10T04:03:34.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-10T04:03:34.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-10T04:03:34.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-10T04:03:34.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-10T04:03:34.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-10T04:03:34.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-10T04:03:34.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-10T04:03:34.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-10T04:03:34.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-10T04:03:34.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-10T04:03:34.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-10T04:03:34.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-10T04:03:34.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-10T04:03:34.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-10T04:03:34.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-10T04:03:34.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-10T04:03:34.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-10T04:03:34.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-10T04:03:34.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-10T04:03:34.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-10T04:03:34.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-10T04:03:34.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-10T04:03:34.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-10T04:03:34.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-10T04:03:34.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-10T04:03:34.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-10T04:03:34.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-10T04:03:34.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-10T04:03:34.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-10T04:03:34.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-10T04:03:34.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-10T04:03:34.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-10T04:03:34.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-10T04:03:34.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-10T04:03:34.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-10T04:03:34.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-10T04:03:34.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-10T04:03:34.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-10T04:03:34.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-10T04:03:34.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-10T04:03:34.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-10T04:03:34.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-10T04:03:34.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-10T04:03:34.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-10T04:03:34.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-10T04:03:34.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-10T04:03:34.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-10T04:03:34.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-10T04:03:34.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-10T04:03:34.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-10T04:03:34.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-10T04:03:34.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-10T04:03:34.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-10T04:03:34.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-10T04:03:34.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-10T04:03:34.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-10T04:03:34.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-10T04:03:34.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-10T04:03:34.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-10T04:03:34.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-10T04:03:34.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-10T04:03:34.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-10T04:03:34.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-10T04:03:34.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-10T04:03:34.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-10T04:03:34.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-10T04:03:34.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-10T04:03:34.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-10T04:03:34.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-10T04:03:34.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-10T04:03:34.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-10T04:03:34.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-10T04:03:34.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-10T04:03:34.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-10T04:03:34.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-10T04:03:34.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-10T04:03:34.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-10T04:03:34.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-10T04:03:34.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-10T04:03:34.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-10T04:03:34.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-10T04:03:34.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-10T04:03:34.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-10T04:03:34.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-10T04:03:34.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-10T04:03:34.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-10T04:03:34.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-10T04:03:34.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-10T04:03:34.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-10T04:03:34.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-10T04:03:34.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-10T04:03:34.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-10T04:03:34.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-10T04:03:34.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-10T04:03:34.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-10T04:03:34.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-10T04:03:34.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-10T04:03:34.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-10T04:03:34.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-10T04:03:34.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-10T04:03:34.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-10T04:03:34.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-10T04:03:34.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-10T04:03:34.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-10T04:03:34.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-10T04:03:34.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-10T04:03:34.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-10T04:03:34.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-10T04:03:34.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-10T04:03:34.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-10T04:03:34.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-10T04:03:34.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-10T04:03:34.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-10T04:03:34.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-10T04:03:34.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-10T04:03:34.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-10T04:03:34.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-10T04:03:34.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-10T04:03:34.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-10T04:03:34.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-10T04:03:34.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-10T04:03:34.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-10T04:03:34.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-10T04:03:34.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-10T04:03:34.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-10T04:03:34.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-10T04:03:34.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-10T04:03:34.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-10T04:03:34.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-10T04:03:34.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-10T04:03:34.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-10T04:03:34.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-10T04:03:34.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-10T04:03:34.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-10T04:03:34.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-10T04:03:34.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-10T04:03:34.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-10T04:03:34.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-10T04:03:34.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-10T04:03:34.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-10T04:03:34.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-10T04:03:34.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-10T04:03:34.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-10T04:03:34.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-10T04:03:34.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-10T04:03:34.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-10T04:03:34.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-10T04:03:34.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-10T04:03:34.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-10T04:03:34.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-10T04:03:34.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-10T04:03:34.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-10T04:03:34.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-10T04:03:34.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-10T04:03:34.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-10T04:03:34.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-10T04:03:34.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-10T04:03:34.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-10T04:03:34.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-10T04:03:34.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-10T04:03:34.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-10T04:03:34.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-10T04:03:34.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-10T04:03:34.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-10T04:03:34.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-10T04:03:34.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-10T04:03:34.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-10T04:03:34.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-10T04:03:34.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-10T04:03:34.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-10T04:03:34.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-10T04:03:34.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-10T04:03:34.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-10T04:03:34.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-10T04:03:34.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-10T04:03:34.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-10T04:03:34.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-10T04:03:34.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-10T04:03:34.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-10T04:03:34.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-10T04:03:34.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-10T04:03:34.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-10T04:03:34.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-10T04:03:34.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-10T04:03:34.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-10T04:03:34.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-10T04:03:34.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-10T04:03:34.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-10T04:03:34.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-10T04:03:34.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-10T04:03:34.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-10T04:03:34.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-10T04:03:34.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-10T04:03:34.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-10T04:03:34.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-10T04:03:34.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-10T04:03:34.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-10T04:03:34.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-10T04:03:34.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-10T04:03:34.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-10T04:03:34.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-10T04:03:34.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-10T04:03:34.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-10T04:03:34.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-10T04:03:34.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-10T04:03:34.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-10T04:03:34.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-10T04:03:34.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-10T04:03:34.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-10T04:03:34.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-10T04:03:34.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-10T04:03:34.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-10T04:03:34.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-10T04:03:34.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-10T04:03:34.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-10T04:03:34.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-10T04:03:34.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-10T04:03:34.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-10T04:03:34.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-10T04:03:34.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-10T04:03:34.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-10T04:03:34.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-10T04:03:34.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-10T04:03:34.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-10T04:03:34.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-10T04:03:34.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-10T04:03:34.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-10T04:03:34.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-10T04:03:34.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-10T04:03:34.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-10T04:03:34.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-10T04:03:34.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-10T04:03:34.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-10T04:03:34.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-10T04:03:34.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-10T04:03:34.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-10T04:03:34.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-10T04:03:34.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-10T04:03:34.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-10T04:03:34.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-10T04:03:34.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-10T04:03:34.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-10T04:03:34.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-10T04:03:34.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-10T04:03:34.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-10T04:03:34.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-10T04:03:34.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-10T04:03:34.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-10T04:03:34.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-10T04:03:34.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-10T04:03:34.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-10T04:03:34.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-10T04:03:34.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-10T04:03:34.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-10T04:03:34.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-10T04:03:34.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-10T04:03:34.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-10T04:03:34.683 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-10T04:03:34.683 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-10T04:03:34.683 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-10T04:03:34.683 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-10T04:03:34.683 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-10T04:03:34.683 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-10T04:03:34.683 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-10T04:03:34.683 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-10T04:03:34.683 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-10T04:03:34.683 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-10T04:03:34.683 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-10T04:03:34.683 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-10T04:03:34.683 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-10T04:03:34.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-10T04:03:34.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-10T04:03:34.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-10T04:03:34.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-10T04:03:34.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-10T04:03:34.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-10T04:03:34.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-10T04:03:34.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-10T04:03:34.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-10T04:03:34.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-10T04:03:34.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-10T04:03:34.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-10T04:03:34.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-10T04:03:34.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-10T04:03:34.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-10T04:03:34.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-10T04:03:34.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-10T04:03:34.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-10T04:03:34.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-10T04:03:34.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-10T04:03:34.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-10T04:03:34.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-10T04:03:34.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-10T04:03:34.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-10T04:03:34.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-10T04:03:34.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-10T04:03:34.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-10T04:03:34.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-10T04:03:34.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-10T04:03:34.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-10T04:03:34.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-10T04:03:34.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-10T04:03:34.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-10T04:03:34.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-10T04:03:34.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-10T04:03:34.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-10T04:03:34.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-10T04:03:34.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-10T04:03:34.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-10T04:03:34.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-10T04:03:34.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-10T04:03:34.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-10T04:03:34.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-10T04:03:34.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-10T04:03:34.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-10T04:03:34.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-10T04:03:34.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-10T04:03:34.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-10T04:03:34.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-10T04:03:34.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-10T04:03:34.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-10T04:03:34.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-10T04:03:34.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-10T04:03:34.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-10T04:03:34.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-10T04:03:34.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-10T04:03:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-10T04:03:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-10T04:03:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-10T04:03:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-10T04:03:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-10T04:03:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-10T04:03:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-10T04:03:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-10T04:03:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-10T04:03:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-10T04:03:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-10T04:03:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-10T04:03:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-10T04:03:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-10T04:03:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-10T04:03:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-10T04:03:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-10T04:03:34.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-10T04:03:34.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-10T04:03:34.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-10T04:03:34.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-10T04:03:34.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-10T04:03:34.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-10T04:03:34.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-10T04:03:34.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-10T04:03:34.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-10T04:03:34.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-10T04:03:34.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-10T04:03:34.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-10T04:03:34.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-10T04:03:34.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-10T04:03:34.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-10T04:03:34.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-10T04:03:34.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-10T04:03:34.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-10T04:03:34.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-10T04:03:34.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-10T04:03:34.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-10T04:03:34.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-10T04:03:34.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-10T04:03:34.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-10T04:03:34.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-10T04:03:34.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-10T04:03:34.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-10T04:03:34.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-10T04:03:34.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-10T04:03:34.691 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-10T04:03:34.691 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-10T04:03:34.691 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-10T04:03:34.691 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-10T04:03:34.691 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-10T04:03:34.691 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-10T04:03:34.691 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-10T04:03:34.691 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-10T04:03:34.691 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-10T04:03:34.691 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-10T04:03:34.691 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-10T04:03:34.691 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-10T04:03:34.691 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-10T04:03:34.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-10T04:03:34.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-10T04:03:34.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-10T04:03:34.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-10T04:03:34.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-10T04:03:34.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-10T04:03:34.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-10T04:03:34.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-10T04:03:34.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-10T04:03:34.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-10T04:03:34.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-10T04:03:34.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-10T04:03:34.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-10T04:03:34.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-10T04:03:34.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-10T04:03:34.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-10T04:03:34.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-10T04:03:34.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-10T04:03:34.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-10T04:03:34.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-10T04:03:34.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-10T04:03:34.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-10T04:03:34.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-10T04:03:34.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-10T04:03:34.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-10T04:03:34.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-10T04:03:34.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-10T04:03:34.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-10T04:03:34.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-10T04:03:34.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-10T04:03:34.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-10T04:03:34.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-10T04:03:34.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-10T04:03:34.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-10T04:03:34.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-10T04:03:34.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-10T04:03:34.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-10T04:03:34.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-10T04:03:34.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-10T04:03:34.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-10T04:03:34.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-10T04:03:34.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-10T04:03:34.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-10T04:03:34.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-10T04:03:34.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-10T04:03:34.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-10T04:03:34.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-10T04:03:34.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-10T04:03:34.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-10T04:03:34.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-10T04:03:34.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-10T04:03:34.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-10T04:03:34.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-10T04:03:34.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-10T04:03:34.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-10T04:03:34.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-10T04:03:34.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-10T04:03:34.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-10T04:03:34.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-10T04:03:34.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-10T04:03:34.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-10T04:03:34.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-10T04:03:34.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-10T04:03:34.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-10T04:03:34.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-10T04:03:34.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-10T04:03:34.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-10T04:03:34.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-10T04:03:34.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-10T04:03:34.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-10T04:03:34.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-10T04:03:34.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-10T04:03:34.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-10T04:03:34.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-10T04:03:34.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-10T04:03:34.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-10T04:03:34.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-10T04:03:34.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-10T04:03:34.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-10T04:03:34.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-10T04:03:34.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-10T04:03:34.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-10T04:03:34.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-10T04:03:34.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-10T04:03:34.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-10T04:03:34.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-10T04:03:34.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-10T04:03:34.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-10T04:03:34.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-10T04:03:34.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-10T04:03:34.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-10T04:03:34.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-10T04:03:34.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-10T04:03:34.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-10T04:03:34.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-10T04:03:34.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-10T04:03:34.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-10T04:03:34.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-10T04:03:34.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-10T04:03:34.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-10T04:03:34.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-10T04:03:34.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-10T04:03:34.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-10T04:03:34.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-10T04:03:34.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-10T04:03:34.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-10T04:03:34.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-10T04:03:34.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-10T04:03:34.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-10T04:03:34.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-10T04:03:34.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-10T04:03:34.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-10T04:03:34.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-10T04:03:34.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-10T04:03:34.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-10T04:03:34.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-10T04:03:34.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-10T04:03:34.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-10T04:03:34.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-10T04:03:34.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-10T04:03:34.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-10T04:03:34.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-10T04:03:34.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-10T04:03:34.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-10T04:03:34.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-10T04:03:34.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-10T04:03:34.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-10T04:03:34.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-10T04:03:34.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-10T04:03:34.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-10T04:03:34.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-10T04:03:34.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-10T04:03:34.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-10T04:03:34.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-10T04:03:34.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-10T04:03:34.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-10T04:03:34.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-10T04:03:34.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-10T04:03:34.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-10T04:03:34.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-10T04:03:34.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-10T04:03:34.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-10T04:03:34.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-10T04:03:34.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-10T04:03:34.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-10T04:03:34.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-10T04:03:34.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-10T04:03:34.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-10T04:03:34.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-10T04:03:34.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-10T04:03:34.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-10T04:03:34.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-10T04:03:34.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-10T04:03:34.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-10T04:03:34.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-10T04:03:34.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-10T04:03:34.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-10T04:03:34.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-10T04:03:34.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-10T04:03:34.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-10T04:03:34.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-10T04:03:34.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-10T04:03:34.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-10T04:03:34.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-10T04:03:34.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-10T04:03:34.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-10T04:03:34.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-10T04:03:34.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-10T04:03:34.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-10T04:03:34.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-10T04:03:34.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-10T04:03:34.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-10T04:03:34.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-10T04:03:34.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-10T04:03:34.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-10T04:03:34.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-10T04:03:34.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-10T04:03:34.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-10T04:03:34.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-10T04:03:34.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-10T04:03:34.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-10T04:03:34.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-10T04:03:34.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-10T04:03:34.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-10T04:03:34.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-10T04:03:34.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-10T04:03:34.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-10T04:03:34.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-10T04:03:34.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-10T04:03:34.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-10T04:03:34.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-10T04:03:34.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-10T04:03:34.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-10T04:03:34.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-10T04:03:34.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-10T04:03:34.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-10T04:03:34.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-10T04:03:34.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-10T04:03:34.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-10T04:03:34.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-10T04:03:34.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-10T04:03:34.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-10T04:03:34.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-10T04:03:34.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-10T04:03:34.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-10T04:03:34.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-10T04:03:34.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-10T04:03:34.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-10T04:03:34.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-10T04:03:34.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-10T04:03:34.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-10T04:03:34.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-10T04:03:34.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-10T04:03:34.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-10T04:03:34.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-10T04:03:34.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-10T04:03:34.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-10T04:03:34.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-10T04:03:34.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-10T04:03:34.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-10T04:03:34.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-10T04:03:34.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-10T04:03:34.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-10T04:03:34.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-10T04:03:34.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-10T04:03:34.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-10T04:03:34.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-10T04:03:34.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-10T04:03:34.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-10T04:03:34.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-10T04:03:34.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-10T04:03:34.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-10T04:03:34.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-10T04:03:34.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-10T04:03:34.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-10T04:03:34.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-10T04:03:34.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-10T04:03:34.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-10T04:03:34.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-10T04:03:34.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-10T04:03:34.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-10T04:03:34.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-10T04:03:34.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-10T04:03:34.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-10T04:03:34.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-10T04:03:34.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-10T04:03:34.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-10T04:03:34.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-10T04:03:34.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-10T04:03:34.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-10T04:03:34.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-10T04:03:34.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-10T04:03:34.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-10T04:03:34.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-10T04:03:34.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-10T04:03:34.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-10T04:03:34.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-10T04:03:34.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-10T04:03:34.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-10T04:03:34.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-10T04:03:34.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-10T04:03:34.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-10T04:03:34.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-10T04:03:34.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-10T04:03:34.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-10T04:03:34.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-10T04:03:34.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-10T04:03:34.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-10T04:03:34.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-10T04:03:34.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-10T04:03:34.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-10T04:03:34.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-10T04:03:34.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-10T04:03:34.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-10T04:03:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-10T04:03:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-10T04:03:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-10T04:03:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-10T04:03:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-10T04:03:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-10T04:03:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-10T04:03:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-10T04:03:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-10T04:03:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-10T04:03:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-10T04:03:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-10T04:03:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-10T04:03:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-10T04:03:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-10T04:03:34.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-10T04:03:34.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-10T04:03:34.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-10T04:03:34.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-10T04:03:34.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-10T04:03:34.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-10T04:03:34.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-10T04:03:34.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-10T04:03:34.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-10T04:03:34.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-10T04:03:34.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-10T04:03:34.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-10T04:03:34.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-10T04:03:34.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-10T04:03:34.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-10T04:03:34.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-10T04:03:34.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-10T04:03:34.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-10T04:03:34.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-10T04:03:34.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-10T04:03:34.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-10T04:03:34.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-10T04:03:34.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-10T04:03:34.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-10T04:03:34.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-10T04:03:34.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-10T04:03:34.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-10T04:03:34.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-10T04:03:34.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-10T04:03:34.714 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-10T04:03:34.714 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-10T04:03:34.714 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-10T04:03:34.714 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-10T04:03:34.714 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-10T04:03:34.714 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-10T04:03:34.714 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-10T04:03:34.714 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-10T04:03:34.714 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-10T04:03:34.714 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-10T04:03:34.714 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-10T04:03:34.714 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-10T04:03:34.714 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-10T04:03:34.714 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-10T04:03:34.715 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-10T04:03:34.715 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-10T04:03:34.715 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-10T04:03:34.715 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-10T04:03:34.715 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-10T04:03:34.715 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-10T04:03:34.715 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-10T04:03:34.715 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-10T04:03:34.715 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-10T04:03:34.715 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-10T04:03:34.715 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-10T04:03:34.715 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-10T04:03:34.715 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-10T04:03:34.715 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-10T04:03:34.716 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-10T04:03:34.716 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-10T04:03:34.716 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-10T04:03:34.716 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-10T04:03:34.716 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-10T04:03:34.716 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-10T04:03:34.716 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-10T04:03:34.716 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-10T04:03:34.716 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-10T04:03:34.716 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-10T04:03:34.716 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-10T04:03:34.716 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-10T04:03:34.716 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-10T04:03:34.716 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-10T04:03:34.716 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-10T04:03:34.716 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-10T04:03:34.717 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-10T04:03:34.717 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-10T04:03:34.717 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-10T04:03:34.717 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-10T04:03:34.717 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-10T04:03:34.717 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-10T04:03:34.717 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-10T04:03:34.717 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-10T04:03:34.717 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-10T04:03:34.717 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-10T04:03:34.717 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-10T04:03:34.717 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-10T04:03:34.717 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-10T04:03:34.717 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-10T04:03:34.717 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-10T04:03:34.717 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-10T04:03:34.718 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-10T04:03:34.718 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-10T04:03:34.718 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-10T04:03:34.718 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-10T04:03:34.718 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-10T04:03:34.718 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-10T04:03:34.718 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-10T04:03:34.718 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-10T04:03:34.718 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-10T04:03:34.718 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-10T04:03:34.718 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-10T04:03:34.718 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-10T04:03:34.718 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-10T04:03:34.718 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-10T04:03:34.718 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-10T04:03:34.719 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-10T04:03:34.719 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-10T04:03:34.719 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-10T04:03:34.719 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-10T04:03:34.719 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-10T04:03:34.719 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-10T04:03:34.719 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-10T04:03:34.719 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-10T04:03:34.719 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-10T04:03:34.719 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-10T04:03:34.719 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-10T04:03:34.719 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-10T04:03:34.719 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-10T04:03:34.719 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-10T04:03:34.719 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-10T04:03:34.719 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-10T04:03:34.720 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-10T04:03:34.720 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-10T04:03:34.720 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-10T04:03:34.720 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-10T04:03:34.720 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-10T04:03:34.720 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-10T04:03:34.720 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-10T04:03:34.720 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-10T04:03:34.720 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-10T04:03:34.720 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-10T04:03:34.720 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-10T04:03:34.720 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-10T04:03:34.720 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-10T04:03:34.720 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-10T04:03:34.720 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-10T04:03:34.720 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-10T04:03:34.721 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-10T04:03:34.721 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-10T04:03:34.721 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-10T04:03:34.721 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-10T04:03:34.721 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-10T04:03:34.721 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-10T04:03:34.721 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-10T04:03:34.721 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-10T04:03:34.721 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-10T04:03:34.721 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-10T04:03:34.721 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-10T04:03:34.721 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-10T04:03:34.721 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-10T04:03:34.722 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-10T04:03:34.722 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-10T04:03:34.722 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-10T04:03:34.722 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-10T04:03:34.722 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-10T04:03:34.722 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-10T04:03:34.722 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-10T04:03:34.722 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-10T04:03:34.722 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-10T04:03:34.722 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-10T04:03:34.722 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-10T04:03:34.722 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-10T04:03:34.722 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-10T04:03:34.722 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-10T04:03:34.723 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-10T04:03:34.723 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-10T04:03:34.723 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-10T04:03:34.723 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-10T04:03:34.723 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-10T04:03:34.723 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-10T04:03:34.723 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-10T04:03:34.723 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-10T04:03:34.723 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-10T04:03:34.723 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-10T04:03:34.723 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-10T04:03:34.723 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-10T04:03:34.723 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-10T04:03:34.723 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-10T04:03:34.723 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-10T04:03:34.723 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-10T04:03:34.724 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-10T04:03:34.724 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-10T04:03:34.724 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-10T04:03:34.724 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-10T04:03:34.724 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-10T04:03:34.724 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-10T04:03:34.724 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-10T04:03:34.724 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-10T04:03:34.724 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-10T04:03:34.724 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-10T04:03:34.724 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-10T04:03:34.724 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-10T04:03:34.724 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-10T04:03:34.724 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-10T04:03:34.724 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-10T04:03:34.724 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-10T04:03:34.725 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-10T04:03:34.725 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-10T04:03:34.725 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-10T04:03:34.725 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-10T04:03:34.725 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-10T04:03:34.725 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-10T04:03:34.725 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-10T04:03:34.725 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-10T04:03:34.725 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-10T04:03:34.725 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-10T04:03:34.725 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-10T04:03:34.725 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-10T04:03:34.725 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-10T04:03:34.725 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-10T04:03:34.725 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-10T04:03:34.725 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-10T04:03:34.726 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-10T04:03:34.726 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-10T04:03:34.726 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-10T04:03:34.726 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-10T04:03:34.726 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-10T04:03:34.726 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-10T04:03:34.726 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-10T04:03:34.726 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-10T04:03:34.726 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-10T04:03:34.726 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-10T04:03:34.726 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-10T04:03:34.726 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-10T04:03:34.726 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-10T04:03:34.726 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-10T04:03:34.726 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-10T04:03:34.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-10T04:03:34.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-10T04:03:34.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-10T04:03:34.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-10T04:03:34.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-10T04:03:34.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-10T04:03:34.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-10T04:03:34.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-10T04:03:34.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-10T04:03:34.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-10T04:03:34.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-10T04:03:34.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-10T04:03:34.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-10T04:03:34.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-10T04:03:34.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-10T04:03:34.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-10T04:03:34.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-10T04:03:34.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-10T04:03:34.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-10T04:03:34.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-10T04:03:34.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-10T04:03:34.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-10T04:03:34.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-10T04:03:34.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-10T04:03:34.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-10T04:03:34.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-10T04:03:34.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-10T04:03:34.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-10T04:03:34.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-10T04:03:34.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-10T04:03:34.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-10T04:03:34.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-10T04:03:34.729 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-10T04:03:34.729 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-10T04:03:34.729 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-10T04:03:34.729 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-10T04:03:34.729 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-10T04:03:34.729 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-10T04:03:34.729 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-10T04:03:34.729 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-10T04:03:34.729 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-10T04:03:34.729 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-10T04:03:34.729 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-10T04:03:34.729 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-10T04:03:34.729 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-10T04:03:34.729 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-10T04:03:34.729 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-10T04:03:34.730 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-10T04:03:34.730 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-10T04:03:34.730 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-10T04:03:34.730 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-10T04:03:34.730 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-10T04:03:34.730 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-10T04:03:34.730 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-10T04:03:34.730 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-10T04:03:34.730 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-10T04:03:34.730 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-10T04:03:34.730 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-10T04:03:34.730 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-10T04:03:34.730 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-10T04:03:34.730 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-10T04:03:34.730 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-10T04:03:34.731 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-10T04:03:34.731 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-10T04:03:34.731 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-10T04:03:34.731 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-10T04:03:34.731 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-10T04:03:34.731 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-10T04:03:34.731 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-10T04:03:34.731 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-10T04:03:34.731 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-10T04:03:34.731 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-10T04:03:34.731 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-10T04:03:34.731 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-10T04:03:34.731 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-10T04:03:34.731 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-10T04:03:34.732 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-10T04:03:34.732 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-10T04:03:34.732 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-10T04:03:34.732 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-10T04:03:34.732 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-10T04:03:34.732 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-10T04:03:34.732 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-10T04:03:34.732 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-10T04:03:34.732 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-10T04:03:34.732 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-10T04:03:34.732 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-10T04:03:34.732 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-10T04:03:34.732 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-10T04:03:34.732 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-10T04:03:34.732 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-10T04:03:34.732 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-10T04:03:34.733 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-10T04:03:34.733 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-10T04:03:34.733 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-10T04:03:34.733 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-10T04:03:34.733 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-10T04:03:34.733 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-10T04:03:34.733 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-10T04:03:34.733 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-10T04:03:34.733 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-10T04:03:34.733 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-10T04:03:34.733 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-10T04:03:34.733 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-10T04:03:34.733 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-10T04:03:34.733 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-10T04:03:34.733 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-10T04:03:34.733 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-10T04:03:34.734 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-10T04:03:34.734 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-10T04:03:34.734 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-10T04:03:34.734 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-10T04:03:34.734 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-10T04:03:34.734 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-10T04:03:34.734 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-10T04:03:34.734 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-10T04:03:34.734 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-10T04:03:34.734 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-10T04:03:34.734 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-10T04:03:34.734 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-10T04:03:34.734 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-10T04:03:34.734 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-10T04:03:34.735 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-10T04:03:34.735 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-10T04:03:34.735 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-10T04:03:34.735 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-10T04:03:34.735 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-10T04:03:34.735 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-10T04:03:34.735 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-10T04:03:34.735 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-10T04:03:34.735 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-10T04:03:34.735 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-10T04:03:34.735 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-10T04:03:34.735 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-10T04:03:34.735 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-10T04:03:34.735 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-10T04:03:34.735 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-10T04:03:34.736 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-10T04:03:34.736 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-10T04:03:34.736 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-10T04:03:34.736 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-10T04:03:34.736 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-10T04:03:34.736 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-10T04:03:34.736 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-10T04:03:34.736 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-10T04:03:34.736 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-10T04:03:34.736 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-10T04:03:34.736 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-10T04:03:34.736 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-10T04:03:34.736 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-10T04:03:34.737 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-10T04:03:34.737 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-10T04:03:34.737 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-10T04:03:34.737 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-10T04:03:34.737 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-10T04:03:34.737 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-10T04:03:34.737 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-10T04:03:34.737 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-10T04:03:34.737 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-10T04:03:34.737 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-10T04:03:34.737 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-10T04:03:34.737 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-10T04:03:34.737 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-10T04:03:34.737 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-10T04:03:34.738 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-10T04:03:34.738 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-10T04:03:34.738 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-10T04:03:34.738 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-10T04:03:34.738 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-10T04:03:34.738 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-10T04:03:34.738 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-10T04:03:34.738 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-10T04:03:34.738 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-10T04:03:34.738 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-10T04:03:34.738 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-10T04:03:34.738 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-10T04:03:34.738 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-10T04:03:34.738 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-10T04:03:34.739 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-10T04:03:34.739 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-10T04:03:34.739 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-10T04:03:34.739 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-10T04:03:34.739 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-10T04:03:34.739 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-10T04:03:34.739 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-10T04:03:34.739 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-10T04:03:34.739 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-10T04:03:34.739 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-10T04:03:34.739 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-10T04:03:34.739 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-10T04:03:34.739 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-10T04:03:34.739 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-10T04:03:34.739 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-10T04:03:34.739 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-10T04:03:34.740 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-10T04:03:34.740 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-10T04:03:34.740 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-10T04:03:34.740 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-10T04:03:34.740 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-10T04:03:34.740 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-10T04:03:34.740 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-10T04:03:34.740 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-10T04:03:34.740 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-10T04:03:34.740 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-10T04:03:34.740 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-10T04:03:34.740 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-10T04:03:34.740 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-10T04:03:34.740 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-10T04:03:34.741 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-10T04:03:34.741 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-10T04:03:34.741 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-10T04:03:34.741 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-10T04:03:34.741 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-10T04:03:34.741 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-10T04:03:34.741 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-10T04:03:34.741 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-10T04:03:34.741 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-10T04:03:34.741 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-10T04:03:34.741 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-10T04:03:34.741 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-10T04:03:34.741 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-10T04:03:34.741 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-10T04:03:34.741 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-10T04:03:34.741 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-10T04:03:34.741 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-10T04:03:34.742 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-10T04:03:34.742 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-10T04:03:34.742 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-10T04:03:34.742 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-10T04:03:34.742 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-10T04:03:34.742 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-10T04:03:34.742 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-10T04:03:34.742 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-10T04:03:34.742 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-10T04:03:34.742 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-10T04:03:34.742 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-10T04:03:34.742 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-10T04:03:34.742 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-10T04:03:34.742 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-10T04:03:34.743 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-10T04:03:34.743 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-10T04:03:34.743 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-10T04:03:34.743 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-10T04:03:34.743 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-10T04:03:34.743 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-10T04:03:34.743 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-10T04:03:34.743 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-10T04:03:34.743 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-10T04:03:34.743 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-10T04:03:34.743 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-10T04:03:34.743 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-10T04:03:34.743 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-10T04:03:34.743 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-10T04:03:34.743 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-10T04:03:34.743 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-10T04:03:34.743 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-10T04:03:34.744 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-10T04:03:34.744 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-10T04:03:34.744 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-10T04:03:34.744 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-10T04:03:34.744 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-10T04:03:34.744 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-10T04:03:34.744 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-10T04:03:34.744 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-10T04:03:34.744 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-10T04:03:34.744 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-10T04:03:34.744 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-10T04:03:34.744 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-10T04:03:34.744 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-10T04:03:34.744 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-10T04:03:34.744 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-10T04:03:34.745 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-10T04:03:34.745 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-10T04:03:34.745 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-10T04:03:34.745 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-10T04:03:34.745 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-10T04:03:34.745 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-10T04:03:34.745 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-10T04:03:34.745 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-10T04:03:34.745 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-10T04:03:34.745 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-10T04:03:34.745 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-10T04:03:34.745 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-10T04:03:34.745 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-10T04:03:34.745 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-10T04:03:34.745 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-10T04:03:34.745 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-10T04:03:34.746 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-10T04:03:34.746 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-10T04:03:34.746 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-10T04:03:34.746 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-10T04:03:34.746 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-10T04:03:34.746 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-10T04:03:34.746 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-10T04:03:34.746 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-10T04:03:34.746 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-10T04:03:34.746 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-10T04:03:34.746 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-10T04:03:34.746 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-10T04:03:34.746 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-10T04:03:34.746 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-10T04:03:34.747 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-10T04:03:34.747 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-10T04:03:34.747 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-10T04:03:34.747 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-10T04:03:34.747 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-10T04:03:34.747 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-10T04:03:34.747 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-10T04:03:34.747 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-10T04:03:34.747 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-10T04:03:34.747 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-10T04:03:34.747 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-10T04:03:34.747 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-10T04:03:34.747 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-10T04:03:34.747 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-10T04:03:34.747 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-10T04:03:34.747 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-10T04:03:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-10T04:03:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-10T04:03:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-10T04:03:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-10T04:03:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-10T04:03:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-10T04:03:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-10T04:03:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-10T04:03:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-10T04:03:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-10T04:03:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-10T04:03:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-10T04:03:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-10T04:03:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-10T04:03:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-10T04:03:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-10T04:03:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-10T04:03:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-10T04:03:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-10T04:03:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-10T04:03:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-10T04:03:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-10T04:03:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-10T04:03:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-10T04:03:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-10T04:03:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-10T04:03:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-10T04:03:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-10T04:03:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-10T04:03:34.750 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-10T04:03:34.750 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-10T04:03:34.750 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-10T04:03:34.750 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-10T04:03:34.750 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-10T04:03:34.750 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-10T04:03:34.750 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-10T04:03:34.750 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-10T04:03:34.750 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-10T04:03:34.750 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-10T04:03:34.750 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-10T04:03:34.750 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-10T04:03:34.750 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-10T04:03:34.750 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-10T04:03:34.751 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-10T04:03:34.751 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-10T04:03:34.751 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-10T04:03:34.751 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-10T04:03:34.751 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-10T04:03:34.751 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-10T04:03:34.751 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-10T04:03:34.751 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-10T04:03:34.751 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-10T04:03:34.751 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-10T04:03:34.751 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-10T04:03:34.751 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-10T04:03:34.751 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-10T04:03:34.751 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-10T04:03:34.751 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-10T04:03:34.752 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-10T04:03:34.752 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-10T04:03:34.752 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-10T04:03:34.752 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-10T04:03:34.752 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-10T04:03:34.752 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-10T04:03:34.752 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-10T04:03:34.752 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-10T04:03:34.752 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-10T04:03:34.752 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-10T04:03:34.752 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-10T04:03:34.752 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-10T04:03:34.752 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-10T04:03:34.752 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-10T04:03:34.752 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-10T04:03:34.753 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-10T04:03:34.753 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-10T04:03:34.753 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-10T04:03:34.753 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-10T04:03:34.753 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-10T04:03:34.753 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-10T04:03:34.753 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-10T04:03:34.753 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-10T04:03:34.753 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-10T04:03:34.753 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-10T04:03:34.753 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-10T04:03:34.753 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-10T04:03:34.753 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-10T04:03:34.753 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-10T04:03:34.754 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-10T04:03:34.754 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-10T04:03:34.754 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-10T04:03:34.754 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-10T04:03:34.754 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-10T04:03:34.754 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-10T04:03:34.754 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-10T04:03:34.754 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-10T04:03:34.754 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-10T04:03:34.754 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-10T04:03:34.754 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-10T04:03:34.754 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-10T04:03:34.754 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-10T04:03:34.754 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-10T04:03:34.755 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-10T04:03:34.755 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-10T04:03:34.755 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-10T04:03:34.755 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-10T04:03:34.755 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-10T04:03:34.755 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-10T04:03:34.755 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-10T04:03:34.755 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-10T04:03:34.755 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-10T04:03:34.755 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-10T04:03:34.755 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-10T04:03:34.755 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-10T04:03:34.755 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-10T04:03:34.755 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-10T04:03:34.755 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-10T04:03:34.756 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-10T04:03:34.756 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-10T04:03:34.756 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-10T04:03:34.756 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-10T04:03:34.756 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-10T04:03:34.756 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-10T04:03:34.756 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-10T04:03:34.756 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-10T04:03:34.756 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-10T04:03:34.756 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-10T04:03:34.756 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-10T04:03:34.756 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-10T04:03:34.756 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-10T04:03:34.756 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-10T04:03:34.757 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-10T04:03:34.757 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-10T04:03:34.757 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-10T04:03:34.757 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-10T04:03:34.757 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-10T04:03:34.757 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-10T04:03:34.757 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-10T04:03:34.757 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-10T04:03:34.757 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-10T04:03:34.757 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-10T04:03:34.757 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-10T04:03:34.757 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-10T04:03:34.757 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-10T04:03:34.757 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-10T04:03:34.757 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-10T04:03:34.758 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-10T04:03:34.758 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-10T04:03:34.758 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-10T04:03:34.758 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-10T04:03:34.758 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-10T04:03:34.758 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-10T04:03:34.758 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-10T04:03:34.758 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-10T04:03:34.758 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-10T04:03:34.758 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-10T04:03:34.758 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-10T04:03:34.758 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-10T04:03:34.758 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-10T04:03:34.758 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-10T04:03:34.758 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-10T04:03:34.759 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-10T04:03:34.759 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-10T04:03:34.759 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-10T04:03:34.759 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-10T04:03:34.759 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-10T04:03:34.759 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-10T04:03:34.759 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-10T04:03:34.759 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-10T04:03:34.759 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-10T04:03:34.759 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-10T04:03:34.759 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-10T04:03:34.759 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-10T04:03:34.759 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-10T04:03:34.759 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-10T04:03:34.759 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-10T04:03:34.760 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-10T04:03:34.760 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-10T04:03:34.760 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-10T04:03:34.760 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-10T04:03:34.760 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-10T04:03:34.760 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-10T04:03:34.760 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-10T04:03:34.760 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-10T04:03:34.760 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-10T04:03:34.760 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-10T04:03:34.760 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-10T04:03:34.760 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-10T04:03:34.760 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-10T04:03:34.760 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-10T04:03:34.760 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-10T04:03:34.761 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-10T04:03:34.761 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-10T04:03:34.761 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-10T04:03:34.761 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-10T04:03:34.761 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-10T04:03:34.761 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-10T04:03:34.761 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-10T04:03:34.761 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-10T04:03:34.761 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-10T04:03:34.761 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-10T04:03:34.761 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-10T04:03:34.761 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-10T04:03:34.761 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-10T04:03:34.762 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-10T04:03:34.762 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-10T04:03:34.762 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-10T04:03:34.762 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-10T04:03:34.762 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-10T04:03:34.762 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-10T04:03:34.762 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-10T04:03:34.762 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-10T04:03:34.762 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-10T04:03:34.762 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-10T04:03:34.762 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-10T04:03:34.762 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-10T04:03:34.762 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-10T04:03:34.762 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-10T04:03:34.763 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-10T04:03:34.763 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-10T04:03:34.763 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-10T04:03:34.763 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-10T04:03:34.763 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-10T04:03:34.763 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-10T04:03:34.763 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-10T04:03:34.763 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-10T04:03:34.763 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-10T04:03:34.763 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-10T04:03:34.763 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-10T04:03:34.763 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-10T04:03:34.763 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-10T04:03:34.763 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-10T04:03:34.763 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-10T04:03:34.764 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-10T04:03:34.764 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-10T04:03:34.764 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-10T04:03:34.764 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-10T04:03:34.764 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-10T04:03:34.764 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-10T04:03:34.764 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-10T04:03:34.764 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-10T04:03:34.764 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-10T04:03:34.764 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-10T04:03:34.764 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-10T04:03:34.764 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-10T04:03:34.764 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-10T04:03:34.764 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-10T04:03:34.764 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-10T04:03:34.765 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-10T04:03:34.765 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-10T04:03:34.765 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-10T04:03:34.765 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-10T04:03:34.765 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-10T04:03:34.765 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-10T04:03:34.765 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-10T04:03:34.765 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-10T04:03:34.765 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-10T04:03:34.765 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-10T04:03:34.765 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-10T04:03:34.765 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-10T04:03:34.765 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-10T04:03:34.765 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-10T04:03:34.766 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-10T04:03:34.766 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-10T04:03:34.766 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-10T04:03:34.766 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-10T04:03:34.766 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-10T04:03:34.766 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-10T04:03:34.766 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-10T04:03:34.766 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-10T04:03:34.766 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-10T04:03:34.766 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-10T04:03:34.766 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-10T04:03:34.766 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-10T04:03:34.766 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-10T04:03:34.767 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-10T04:03:34.767 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-10T04:03:34.767 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-10T04:03:34.767 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-10T04:03:34.767 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-10T04:03:34.767 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-10T04:03:34.767 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-10T04:03:34.767 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-10T04:03:34.767 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-10T04:03:34.767 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-10T04:03:34.767 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-10T04:03:34.767 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-10T04:03:34.767 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-10T04:03:34.767 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-10T04:03:34.767 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-10T04:03:34.767 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-10T04:03:34.768 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-10T04:03:34.768 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-10T04:03:34.768 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-10T04:03:34.768 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-10T04:03:34.768 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-10T04:03:34.768 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-10T04:03:34.768 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-10T04:03:34.768 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-10T04:03:34.768 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-10T04:03:34.768 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-10T04:03:34.768 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-10T04:03:34.768 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-10T04:03:34.768 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-10T04:03:34.768 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-10T04:03:34.769 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-10T04:03:34.769 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-10T04:03:34.769 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-10T04:03:34.769 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-10T04:03:34.769 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-10T04:03:34.769 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-10T04:03:34.769 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-10T04:03:34.769 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-10T04:03:34.769 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-10T04:03:34.769 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-10T04:03:34.769 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-10T04:03:34.769 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-10T04:03:34.769 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-10T04:03:34.769 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-10T04:03:34.769 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-10T04:03:34.770 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-10T04:03:34.770 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-10T04:03:34.770 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-10T04:03:34.770 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-10T04:03:34.770 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-10T04:03:34.770 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-10T04:03:34.770 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-10T04:03:34.770 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-10T04:03:34.770 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-10T04:03:34.770 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-10T04:03:34.770 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-10T04:03:34.770 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-10T04:03:34.770 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-10T04:03:34.770 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-10T04:03:34.771 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-10T04:03:34.771 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-10T04:03:34.771 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-10T04:03:34.771 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-10T04:03:34.771 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-10T04:03:34.771 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-10T04:03:34.771 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-10T04:03:34.771 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-10T04:03:34.771 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-10T04:03:34.771 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-10T04:03:34.771 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-10T04:03:34.771 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-10T04:03:34.771 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-10T04:03:34.771 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-10T04:03:34.771 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-10T04:03:34.771 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-10T04:03:34.772 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-10T04:03:34.772 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-10T04:03:34.772 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-10T04:03:34.772 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-10T04:03:34.772 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-10T04:03:34.772 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-10T04:03:34.772 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-10T04:03:34.772 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-10T04:03:34.772 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-10T04:03:34.772 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-10T04:03:34.772 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-10T04:03:34.772 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-10T04:03:34.772 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-10T04:03:34.772 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-10T04:03:34.772 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-10T04:03:34.773 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-10T04:03:34.773 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-10T04:03:34.773 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-10T04:03:34.773 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-10T04:03:34.773 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-10T04:03:34.773 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-10T04:03:34.773 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-10T04:03:34.773 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-10T04:03:34.773 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-10T04:03:34.773 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-10T04:03:34.773 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-10T04:03:34.773 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-10T04:03:34.773 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-10T04:03:34.773 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-10T04:03:34.773 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-10T04:03:34.773 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-10T04:03:34.774 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-10T04:03:34.774 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-10T04:03:34.774 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-10T04:03:34.774 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-10T04:03:34.774 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-10T04:03:34.774 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-10T04:03:34.774 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-10T04:03:34.774 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-10T04:03:34.774 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-10T04:03:34.774 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-10T04:03:34.774 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-10T04:03:34.774 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-10T04:03:34.774 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-10T04:03:34.774 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-10T04:03:34.775 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-10T04:03:34.775 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-10T04:03:34.775 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-10T04:03:34.775 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-10T04:03:34.775 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-10T04:03:34.775 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-10T04:03:34.775 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-10T04:03:34.775 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-10T04:03:34.775 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-10T04:03:34.775 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-10T04:03:34.775 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-10T04:03:34.775 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-10T04:03:34.775 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-10T04:03:34.775 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-10T04:03:34.775 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-10T04:03:34.779 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-10T04:03:34.779 DEBUG:teuthology.orchestra.run.smithi080:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-10T04:03:34.802 INFO:teuthology.orchestra.run.smithi080.stdout:postinstall scriptlet (using /bin/sh): 2024-05-10T04:03:34.802 INFO:teuthology.orchestra.run.smithi080.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-10T04:03:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-10T04:03:34.802 INFO:teuthology.orchestra.run.smithi080.stdout:fi 2024-05-10T04:03:34.802 INFO:teuthology.orchestra.run.smithi080.stdout:for file in vmlinuz System.map config; do 2024-05-10T04:03:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-10T04:03:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:03:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: fi 2024-05-10T04:03:34.802 INFO:teuthology.orchestra.run.smithi080.stdout:done 2024-05-10T04:03:34.803 INFO:teuthology.orchestra.run.smithi080.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-10T04:03:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-10T04:03:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:03:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:03:34.803 INFO:teuthology.orchestra.run.smithi080.stdout:fi 2024-05-10T04:03:34.803 INFO:teuthology.orchestra.run.smithi080.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-10T04:03:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-10T04:03:34.803 INFO:teuthology.orchestra.run.smithi080.stdout:fi 2024-05-10T04:03:34.803 INFO:teuthology.orchestra.run.smithi080.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-10T04:03:34.803 INFO:teuthology.orchestra.run.smithi080.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-10T04:03:34.803 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-10T04:03:34.803 INFO:teuthology.orchestra.run.smithi080.stdout:fi 2024-05-10T04:03:34.804 DEBUG:teuthology.orchestra.run.smithi080:> sudo rpm -qi grub2-tools 2024-05-10T04:03:34.878 INFO:teuthology.orchestra.run.smithi080.stdout:Name : grub2-tools 2024-05-10T04:03:34.878 INFO:teuthology.orchestra.run.smithi080.stdout:Epoch : 1 2024-05-10T04:03:34.878 INFO:teuthology.orchestra.run.smithi080.stdout:Version : 2.02 2024-05-10T04:03:34.878 INFO:teuthology.orchestra.run.smithi080.stdout:Release : 123.el8 2024-05-10T04:03:34.879 INFO:teuthology.orchestra.run.smithi080.stdout:Architecture: x86_64 2024-05-10T04:03:34.879 INFO:teuthology.orchestra.run.smithi080.stdout:Install Date: Thu 14 Dec 2023 12:39:42 AM UTC 2024-05-10T04:03:34.879 INFO:teuthology.orchestra.run.smithi080.stdout:Group : System Environment/Base 2024-05-10T04:03:34.879 INFO:teuthology.orchestra.run.smithi080.stdout:Size : 9265450 2024-05-10T04:03:34.879 INFO:teuthology.orchestra.run.smithi080.stdout:License : GPLv3+ 2024-05-10T04:03:34.879 INFO:teuthology.orchestra.run.smithi080.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2024-05-10T04:03:34.879 INFO:teuthology.orchestra.run.smithi080.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2024-05-10T04:03:34.879 INFO:teuthology.orchestra.run.smithi080.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2024-05-10T04:03:34.879 INFO:teuthology.orchestra.run.smithi080.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2024-05-10T04:03:34.879 INFO:teuthology.orchestra.run.smithi080.stdout:Relocations : (not relocatable) 2024-05-10T04:03:34.880 INFO:teuthology.orchestra.run.smithi080.stdout:Packager : Red Hat, Inc. 2024-05-10T04:03:34.880 INFO:teuthology.orchestra.run.smithi080.stdout:Vendor : Red Hat, Inc. 2024-05-10T04:03:34.880 INFO:teuthology.orchestra.run.smithi080.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-10T04:03:34.880 INFO:teuthology.orchestra.run.smithi080.stdout:Summary : Support tools for GRUB. 2024-05-10T04:03:34.880 INFO:teuthology.orchestra.run.smithi080.stdout:Description : 2024-05-10T04:03:34.880 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:03:34.880 INFO:teuthology.orchestra.run.smithi080.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-10T04:03:34.880 INFO:teuthology.orchestra.run.smithi080.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-10T04:03:34.880 INFO:teuthology.orchestra.run.smithi080.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-10T04:03:34.880 INFO:teuthology.orchestra.run.smithi080.stdout:hardware devices. 2024-05-10T04:03:34.880 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:03:34.880 INFO:teuthology.orchestra.run.smithi080.stdout:This subpackage provides tools for support of all platforms. 2024-05-10T04:03:34.881 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-10T04:03:34.881 INFO:teuthology.task.kernel:Updating grub on smithi080 to boot 6.9.0-rc3-g806ec36b2112 2024-05-10T04:03:34.882 DEBUG:teuthology.orchestra.run.smithi080:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-10T04:03:35.643 INFO:teuthology.orchestra.run.smithi080.stderr:Generating grub configuration file ... 2024-05-10T04:03:38.101 INFO:teuthology.orchestra.run.smithi080.stderr:done 2024-05-10T04:03:38.102 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-05-10T04:03:38.119 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.GmShSXytTG 2024-05-10T04:03:38.119 DEBUG:teuthology.orchestra.run.smithi080:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GmShSXytTG 2024-05-10T04:03:38.193 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.GmShSXytTG 2024-05-10T04:03:38.353 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.GmShSXytTG is 6KB 2024-05-10T04:03:38.402 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.GmShSXytTG 2024-05-10T04:03:38.419 DEBUG:teuthology.orchestra.run.smithi080:> sudo /bin/ls /boot/loader/entries || true 2024-05-10T04:03:38.507 INFO:teuthology.orchestra.run.smithi080.stdout:2db68f91c8f90721a6596efe657a5324-0-rescue.conf 2024-05-10T04:03:38.507 INFO:teuthology.orchestra.run.smithi080.stdout:2db68f91c8f90721a6596efe657a5324-6.9.0-rc3-g806ec36b2112.conf 2024-05-10T04:03:38.507 INFO:teuthology.orchestra.run.smithi080.stdout:963f8b6c99184de696879b3f7da9ecce-0-rescue.conf 2024-05-10T04:03:38.507 INFO:teuthology.orchestra.run.smithi080.stdout:963f8b6c99184de696879b3f7da9ecce-4.18.0-372.9.1.el8.x86_64.conf 2024-05-10T04:03:38.507 INFO:teuthology.orchestra.run.smithi080.stdout:963f8b6c99184de696879b3f7da9ecce-4.18.0-513.9.1.el8_9.x86_64.conf 2024-05-10T04:03:38.508 DEBUG:teuthology.orchestra.run.smithi080:> sudo grub2-set-default 2db68f91c8f90721a6596efe657a5324-6.9.0-rc3-g806ec36b2112 2024-05-10T04:03:38.618 DEBUG:teuthology.orchestra.run.smithi080:> sudo shutdown -r now 2024-05-10T04:03:52.698 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-10T04:03:52.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-10T04:03:52.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:04:08.634 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-10T04:04:08.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-10T04:04:08.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:04:27.038 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-05-10T04:04:36.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-10T04:04:36.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:04:39.102 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-05-10T04:04:51.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-10T04:04:51.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:04:52.704 DEBUG:teuthology.orchestra.remote:timed out 2024-05-10T04:05:01.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-10T04:05:01.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:05:09.054 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-05-10T04:05:09.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-10T04:05:09.466 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g806ec36b2112"... 2024-05-10T04:05:09.466 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-05-10T04:05:09.506 INFO:teuthology.orchestra.run.smithi106.stdout:6.9.0-rc3-g806ec36b2112 2024-05-10T04:05:09.507 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-10T04:05:09.507 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-10T04:05:09.507 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2024-05-10T04:05:10.510 DEBUG:teuthology.parallel:result is None 2024-05-10T04:05:51.118 DEBUG:teuthology.orchestra.remote:timed out 2024-05-10T04:06:06.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-10T04:06:06.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:06:06.526 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-05-10T04:06:07.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-10T04:06:07.015 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-05-10T04:06:07.015 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-05-10T04:06:07.057 INFO:teuthology.orchestra.run.smithi080.stdout:6.9.0-rc3-g806ec36b2112 2024-05-10T04:06:07.057 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-10T04:06:07.058 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-10T04:06:07.058 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2024-05-10T04:06:08.059 DEBUG:teuthology.parallel:result is None 2024-05-10T04:06:08.059 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-10T04:06:08.067 INFO:teuthology.task.internal:Creating test directory... 2024-05-10T04:06:08.067 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T04:06:08.072 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T04:06:08.123 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-10T04:06:08.129 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-10T04:06:08.140 INFO:teuthology.task.internal:Creating archive directory... 2024-05-10T04:06:08.140 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T04:06:08.159 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T04:06:08.224 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-10T04:06:08.230 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-10T04:06:08.230 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T04:06:08.234 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T04:06:08.366 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T04:06:08.383 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T04:06:08.398 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T04:06:08.418 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T04:06:08.422 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-10T04:06:08.429 INFO:teuthology.task.internal:Configuring sudo... 2024-05-10T04:06:08.429 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T04:06:08.433 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T04:06:08.499 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-10T04:06:08.508 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-10T04:06:08.508 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T04:06:08.512 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T04:06:08.553 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T04:06:08.660 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T04:06:08.739 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T04:06:08.808 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T04:06:08.888 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:06:08.888 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T04:06:08.952 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T04:06:09.019 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T04:06:09.132 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T04:06:09.203 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T04:06:09.281 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:06:09.282 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T04:06:09.356 DEBUG:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2024-05-10T04:06:09.360 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2024-05-10T04:06:09.466 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T04:06:09.502 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T04:06:09.838 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-10T04:06:09.845 INFO:teuthology.task.internal:Starting timer... 2024-05-10T04:06:09.845 INFO:teuthology.run_tasks:Running task pcp... 2024-05-10T04:06:09.855 INFO:teuthology.run_tasks:Running task selinux... 2024-05-10T04:06:09.865 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-05-10T04:06:09.866 DEBUG:teuthology.orchestra.run.smithi080:> sudo service auditd rotate 2024-05-10T04:06:09.978 INFO:teuthology.orchestra.run.smithi080.stdout:Rotating logs: 2024-05-10T04:06:09.982 DEBUG:teuthology.orchestra.run.smithi106:> sudo service auditd rotate 2024-05-10T04:06:10.102 INFO:teuthology.orchestra.run.smithi106.stdout:Rotating logs: 2024-05-10T04:06:10.106 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-10T04:06:10.106 DEBUG:teuthology.orchestra.run.smithi080:> /usr/sbin/getenforce 2024-05-10T04:06:10.154 INFO:teuthology.orchestra.run.smithi080.stdout:Permissive 2024-05-10T04:06:10.155 DEBUG:teuthology.orchestra.run.smithi106:> /usr/sbin/getenforce 2024-05-10T04:06:10.207 INFO:teuthology.orchestra.run.smithi106.stdout:Permissive 2024-05-10T04:06:10.207 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi080.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi106.front.sepia.ceph.com': 'permissive'} 2024-05-10T04:06:10.208 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T04:06:10.279 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:06:10.280 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T04:06:10.350 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:06:10.350 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-10T04:06:10.350 DEBUG:teuthology.orchestra.run.smithi080:> sudo /usr/sbin/setenforce permissive 2024-05-10T04:06:10.420 DEBUG:teuthology.orchestra.run.smithi106:> sudo /usr/sbin/setenforce permissive 2024-05-10T04:06:10.487 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-10T04:06:10.497 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-10T04:06:10.514 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-10T04:06:10.515 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi080.front.sepia.ceph.com,smithi106.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-10T04:18:04.845 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi080.front.sepia.ceph.com'), Remote(name='ubuntu@smithi106.front.sepia.ceph.com')] 2024-05-10T04:18:04.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-10T04:18:04.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:18:04.946 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-05-10T04:18:05.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-10T04:18:05.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-10T04:18:05.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:18:05.147 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-05-10T04:18:05.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-10T04:18:05.263 INFO:teuthology.run_tasks:Running task clock... 2024-05-10T04:18:05.274 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-10T04:18:05.274 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T04:18:05.275 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T04:18:05.279 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T04:18:05.279 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T04:18:05.348 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T04:18:05.373 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T04:18:05.381 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T04:18:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T04:18:05.467 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: ntpd: command not found 2024-05-10T04:18:05.494 INFO:teuthology.orchestra.run.smithi080.stdout:506 Cannot talk to daemon 2024-05-10T04:18:05.507 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: ntpd: command not found 2024-05-10T04:18:05.527 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T04:18:05.534 INFO:teuthology.orchestra.run.smithi106.stdout:506 Cannot talk to daemon 2024-05-10T04:18:05.559 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T04:18:05.568 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T04:18:05.600 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T04:18:05.658 INFO:teuthology.orchestra.run.smithi080.stderr:bash: ntpq: command not found 2024-05-10T04:18:05.665 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T04:18:05.665 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-05-10T04:18:05.665 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:18:05.665 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:18:05.665 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:18:05.665 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:18:05.691 INFO:teuthology.orchestra.run.smithi106.stderr:bash: ntpq: command not found 2024-05-10T04:18:05.698 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T04:18:05.698 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2024-05-10T04:18:05.698 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:18:05.698 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:18:05.698 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:18:05.699 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:18:05.700 INFO:teuthology.run_tasks:Running task install... 2024-05-10T04:18:05.709 DEBUG:teuthology.task.install:project ceph 2024-05-10T04:18:05.709 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '50174015a7e79f951b988949abe236791f52d4da'}} 2024-05-10T04:18:05.709 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50174015a7e79f951b988949abe236791f52d4da'} 2024-05-10T04:18:05.709 INFO:teuthology.task.install:Using flavor: default 2024-05-10T04:18:05.716 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-10T04:18:05.716 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-05-10T04:18:05.717 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50174015a7e79f951b988949abe236791f52d4da', 'tag': None, 'wait_for_package': False} 2024-05-10T04:18:05.717 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:18:05.719 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50174015a7e79f951b988949abe236791f52d4da', 'tag': None, 'wait_for_package': False} 2024-05-10T04:18:05.720 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:18:06.132 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/ 2024-05-10T04:18:06.132 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1330.g50174015 2024-05-10T04:18:06.145 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/ 2024-05-10T04:18:06.145 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1330.g50174015 2024-05-10T04:18:06.240 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T04:18:06.241 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:18:06.241 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T04:18:06.250 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T04:18:06.250 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:18:06.250 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T04:18:06.310 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T04:18:06.310 DEBUG:teuthology.orchestra.run.smithi080:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50174015a7e79f951b988949abe236791f52d4da/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T04:18:06.317 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T04:18:06.317 DEBUG:teuthology.orchestra.run.smithi106:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50174015a7e79f951b988949abe236791f52d4da/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T04:18:06.418 DEBUG:teuthology.orchestra.run.smithi080:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T04:18:06.424 DEBUG:teuthology.orchestra.run.smithi106:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T04:18:06.509 DEBUG:teuthology.orchestra.run.smithi080:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T04:18:06.514 DEBUG:teuthology.orchestra.run.smithi106:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T04:18:06.573 INFO:teuthology.orchestra.run.smithi080.stdout:check_obsoletes = 1 2024-05-10T04:18:06.576 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum clean all 2024-05-10T04:18:06.577 INFO:teuthology.orchestra.run.smithi106.stdout:check_obsoletes = 1 2024-05-10T04:18:06.581 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum clean all 2024-05-10T04:18:07.027 INFO:teuthology.orchestra.run.smithi080.stdout:Updating Subscription Management repositories. 2024-05-10T04:18:07.033 INFO:teuthology.orchestra.run.smithi106.stdout:Updating Subscription Management repositories. 2024-05-10T04:18:08.371 INFO:teuthology.orchestra.run.smithi106.stdout:61 files removed 2024-05-10T04:18:08.428 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T04:18:08.630 INFO:teuthology.orchestra.run.smithi080.stdout:61 files removed 2024-05-10T04:18:08.687 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T04:18:08.875 INFO:teuthology.orchestra.run.smithi106.stdout:Updating Subscription Management repositories. 2024-05-10T04:18:09.135 INFO:teuthology.orchestra.run.smithi080.stdout:Updating Subscription Management repositories. 2024-05-10T04:18:11.021 INFO:teuthology.orchestra.run.smithi106.stdout:ceph packages for x86_64 220 kB/s | 80 kB 00:00 2024-05-10T04:18:11.199 INFO:teuthology.orchestra.run.smithi080.stdout:ceph packages for x86_64 258 kB/s | 80 kB 00:00 2024-05-10T04:18:11.330 INFO:teuthology.orchestra.run.smithi106.stdout:ceph noarch packages 42 kB/s | 11 kB 00:00 2024-05-10T04:18:11.566 INFO:teuthology.orchestra.run.smithi080.stdout:ceph noarch packages 35 kB/s | 11 kB 00:00 2024-05-10T04:18:11.697 INFO:teuthology.orchestra.run.smithi106.stdout:ceph source packages 4.4 kB/s | 1.5 kB 00:00 2024-05-10T04:18:11.856 INFO:teuthology.orchestra.run.smithi106.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-05-10T04:18:11.925 INFO:teuthology.orchestra.run.smithi080.stdout:ceph source packages 4.5 kB/s | 1.5 kB 00:00 2024-05-10T04:18:12.109 INFO:teuthology.orchestra.run.smithi080.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-05-10T04:18:13.244 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 12 MB/s | 14 MB 00:01 2024-05-10T04:18:14.140 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 6.0 MB/s | 14 MB 00:02 2024-05-10T04:18:17.335 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 401 kB/s | 24 kB 00:00 2024-05-10T04:18:18.224 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 105 kB/s | 24 kB 00:00 2024-05-10T04:18:18.942 INFO:teuthology.orchestra.run.smithi106.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2024-05-10T04:18:19.110 INFO:teuthology.orchestra.run.smithi080.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 40 MB/s | 67 MB 00:01 2024-05-10T04:18:22.244 INFO:teuthology.orchestra.run.smithi106.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 41 MB/s | 67 MB 00:01 2024-05-10T04:18:30.054 INFO:teuthology.orchestra.run.smithi080.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 15 MB/s | 8.8 MB 00:00 2024-05-10T04:18:33.589 INFO:teuthology.orchestra.run.smithi080.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 38 MB/s | 61 MB 00:01 2024-05-10T04:18:33.786 INFO:teuthology.orchestra.run.smithi106.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 41 MB/s | 61 MB 00:01 2024-05-10T04:18:50.199 INFO:teuthology.orchestra.run.smithi106.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T04:18:50.200 INFO:teuthology.orchestra.run.smithi106.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T04:18:50.219 INFO:teuthology.orchestra.run.smithi106.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-10T04:18:50.220 INFO:teuthology.orchestra.run.smithi106.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-10T04:18:50.222 INFO:teuthology.orchestra.run.smithi106.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-10T04:18:50.224 INFO:teuthology.orchestra.run.smithi106.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-10T04:18:50.227 INFO:teuthology.orchestra.run.smithi106.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-10T04:18:50.231 INFO:teuthology.orchestra.run.smithi106.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-10T04:18:50.233 INFO:teuthology.orchestra.run.smithi106.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-10T04:18:50.457 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-10T04:18:50.478 INFO:teuthology.orchestra.run.smithi106.stdout:=================================================================================================================================== 2024-05-10T04:18:50.478 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2024-05-10T04:18:50.478 INFO:teuthology.orchestra.run.smithi106.stdout:=================================================================================================================================== 2024-05-10T04:18:50.478 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-10T04:18:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-10T04:18:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-10T04:18:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: ceph x86_64 2:18.2.2-1330.g50174015.el8 ceph 6.4 k 2024-05-10T04:18:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.7 M 2024-05-10T04:18:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 829 k 2024-05-10T04:18:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1330.g50174015.el8 ceph 157 k 2024-05-10T04:18:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr x86_64 2:18.2.2-1330.g50174015.el8 ceph 1.5 M 2024-05-10T04:18:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 138 k 2024-05-10T04:18:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 3.5 M 2024-05-10T04:18:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 7.4 M 2024-05-10T04:18:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 49 k 2024-05-10T04:18:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 14 M 2024-05-10T04:18:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test x86_64 2:18.2.2-1330.g50174015.el8 ceph 49 M 2024-05-10T04:18:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-volume noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 263 k 2024-05-10T04:18:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 173 k 2024-05-10T04:18:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 246 k 2024-05-10T04:18:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-top noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 18 k 2024-05-10T04:18:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-10T04:18:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-10T04:18:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-10T04:18:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 31 k 2024-05-10T04:18:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 756 k 2024-05-10T04:18:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T04:18:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-10T04:18:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-10T04:18:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-10T04:18:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-10T04:18:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-10T04:18:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-10T04:18:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs x86_64 2:18.2.2-1330.g50174015.el8 ceph 197 k 2024-05-10T04:18:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados x86_64 2:18.2.2-1330.g50174015.el8 ceph 371 k 2024-05-10T04:18:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 364 k 2024-05-10T04:18:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 107 k 2024-05-10T04:18:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 91 k 2024-05-10T04:18:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.3 M 2024-05-10T04:18:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 179 k 2024-05-10T04:18:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-10T04:18:50.482 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrading: 2024-05-10T04:18:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-10T04:18:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-10T04:18:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-10T04:18:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-10T04:18:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-10T04:18:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-10T04:18:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: librados2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T04:18:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T04:18:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-10T04:18:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-10T04:18:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-10T04:18:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-10T04:18:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-10T04:18:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-10T04:18:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-10T04:18:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-10T04:18:50.483 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2024-05-10T04:18:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-10T04:18:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 23 M 2024-05-10T04:18:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 24 k 2024-05-10T04:18:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds x86_64 2:18.2.2-1330.g50174015.el8 ceph 2.2 M 2024-05-10T04:18:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 246 k 2024-05-10T04:18:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.1 M 2024-05-10T04:18:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd x86_64 2:18.2.2-1330.g50174015.el8 ceph 19 M 2024-05-10T04:18:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 16 k 2024-05-10T04:18:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux x86_64 2:18.2.2-1330.g50174015.el8 ceph 24 k 2024-05-10T04:18:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-10T04:18:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-10T04:18:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-10T04:18:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-10T04:18:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-10T04:18:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T04:18:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-10T04:18:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-10T04:18:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-10T04:18:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-10T04:18:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-10T04:18:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-10T04:18:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 461 k 2024-05-10T04:18:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-10T04:18:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 7.2 M 2024-05-10T04:18:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-10T04:18:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-10T04:18:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-10T04:18:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-10T04:18:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-10T04:18:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-10T04:18:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-10T04:18:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-10T04:18:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-10T04:18:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-10T04:18:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-10T04:18:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-10T04:18:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-10T04:18:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-10T04:18:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-10T04:18:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-10T04:18:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-10T04:18:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse x86_64 2:18.2.2-1330.g50174015.el8 ceph 45 k 2024-05-10T04:18:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 129 k 2024-05-10T04:18:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-10T04:18:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-10T04:18:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-10T04:18:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-10T04:18:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-10T04:18:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-10T04:18:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-10T04:18:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-10T04:18:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-10T04:18:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-10T04:18:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-10T04:18:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-10T04:18:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-10T04:18:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-10T04:18:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-10T04:18:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-10T04:18:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-10T04:18:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-10T04:18:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-10T04:18:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-10T04:18:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-10T04:18:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-10T04:18:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-10T04:18:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-10T04:18:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-10T04:18:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-10T04:18:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-10T04:18:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-10T04:18:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-10T04:18:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-10T04:18:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-10T04:18:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-10T04:18:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-10T04:18:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-10T04:18:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-10T04:18:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-10T04:18:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-10T04:18:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-10T04:18:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-10T04:18:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-10T04:18:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-10T04:18:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-10T04:18:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-10T04:18:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-10T04:18:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-10T04:18:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-10T04:18:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-10T04:18:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-10T04:18:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-10T04:18:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-10T04:18:50.492 INFO:teuthology.orchestra.run.smithi106.stdout:Enabling module streams: 2024-05-10T04:18:50.492 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql 10 2024-05-10T04:18:50.492 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:18:50.492 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-10T04:18:50.492 INFO:teuthology.orchestra.run.smithi106.stdout:=================================================================================================================================== 2024-05-10T04:18:50.492 INFO:teuthology.orchestra.run.smithi106.stdout:Install 130 Packages 2024-05-10T04:18:50.492 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrade 16 Packages 2024-05-10T04:18:50.492 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:18:50.493 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 221 M 2024-05-10T04:18:50.493 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-10T04:18:50.711 INFO:teuthology.orchestra.run.smithi106.stdout:(1/146): ceph-18.2.2-1330.g50174015.el8.x86_64. 35 kB/s | 6.4 kB 00:00 2024-05-10T04:18:50.794 INFO:teuthology.orchestra.run.smithi080.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T04:18:50.796 INFO:teuthology.orchestra.run.smithi080.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T04:18:50.815 INFO:teuthology.orchestra.run.smithi080.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-10T04:18:50.816 INFO:teuthology.orchestra.run.smithi080.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-10T04:18:50.818 INFO:teuthology.orchestra.run.smithi080.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-10T04:18:50.819 INFO:teuthology.orchestra.run.smithi080.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-10T04:18:50.822 INFO:teuthology.orchestra.run.smithi080.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-10T04:18:50.826 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-10T04:18:50.828 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-10T04:18:51.044 INFO:teuthology.orchestra.run.smithi106.stdout:(2/146): ceph-fuse-18.2.2-1330.g50174015.el8.x8 2.4 MB/s | 829 kB 00:00 2024-05-10T04:18:51.056 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-10T04:18:51.083 INFO:teuthology.orchestra.run.smithi080.stdout:=================================================================================================================================== 2024-05-10T04:18:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-05-10T04:18:51.083 INFO:teuthology.orchestra.run.smithi080.stdout:=================================================================================================================================== 2024-05-10T04:18:51.084 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-10T04:18:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-10T04:18:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-10T04:18:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: ceph x86_64 2:18.2.2-1330.g50174015.el8 ceph 6.4 k 2024-05-10T04:18:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.7 M 2024-05-10T04:18:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 829 k 2024-05-10T04:18:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1330.g50174015.el8 ceph 157 k 2024-05-10T04:18:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr x86_64 2:18.2.2-1330.g50174015.el8 ceph 1.5 M 2024-05-10T04:18:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 138 k 2024-05-10T04:18:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 3.5 M 2024-05-10T04:18:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 7.4 M 2024-05-10T04:18:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 49 k 2024-05-10T04:18:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 14 M 2024-05-10T04:18:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test x86_64 2:18.2.2-1330.g50174015.el8 ceph 49 M 2024-05-10T04:18:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 263 k 2024-05-10T04:18:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 173 k 2024-05-10T04:18:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 246 k 2024-05-10T04:18:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 18 k 2024-05-10T04:18:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-10T04:18:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-10T04:18:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-10T04:18:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 31 k 2024-05-10T04:18:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 756 k 2024-05-10T04:18:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T04:18:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-10T04:18:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-10T04:18:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-10T04:18:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-10T04:18:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-10T04:18:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-10T04:18:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs x86_64 2:18.2.2-1330.g50174015.el8 ceph 197 k 2024-05-10T04:18:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados x86_64 2:18.2.2-1330.g50174015.el8 ceph 371 k 2024-05-10T04:18:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 364 k 2024-05-10T04:18:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 107 k 2024-05-10T04:18:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 91 k 2024-05-10T04:18:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.3 M 2024-05-10T04:18:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 179 k 2024-05-10T04:18:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-10T04:18:51.087 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrading: 2024-05-10T04:18:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-10T04:18:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-10T04:18:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-10T04:18:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-10T04:18:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-10T04:18:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-10T04:18:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: librados2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T04:18:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T04:18:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-10T04:18:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-10T04:18:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-10T04:18:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-10T04:18:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-10T04:18:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-10T04:18:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-10T04:18:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-10T04:18:51.088 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-05-10T04:18:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-10T04:18:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 23 M 2024-05-10T04:18:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 24 k 2024-05-10T04:18:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds x86_64 2:18.2.2-1330.g50174015.el8 ceph 2.2 M 2024-05-10T04:18:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 246 k 2024-05-10T04:18:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.1 M 2024-05-10T04:18:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd x86_64 2:18.2.2-1330.g50174015.el8 ceph 19 M 2024-05-10T04:18:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 16 k 2024-05-10T04:18:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux x86_64 2:18.2.2-1330.g50174015.el8 ceph 24 k 2024-05-10T04:18:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-10T04:18:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-10T04:18:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-10T04:18:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-10T04:18:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-10T04:18:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T04:18:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-10T04:18:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-10T04:18:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-10T04:18:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-10T04:18:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-10T04:18:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-10T04:18:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 461 k 2024-05-10T04:18:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-10T04:18:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 7.2 M 2024-05-10T04:18:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-10T04:18:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-10T04:18:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-10T04:18:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-10T04:18:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-10T04:18:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-10T04:18:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-10T04:18:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-10T04:18:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-10T04:18:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-10T04:18:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-10T04:18:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-10T04:18:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-10T04:18:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-10T04:18:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-10T04:18:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-10T04:18:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-10T04:18:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse x86_64 2:18.2.2-1330.g50174015.el8 ceph 45 k 2024-05-10T04:18:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 129 k 2024-05-10T04:18:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-10T04:18:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-10T04:18:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-10T04:18:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-10T04:18:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-10T04:18:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-10T04:18:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-10T04:18:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-10T04:18:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-10T04:18:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-10T04:18:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-10T04:18:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-10T04:18:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-10T04:18:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-10T04:18:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-10T04:18:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-10T04:18:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-10T04:18:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-10T04:18:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-10T04:18:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-10T04:18:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-10T04:18:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-10T04:18:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-10T04:18:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-10T04:18:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-10T04:18:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-10T04:18:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-10T04:18:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-10T04:18:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-10T04:18:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-10T04:18:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-10T04:18:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-10T04:18:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-10T04:18:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-10T04:18:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-10T04:18:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-10T04:18:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-10T04:18:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-10T04:18:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-10T04:18:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-10T04:18:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-10T04:18:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-10T04:18:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-10T04:18:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-10T04:18:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-10T04:18:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-10T04:18:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-10T04:18:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-10T04:18:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-10T04:18:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-10T04:18:51.095 INFO:teuthology.orchestra.run.smithi080.stdout:Enabling module streams: 2024-05-10T04:18:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql 10 2024-05-10T04:18:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:18:51.095 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-10T04:18:51.095 INFO:teuthology.orchestra.run.smithi080.stdout:=================================================================================================================================== 2024-05-10T04:18:51.095 INFO:teuthology.orchestra.run.smithi080.stdout:Install 130 Packages 2024-05-10T04:18:51.095 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrade 16 Packages 2024-05-10T04:18:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:18:51.096 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 221 M 2024-05-10T04:18:51.096 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-10T04:18:51.128 INFO:teuthology.orchestra.run.smithi106.stdout:(3/146): ceph-immutable-object-cache-18.2.2-133 1.8 MB/s | 157 kB 00:00 2024-05-10T04:18:51.248 INFO:teuthology.orchestra.run.smithi106.stdout:(4/146): ceph-base-18.2.2-1330.g50174015.el8.x8 7.9 MB/s | 5.7 MB 00:00 2024-05-10T04:18:51.370 INFO:teuthology.orchestra.run.smithi080.stdout:(1/146): ceph-18.2.2-1330.g50174015.el8.x86_64. 31 kB/s | 6.4 kB 00:00 2024-05-10T04:18:51.603 INFO:teuthology.orchestra.run.smithi106.stdout:(5/146): ceph-mgr-18.2.2-1330.g50174015.el8.x86 4.2 MB/s | 1.5 MB 00:00 2024-05-10T04:18:51.662 INFO:teuthology.orchestra.run.smithi106.stdout:(6/146): ceph-mds-18.2.2-1330.g50174015.el8.x86 4.0 MB/s | 2.2 MB 00:00 2024-05-10T04:18:51.787 INFO:teuthology.orchestra.run.smithi080.stdout:(2/146): ceph-fuse-18.2.2-1330.g50174015.el8.x8 1.9 MB/s | 829 kB 00:00 2024-05-10T04:18:51.904 INFO:teuthology.orchestra.run.smithi080.stdout:(3/146): ceph-immutable-object-cache-18.2.2-133 1.3 MB/s | 157 kB 00:00 2024-05-10T04:18:52.412 INFO:teuthology.orchestra.run.smithi106.stdout:(7/146): ceph-mon-18.2.2-1330.g50174015.el8.x86 6.3 MB/s | 5.1 MB 00:00 2024-05-10T04:18:52.870 INFO:teuthology.orchestra.run.smithi080.stdout:(4/146): ceph-mds-18.2.2-1330.g50174015.el8.x86 2.2 MB/s | 2.2 MB 00:00 2024-05-10T04:18:53.096 INFO:teuthology.orchestra.run.smithi106.stdout:(8/146): ceph-common-18.2.2-1330.g50174015.el8. 9.0 MB/s | 23 MB 00:02 2024-05-10T04:18:53.171 INFO:teuthology.orchestra.run.smithi106.stdout:(9/146): ceph-selinux-18.2.2-1330.g50174015.el8 326 kB/s | 24 kB 00:00 2024-05-10T04:18:53.596 INFO:teuthology.orchestra.run.smithi080.stdout:(5/146): ceph-mgr-18.2.2-1330.g50174015.el8.x86 2.1 MB/s | 1.5 MB 00:00 2024-05-10T04:18:54.088 INFO:teuthology.orchestra.run.smithi106.stdout:(10/146): ceph-osd-18.2.2-1330.g50174015.el8.x8 7.7 MB/s | 19 MB 00:02 2024-05-10T04:18:54.171 INFO:teuthology.orchestra.run.smithi106.stdout:(11/146): cephfs-mirror-18.2.2-1330.g50174015.e 2.9 MB/s | 246 kB 00:00 2024-05-10T04:18:54.263 INFO:teuthology.orchestra.run.smithi080.stdout:(6/146): ceph-base-18.2.2-1330.g50174015.el8.x8 1.8 MB/s | 5.7 MB 00:03 2024-05-10T04:18:54.363 INFO:teuthology.orchestra.run.smithi106.stdout:(12/146): ceph-radosgw-18.2.2-1330.g50174015.el 7.4 MB/s | 14 MB 00:01 2024-05-10T04:18:54.389 INFO:teuthology.orchestra.run.smithi106.stdout:(13/146): libcephfs-devel-18.2.2-1330.g50174015 142 kB/s | 31 kB 00:00 2024-05-10T04:18:54.464 INFO:teuthology.orchestra.run.smithi106.stdout:(14/146): libcephfs2-18.2.2-1330.g50174015.el8. 7.4 MB/s | 756 kB 00:00 2024-05-10T04:18:54.489 INFO:teuthology.orchestra.run.smithi106.stdout:(15/146): libcephsqlite-18.2.2-1330.g50174015.e 1.4 MB/s | 139 kB 00:00 2024-05-10T04:18:54.523 INFO:teuthology.orchestra.run.smithi106.stdout:(16/146): librados-devel-18.2.2-1330.g50174015. 2.3 MB/s | 139 kB 00:00 2024-05-10T04:18:54.590 INFO:teuthology.orchestra.run.smithi106.stdout:(17/146): libradosstriper1-18.2.2-1330.g5017401 4.5 MB/s | 461 kB 00:00 2024-05-10T04:18:54.674 INFO:teuthology.orchestra.run.smithi106.stdout:(18/146): python3-ceph-argparse-18.2.2-1330.g50 538 kB/s | 45 kB 00:00 2024-05-10T04:18:54.757 INFO:teuthology.orchestra.run.smithi106.stdout:(19/146): python3-ceph-common-18.2.2-1330.g5017 1.5 MB/s | 129 kB 00:00 2024-05-10T04:18:54.841 INFO:teuthology.orchestra.run.smithi106.stdout:(20/146): python3-cephfs-18.2.2-1330.g50174015. 2.3 MB/s | 197 kB 00:00 2024-05-10T04:18:54.941 INFO:teuthology.orchestra.run.smithi106.stdout:(21/146): python3-rados-18.2.2-1330.g50174015.e 3.6 MB/s | 371 kB 00:00 2024-05-10T04:18:55.033 INFO:teuthology.orchestra.run.smithi106.stdout:(22/146): python3-rbd-18.2.2-1330.g50174015.el8 3.9 MB/s | 364 kB 00:00 2024-05-10T04:18:55.117 INFO:teuthology.orchestra.run.smithi106.stdout:(23/146): python3-rgw-18.2.2-1330.g50174015.el8 1.3 MB/s | 107 kB 00:00 2024-05-10T04:18:55.200 INFO:teuthology.orchestra.run.smithi106.stdout:(24/146): rbd-fuse-18.2.2-1330.g50174015.el8.x8 1.1 MB/s | 91 kB 00:00 2024-05-10T04:18:55.387 INFO:teuthology.orchestra.run.smithi080.stdout:(7/146): ceph-mon-18.2.2-1330.g50174015.el8.x86 2.9 MB/s | 5.1 MB 00:01 2024-05-10T04:18:55.467 INFO:teuthology.orchestra.run.smithi106.stdout:(25/146): librgw2-18.2.2-1330.g50174015.el8.x86 7.7 MB/s | 7.2 MB 00:00 2024-05-10T04:18:55.543 INFO:teuthology.orchestra.run.smithi106.stdout:(26/146): rbd-nbd-18.2.2-1330.g50174015.el8.x86 2.3 MB/s | 179 kB 00:00 2024-05-10T04:18:55.601 INFO:teuthology.orchestra.run.smithi106.stdout:(27/146): rbd-mirror-18.2.2-1330.g50174015.el8. 8.3 MB/s | 3.3 MB 00:00 2024-05-10T04:18:55.618 INFO:teuthology.orchestra.run.smithi106.stdout:(28/146): ceph-grafana-dashboards-18.2.2-1330.g 323 kB/s | 24 kB 00:00 2024-05-10T04:18:55.677 INFO:teuthology.orchestra.run.smithi106.stdout:(29/146): ceph-mgr-cephadm-18.2.2-1330.g5017401 1.8 MB/s | 138 kB 00:00 2024-05-10T04:18:56.219 INFO:teuthology.orchestra.run.smithi106.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1330.g50174 5.9 MB/s | 3.5 MB 00:00 2024-05-10T04:18:56.311 INFO:teuthology.orchestra.run.smithi106.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1330.g50 2.6 MB/s | 246 kB 00:00 2024-05-10T04:18:56.394 INFO:teuthology.orchestra.run.smithi106.stdout:(32/146): ceph-mgr-rook-18.2.2-1330.g50174015.e 592 kB/s | 49 kB 00:00 2024-05-10T04:18:56.494 INFO:teuthology.orchestra.run.smithi106.stdout:(33/146): ceph-mgr-diskprediction-local-18.2.2- 9.0 MB/s | 7.4 MB 00:00 2024-05-10T04:18:56.658 INFO:teuthology.orchestra.run.smithi106.stdout:(34/146): ceph-prometheus-alerts-18.2.2-1330.g5 62 kB/s | 16 kB 00:00 2024-05-10T04:18:56.703 INFO:teuthology.orchestra.run.smithi106.stdout:(35/146): ceph-volume-18.2.2-1330.g50174015.el8 1.2 MB/s | 263 kB 00:00 2024-05-10T04:18:56.729 INFO:teuthology.orchestra.run.smithi106.stdout:(36/146): cephadm-18.2.2-1330.g50174015.el8.noa 2.4 MB/s | 173 kB 00:00 2024-05-10T04:18:56.771 INFO:teuthology.orchestra.run.smithi106.stdout:(37/146): cephfs-top-18.2.2-1330.g50174015.el8. 271 kB/s | 18 kB 00:00 2024-05-10T04:18:56.896 INFO:teuthology.orchestra.run.smithi106.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 470 kB/s | 59 kB 00:00 2024-05-10T04:18:56.947 INFO:teuthology.orchestra.run.smithi106.stdout:(39/146): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2024-05-10T04:18:56.972 INFO:teuthology.orchestra.run.smithi106.stdout:(40/146): libunwind-1.3.1-3.el8.x86_64.rpm 1.0 MB/s | 75 kB 00:00 2024-05-10T04:18:57.022 INFO:teuthology.orchestra.run.smithi106.stdout:(41/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 873 kB/s | 44 kB 00:00 2024-05-10T04:18:57.047 INFO:teuthology.orchestra.run.smithi106.stdout:(42/146): python3-asyncssh-2.7.0-2.el8.noarch.r 4.6 MB/s | 476 kB 00:00 2024-05-10T04:18:57.098 INFO:teuthology.orchestra.run.smithi106.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 660 kB/s | 33 kB 00:00 2024-05-10T04:18:57.131 INFO:teuthology.orchestra.run.smithi106.stdout:(44/146): python3-beautifulsoup4-4.6.3-2.el8.1. 1.7 MB/s | 185 kB 00:00 2024-05-10T04:18:57.157 INFO:teuthology.orchestra.run.smithi106.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 277 kB/s | 16 kB 00:00 2024-05-10T04:18:57.190 INFO:teuthology.orchestra.run.smithi106.stdout:(46/146): python3-cheroot-8.5.2-1.el8.noarch.rp 2.9 MB/s | 173 kB 00:00 2024-05-10T04:18:57.224 INFO:teuthology.orchestra.run.smithi106.stdout:(47/146): python3-cherrypy-18.4.0-1.el8.noarch. 5.6 MB/s | 384 kB 00:00 2024-05-10T04:18:57.249 INFO:teuthology.orchestra.run.smithi106.stdout:(48/146): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2024-05-10T04:18:57.274 INFO:teuthology.orchestra.run.smithi106.stdout:(49/146): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2024-05-10T04:18:57.300 INFO:teuthology.orchestra.run.smithi106.stdout:(50/146): python3-jaraco-functools-2.0-4.el8.no 352 kB/s | 18 kB 00:00 2024-05-10T04:18:57.350 INFO:teuthology.orchestra.run.smithi106.stdout:(51/146): python3-logutils-0.3.5-11.el8.noarch. 975 kB/s | 49 kB 00:00 2024-05-10T04:18:57.409 INFO:teuthology.orchestra.run.smithi106.stdout:(52/146): python3-kubernetes-11.0.0-6.el8.noarc 8.7 MB/s | 1.2 MB 00:00 2024-05-10T04:18:57.434 INFO:teuthology.orchestra.run.smithi106.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 703 kB/s | 59 kB 00:00 2024-05-10T04:18:57.460 INFO:teuthology.orchestra.run.smithi106.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2024-05-10T04:18:57.493 INFO:teuthology.orchestra.run.smithi106.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2024-05-10T04:18:57.518 INFO:teuthology.orchestra.run.smithi106.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 267 kB/s | 16 kB 00:00 2024-05-10T04:18:57.544 INFO:teuthology.orchestra.run.smithi106.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 674 kB/s | 34 kB 00:00 2024-05-10T04:18:57.569 INFO:teuthology.orchestra.run.smithi106.stdout:(58/146): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2024-05-10T04:18:57.594 INFO:teuthology.orchestra.run.smithi106.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 1.2 MB/s | 64 kB 00:00 2024-05-10T04:18:57.620 INFO:teuthology.orchestra.run.smithi106.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 373 kB/s | 19 kB 00:00 2024-05-10T04:18:57.645 INFO:teuthology.orchestra.run.smithi106.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 476 kB/s | 24 kB 00:00 2024-05-10T04:18:57.670 INFO:teuthology.orchestra.run.smithi106.stdout:(62/146): python3-tempora-1.14.1-5.el8.noarch.r 584 kB/s | 29 kB 00:00 2024-05-10T04:18:57.696 INFO:teuthology.orchestra.run.smithi106.stdout:(63/146): python3-trustme-0.6.0-4.el8.noarch.rp 549 kB/s | 27 kB 00:00 2024-05-10T04:18:57.721 INFO:teuthology.orchestra.run.smithi106.stdout:(64/146): python3-waitress-1.4.3-1.el8.noarch.r 5.0 MB/s | 255 kB 00:00 2024-05-10T04:18:57.755 INFO:teuthology.orchestra.run.smithi106.stdout:(65/146): python3-webob-1.8.5-1.el8.1.noarch.rp 4.2 MB/s | 251 kB 00:00 2024-05-10T04:18:57.780 INFO:teuthology.orchestra.run.smithi106.stdout:(66/146): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2024-05-10T04:18:57.805 INFO:teuthology.orchestra.run.smithi106.stdout:(67/146): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2024-05-10T04:18:57.830 INFO:teuthology.orchestra.run.smithi106.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 460 kB/s | 23 kB 00:00 2024-05-10T04:18:57.847 INFO:teuthology.orchestra.run.smithi106.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2024-05-10T04:18:57.923 INFO:teuthology.orchestra.run.smithi106.stdout:(70/146): thrift-0.13.0-2.el8.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2024-05-10T04:18:57.998 INFO:teuthology.orchestra.run.smithi106.stdout:(71/146): python3-packaging-16.8-9.el8.noarch.r 320 kB/s | 48 kB 00:00 2024-05-10T04:18:58.023 INFO:teuthology.orchestra.run.smithi106.stdout:(72/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 178 kB/s | 18 kB 00:00 2024-05-10T04:18:58.124 INFO:teuthology.orchestra.run.smithi106.stdout:(73/146): python3-jwt-1.6.1-2.el8.noarch.rpm 341 kB/s | 43 kB 00:00 2024-05-10T04:18:58.157 INFO:teuthology.orchestra.run.smithi106.stdout:(74/146): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2024-05-10T04:18:58.258 INFO:teuthology.orchestra.run.smithi106.stdout:(75/146): python3-requests-oauthlib-1.0.0-1.el8 428 kB/s | 43 kB 00:00 2024-05-10T04:18:58.283 INFO:teuthology.orchestra.run.smithi106.stdout:(76/146): python3-pycparser-2.14-14.el8.noarch. 686 kB/s | 109 kB 00:00 2024-05-10T04:18:58.337 INFO:teuthology.orchestra.run.smithi080.stdout:(8/146): ceph-common-18.2.2-1330.g50174015.el8. 3.2 MB/s | 23 MB 00:07 2024-05-10T04:18:58.388 INFO:teuthology.orchestra.run.smithi080.stdout:(9/146): ceph-selinux-18.2.2-1330.g50174015.el8 489 kB/s | 24 kB 00:00 2024-05-10T04:18:58.704 INFO:teuthology.orchestra.run.smithi080.stdout:(10/146): ceph-osd-18.2.2-1330.g50174015.el8.x8 4.2 MB/s | 19 MB 00:04 2024-05-10T04:18:58.780 INFO:teuthology.orchestra.run.smithi080.stdout:(11/146): cephfs-mirror-18.2.2-1330.g50174015.e 3.2 MB/s | 246 kB 00:00 2024-05-10T04:18:58.783 INFO:teuthology.orchestra.run.smithi106.stdout:(77/146): ceph-test-18.2.2-1330.g50174015.el8.x 8.8 MB/s | 49 MB 00:05 2024-05-10T04:18:58.808 INFO:teuthology.orchestra.run.smithi106.stdout:(78/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 34 kB/s | 19 kB 00:00 2024-05-10T04:18:58.830 INFO:teuthology.orchestra.run.smithi080.stdout:(12/146): libcephfs-devel-18.2.2-1330.g50174015 623 kB/s | 31 kB 00:00 2024-05-10T04:18:58.842 INFO:teuthology.orchestra.run.smithi106.stdout:(79/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 78 kB/s | 44 kB 00:00 2024-05-10T04:18:58.951 INFO:teuthology.orchestra.run.smithi106.stdout:(80/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2024-05-10T04:18:58.988 INFO:teuthology.orchestra.run.smithi080.stdout:(13/146): libcephfs2-18.2.2-1330.g50174015.el8. 4.7 MB/s | 756 kB 00:00 2024-05-10T04:18:59.001 INFO:teuthology.orchestra.run.smithi106.stdout:(81/146): pcre2-devel-10.32-2.el8.x86_64.rpm 2.7 MB/s | 605 kB 00:00 2024-05-10T04:18:59.026 INFO:teuthology.orchestra.run.smithi106.stdout:(82/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2024-05-10T04:18:59.039 INFO:teuthology.orchestra.run.smithi080.stdout:(14/146): libcephsqlite-18.2.2-1330.g50174015.e 2.7 MB/s | 139 kB 00:00 2024-05-10T04:18:59.118 INFO:teuthology.orchestra.run.smithi106.stdout:(83/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 412 kB/s | 48 kB 00:00 2024-05-10T04:18:59.143 INFO:teuthology.orchestra.run.smithi106.stdout:(84/146): libsepol-devel-2.9-3.el8.x86_64.rpm 744 kB/s | 87 kB 00:00 2024-05-10T04:18:59.169 INFO:teuthology.orchestra.run.smithi106.stdout:(85/146): libselinux-devel-2.9-5.el8.x86_64.rpm 919 kB/s | 200 kB 00:00 2024-05-10T04:18:59.197 INFO:teuthology.orchestra.run.smithi080.stdout:(15/146): ceph-radosgw-18.2.2-1330.g50174015.el 3.8 MB/s | 14 MB 00:03 2024-05-10T04:18:59.219 INFO:teuthology.orchestra.run.smithi106.stdout:(86/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 574 kB/s | 58 kB 00:00 2024-05-10T04:18:59.223 INFO:teuthology.orchestra.run.smithi080.stdout:(16/146): librados-devel-18.2.2-1330.g50174015. 756 kB/s | 139 kB 00:00 2024-05-10T04:18:59.303 INFO:teuthology.orchestra.run.smithi106.stdout:(87/146): libcom_err-devel-1.45.6-4.el8.x86_64. 243 kB/s | 39 kB 00:00 2024-05-10T04:18:59.328 INFO:teuthology.orchestra.run.smithi106.stdout:(88/146): fuse-2.9.7-17.el8.x86_64.rpm 522 kB/s | 83 kB 00:00 2024-05-10T04:18:59.362 INFO:teuthology.orchestra.run.smithi106.stdout:(89/146): libgfortran-8.5.0-20.el8.x86_64.rpm 4.4 MB/s | 645 kB 00:00 2024-05-10T04:18:59.437 INFO:teuthology.orchestra.run.smithi106.stdout:(90/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2024-05-10T04:18:59.462 INFO:teuthology.orchestra.run.smithi106.stdout:(91/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.7 MB/s | 238 kB 00:00 2024-05-10T04:18:59.504 INFO:teuthology.orchestra.run.smithi106.stdout:(92/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 510 kB/s | 73 kB 00:00 2024-05-10T04:18:59.506 INFO:teuthology.orchestra.run.smithi080.stdout:(17/146): libradosstriper1-18.2.2-1330.g5017401 1.5 MB/s | 461 kB 00:00 2024-05-10T04:18:59.565 INFO:teuthology.orchestra.run.smithi080.stdout:(18/146): python3-ceph-argparse-18.2.2-1330.g50 769 kB/s | 45 kB 00:00 2024-05-10T04:18:59.588 INFO:teuthology.orchestra.run.smithi106.stdout:(93/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 4.4 MB/s | 562 kB 00:00 2024-05-10T04:18:59.622 INFO:teuthology.orchestra.run.smithi106.stdout:(94/146): elfutils-libelf-devel-0.189-3.el8.x86 335 kB/s | 62 kB 00:00 2024-05-10T04:18:59.632 INFO:teuthology.orchestra.run.smithi080.stdout:(19/146): python3-ceph-common-18.2.2-1330.g5017 1.9 MB/s | 129 kB 00:00 2024-05-10T04:18:59.705 INFO:teuthology.orchestra.run.smithi106.stdout:(95/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-05-10T04:18:59.707 INFO:teuthology.orchestra.run.smithi080.stdout:(20/146): python3-cephfs-18.2.2-1330.g50174015. 2.6 MB/s | 197 kB 00:00 2024-05-10T04:18:59.747 INFO:teuthology.orchestra.run.smithi106.stdout:(96/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 297 kB/s | 47 kB 00:00 2024-05-10T04:18:59.816 INFO:teuthology.orchestra.run.smithi080.stdout:(21/146): python3-rados-18.2.2-1330.g50174015.e 3.4 MB/s | 371 kB 00:00 2024-05-10T04:18:59.831 INFO:teuthology.orchestra.run.smithi106.stdout:(97/146): python3-cryptography-3.2.1-7.el8_9.x8 2.6 MB/s | 559 kB 00:00 2024-05-10T04:18:59.881 INFO:teuthology.orchestra.run.smithi106.stdout:(98/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 746 kB/s | 100 kB 00:00 2024-05-10T04:18:59.906 INFO:teuthology.orchestra.run.smithi106.stdout:(99/146): NetworkManager-initscripts-updown-1.4 718 kB/s | 144 kB 00:00 2024-05-10T04:18:59.941 INFO:teuthology.orchestra.run.smithi080.stdout:(22/146): python3-rbd-18.2.2-1330.g50174015.el8 2.9 MB/s | 364 kB 00:00 2024-05-10T04:19:00.008 INFO:teuthology.orchestra.run.smithi080.stdout:(23/146): python3-rgw-18.2.2-1330.g50174015.el8 1.6 MB/s | 107 kB 00:00 2024-05-10T04:19:00.075 INFO:teuthology.orchestra.run.smithi080.stdout:(24/146): rbd-fuse-18.2.2-1330.g50174015.el8.x8 1.3 MB/s | 91 kB 00:00 2024-05-10T04:19:00.098 INFO:teuthology.orchestra.run.smithi106.stdout:(100/146): python3-pyasn1-modules-0.3.7-6.el8.n 574 kB/s | 110 kB 00:00 2024-05-10T04:19:00.124 INFO:teuthology.orchestra.run.smithi106.stdout:(101/146): python3-jsonpointer-1.10-11.el8.noar 68 kB/s | 20 kB 00:00 2024-05-10T04:19:00.182 INFO:teuthology.orchestra.run.smithi106.stdout:(102/146): python3-prettytable-0.7.2-14.el8.noa 146 kB/s | 44 kB 00:00 2024-05-10T04:19:00.224 INFO:teuthology.orchestra.run.smithi106.stdout:(103/146): python3-jsonpatch-1.21-2.el8.noarch. 211 kB/s | 27 kB 00:00 2024-05-10T04:19:00.316 INFO:teuthology.orchestra.run.smithi106.stdout:(104/146): python3-werkzeug-0.12.2-4.el8.noarch 3.3 MB/s | 457 kB 00:00 2024-05-10T04:19:00.334 INFO:teuthology.orchestra.run.smithi080.stdout:(25/146): librgw2-18.2.2-1330.g50174015.el8.x86 6.5 MB/s | 7.2 MB 00:01 2024-05-10T04:19:00.341 INFO:teuthology.orchestra.run.smithi106.stdout:(105/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 582 kB/s | 126 kB 00:00 2024-05-10T04:19:00.375 INFO:teuthology.orchestra.run.smithi106.stdout:(106/146): bison-3.0.4-10.el8.x86_64.rpm 4.5 MB/s | 688 kB 00:00 2024-05-10T04:19:00.392 INFO:teuthology.orchestra.run.smithi080.stdout:(26/146): rbd-nbd-18.2.2-1330.g50174015.el8.x86 3.0 MB/s | 179 kB 00:00 2024-05-10T04:19:00.442 INFO:teuthology.orchestra.run.smithi080.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1330.g 487 kB/s | 24 kB 00:00 2024-05-10T04:19:00.501 INFO:teuthology.orchestra.run.smithi080.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1330.g5017401 2.3 MB/s | 138 kB 00:00 2024-05-10T04:19:00.562 INFO:teuthology.orchestra.run.smithi106.stdout:(107/146): libtool-2.4.6-25.el8.x86_64.rpm 3.2 MB/s | 709 kB 00:00 2024-05-10T04:19:00.592 INFO:teuthology.orchestra.run.smithi106.stdout:(108/146): flex-2.6.1-9.el8.x86_64.rpm 1.1 MB/s | 320 kB 00:00 2024-05-10T04:19:00.634 INFO:teuthology.orchestra.run.smithi106.stdout:(109/146): python3-markupsafe-0.23-19.el8.x86_6 150 kB/s | 39 kB 00:00 2024-05-10T04:19:00.759 INFO:teuthology.orchestra.run.smithi106.stdout:(110/146): uuid-1.6.2-43.el8.x86_64.rpm 384 kB/s | 64 kB 00:00 2024-05-10T04:19:00.793 INFO:teuthology.orchestra.run.smithi106.stdout:(111/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.1 MB/s | 259 kB 00:00 2024-05-10T04:19:00.794 INFO:teuthology.orchestra.run.smithi080.stdout:(29/146): rbd-mirror-18.2.2-1330.g50174015.el8. 4.6 MB/s | 3.3 MB 00:00 2024-05-10T04:19:00.877 INFO:teuthology.orchestra.run.smithi106.stdout:(112/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 427 kB/s | 103 kB 00:00 2024-05-10T04:19:00.944 INFO:teuthology.orchestra.run.smithi080.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1330.g50174 8.0 MB/s | 3.5 MB 00:00 2024-05-10T04:19:01.010 INFO:teuthology.orchestra.run.smithi080.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1330.g50 3.6 MB/s | 246 kB 00:00 2024-05-10T04:19:01.061 INFO:teuthology.orchestra.run.smithi080.stdout:(32/146): ceph-mgr-rook-18.2.2-1330.g50174015.e 991 kB/s | 49 kB 00:00 2024-05-10T04:19:01.077 INFO:teuthology.orchestra.run.smithi106.stdout:(113/146): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2024-05-10T04:19:01.119 INFO:teuthology.orchestra.run.smithi106.stdout:(114/146): python3-jinja2-2.10.1-3.el8.noarch.r 1.6 MB/s | 538 kB 00:00 2024-05-10T04:19:01.127 INFO:teuthology.orchestra.run.smithi080.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1330.g5 245 kB/s | 16 kB 00:00 2024-05-10T04:19:01.203 INFO:teuthology.orchestra.run.smithi080.stdout:(34/146): ceph-volume-18.2.2-1330.g50174015.el8 3.4 MB/s | 263 kB 00:00 2024-05-10T04:19:01.219 INFO:teuthology.orchestra.run.smithi106.stdout:(115/146): python3-numpy-1.14.3-10.el8.x86_64.r 11 MB/s | 3.7 MB 00:00 2024-05-10T04:19:01.261 INFO:teuthology.orchestra.run.smithi080.stdout:(35/146): cephadm-18.2.2-1330.g50174015.el8.noa 2.9 MB/s | 173 kB 00:00 2024-05-10T04:19:01.294 INFO:teuthology.orchestra.run.smithi106.stdout:(116/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.3 MB/s | 225 kB 00:00 2024-05-10T04:19:01.312 INFO:teuthology.orchestra.run.smithi080.stdout:(36/146): cephfs-top-18.2.2-1330.g50174015.el8. 364 kB/s | 18 kB 00:00 2024-05-10T04:19:01.328 INFO:teuthology.orchestra.run.smithi106.stdout:(117/146): socat-1.7.4.1-1.el8.x86_64.rpm 1.3 MB/s | 323 kB 00:00 2024-05-10T04:19:01.412 INFO:teuthology.orchestra.run.smithi106.stdout:(118/146): librdkafka-0.11.4-3.el8.x86_64.rpm 1.8 MB/s | 354 kB 00:00 2024-05-10T04:19:01.512 INFO:teuthology.orchestra.run.smithi106.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 856 kB/s | 157 kB 00:00 2024-05-10T04:19:01.587 INFO:teuthology.orchestra.run.smithi080.stdout:(37/146): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2024-05-10T04:19:01.637 INFO:teuthology.orchestra.run.smithi080.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 1.2 MB/s | 59 kB 00:00 2024-05-10T04:19:01.696 INFO:teuthology.orchestra.run.smithi080.stdout:(39/146): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2024-05-10T04:19:01.797 INFO:teuthology.orchestra.run.smithi080.stdout:(40/146): python3-asyncssh-2.7.0-2.el8.noarch.r 4.6 MB/s | 476 kB 00:00 2024-05-10T04:19:01.855 INFO:teuthology.orchestra.run.smithi080.stdout:(41/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 750 kB/s | 44 kB 00:00 2024-05-10T04:19:01.887 INFO:teuthology.orchestra.run.smithi106.stdout:(120/146): openblas-threads-0.3.15-6.el8.x86_64 8.8 MB/s | 5.2 MB 00:00 2024-05-10T04:19:01.938 INFO:teuthology.orchestra.run.smithi106.stdout:(121/146): automake-1.16.1-8.el8.noarch.rpm 1.6 MB/s | 714 kB 00:00 2024-05-10T04:19:01.944 INFO:teuthology.orchestra.run.smithi080.stdout:(42/146): python3-beautifulsoup4-4.6.3-2.el8.1. 2.0 MB/s | 185 kB 00:00 2024-05-10T04:19:02.006 INFO:teuthology.orchestra.run.smithi080.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 539 kB/s | 33 kB 00:00 2024-05-10T04:19:02.054 INFO:teuthology.orchestra.run.smithi106.stdout:(122/146): openblas-0.3.15-6.el8.x86_64.rpm 7.9 MB/s | 5.0 MB 00:00 2024-05-10T04:19:02.073 INFO:teuthology.orchestra.run.smithi080.stdout:(44/146): python3-certifi-2018.10.15-7.el8.noar 244 kB/s | 16 kB 00:00 2024-05-10T04:19:02.088 INFO:teuthology.orchestra.run.smithi106.stdout:(123/146): libpq-13.11-1.el8.x86_64.rpm 988 kB/s | 198 kB 00:00 2024-05-10T04:19:02.132 INFO:teuthology.orchestra.run.smithi080.stdout:(45/146): python3-cheroot-8.5.2-1.el8.noarch.rp 2.9 MB/s | 173 kB 00:00 2024-05-10T04:19:02.230 INFO:teuthology.orchestra.run.smithi106.stdout:(124/146): jq-1.6-7.el8.x86_64.rpm 693 kB/s | 202 kB 00:00 2024-05-10T04:19:02.265 INFO:teuthology.orchestra.run.smithi080.stdout:(46/146): ceph-mgr-diskprediction-local-18.2.2- 5.0 MB/s | 7.4 MB 00:01 2024-05-10T04:19:02.280 INFO:teuthology.orchestra.run.smithi106.stdout:(125/146): python3-pytz-2017.2-11.el8.noarch.rp 241 kB/s | 54 kB 00:00 2024-05-10T04:19:02.299 INFO:teuthology.orchestra.run.smithi080.stdout:(47/146): python3-cherrypy-18.4.0-1.el8.noarch. 2.3 MB/s | 384 kB 00:00 2024-05-10T04:19:02.383 INFO:teuthology.orchestra.run.smithi080.stdout:(48/146): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2024-05-10T04:19:02.441 INFO:teuthology.orchestra.run.smithi080.stdout:(49/146): python3-jaraco-functools-2.0-4.el8.no 303 kB/s | 18 kB 00:00 2024-05-10T04:19:02.466 INFO:teuthology.orchestra.run.smithi080.stdout:(50/146): python3-google-auth-1.1.1-10.el8.noar 405 kB/s | 81 kB 00:00 2024-05-10T04:19:02.542 INFO:teuthology.orchestra.run.smithi080.stdout:(51/146): python3-kubernetes-11.0.0-6.el8.noarc 12 MB/s | 1.2 MB 00:00 2024-05-10T04:19:02.567 INFO:teuthology.orchestra.run.smithi080.stdout:(52/146): python3-logutils-0.3.5-11.el8.noarch. 487 kB/s | 49 kB 00:00 2024-05-10T04:19:02.601 INFO:teuthology.orchestra.run.smithi080.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2024-05-10T04:19:02.614 INFO:teuthology.orchestra.run.smithi106.stdout:(126/146): python3-scipy-1.0.0-21.module+el8.9. 26 MB/s | 14 MB 00:00 2024-05-10T04:19:02.643 INFO:teuthology.orchestra.run.smithi080.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 803 kB/s | 60 kB 00:00 2024-05-10T04:19:02.647 INFO:teuthology.orchestra.run.smithi106.stdout:(127/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 451 kB/s | 188 kB 00:00 2024-05-10T04:19:02.676 INFO:teuthology.orchestra.run.smithi080.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2024-05-10T04:19:02.698 INFO:teuthology.orchestra.run.smithi106.stdout:(128/146): postgresql-10.23-4.module+el8.9.0+21 3.6 MB/s | 1.5 MB 00:00 2024-05-10T04:19:02.701 INFO:teuthology.orchestra.run.smithi080.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2024-05-10T04:19:02.735 INFO:teuthology.orchestra.run.smithi080.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 574 kB/s | 34 kB 00:00 2024-05-10T04:19:02.808 INFO:teuthology.orchestra.run.smithi106.stdout:(129/146): postgresql-contrib-10.23-4.module+el 4.1 MB/s | 812 kB 00:00 2024-05-10T04:19:02.811 INFO:teuthology.orchestra.run.smithi080.stdout:(58/146): python3-rsa-4.9-2.el8.noarch.rpm 858 kB/s | 64 kB 00:00 2024-05-10T04:19:02.836 INFO:teuthology.orchestra.run.smithi080.stdout:(59/146): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2024-05-10T04:19:02.869 INFO:teuthology.orchestra.run.smithi080.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 322 kB/s | 19 kB 00:00 2024-05-10T04:19:02.895 INFO:teuthology.orchestra.run.smithi080.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 408 kB/s | 24 kB 00:00 2024-05-10T04:19:02.928 INFO:teuthology.orchestra.run.smithi080.stdout:(62/146): python3-tempora-1.14.1-5.el8.noarch.r 501 kB/s | 29 kB 00:00 2024-05-10T04:19:02.954 INFO:teuthology.orchestra.run.smithi080.stdout:(63/146): python3-trustme-0.6.0-4.el8.noarch.rp 471 kB/s | 27 kB 00:00 2024-05-10T04:19:02.975 INFO:teuthology.orchestra.run.smithi106.stdout:(130/146): postgresql-server-10.23-4.module+el8 15 MB/s | 5.1 MB 00:00 2024-05-10T04:19:02.987 INFO:teuthology.orchestra.run.smithi080.stdout:(64/146): python3-waitress-1.4.3-1.el8.noarch.r 4.3 MB/s | 255 kB 00:00 2024-05-10T04:19:03.038 INFO:teuthology.orchestra.run.smithi080.stdout:(65/146): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2024-05-10T04:19:03.063 INFO:teuthology.orchestra.run.smithi080.stdout:(66/146): python3-websocket-client-0.56.0-5.el8 815 kB/s | 61 kB 00:00 2024-05-10T04:19:03.097 INFO:teuthology.orchestra.run.smithi080.stdout:(67/146): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2024-05-10T04:19:03.100 INFO:teuthology.orchestra.run.smithi106.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.8 MB/s | 232 kB 00:00 2024-05-10T04:19:03.130 INFO:teuthology.orchestra.run.smithi080.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 345 kB/s | 23 kB 00:00 2024-05-10T04:19:03.155 INFO:teuthology.orchestra.run.smithi080.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-05-10T04:19:03.251 INFO:teuthology.orchestra.run.smithi106.stdout:(132/146): librados2-18.2.2-1330.g50174015.el8. 6.4 MB/s | 3.5 MB 00:00 2024-05-10T04:19:03.264 INFO:teuthology.orchestra.run.smithi080.stdout:(70/146): thrift-0.13.0-2.el8.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2024-05-10T04:19:03.290 INFO:teuthology.orchestra.run.smithi080.stdout:(71/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 134 kB/s | 18 kB 00:00 2024-05-10T04:19:03.318 INFO:teuthology.orchestra.run.smithi106.stdout:(133/146): librbd1-18.2.2-1330.g50174015.el8.x8 7.0 MB/s | 3.5 MB 00:00 2024-05-10T04:19:03.343 INFO:teuthology.orchestra.run.smithi106.stdout:(134/146): elfutils-libs-0.189-3.el8.x86_64.rpm 1.2 MB/s | 303 kB 00:00 2024-05-10T04:19:03.373 INFO:teuthology.orchestra.run.smithi080.stdout:(72/146): python3-oauthlib-2.1.0-1.el8.noarch.r 2.0 MB/s | 155 kB 00:00 2024-05-10T04:19:03.390 INFO:teuthology.orchestra.run.smithi080.stdout:(73/146): python3-jwt-1.6.1-2.el8.noarch.rpm 339 kB/s | 43 kB 00:00 2024-05-10T04:19:03.393 INFO:teuthology.orchestra.run.smithi106.stdout:(135/146): iproute-6.2.0-5.el8_9.x86_64.rpm 5.9 MB/s | 854 kB 00:00 2024-05-10T04:19:03.452 INFO:teuthology.orchestra.run.smithi106.stdout:(136/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 5.2 MB/s | 711 kB 00:00 2024-05-10T04:19:03.499 INFO:teuthology.orchestra.run.smithi080.stdout:(74/146): python3-pycparser-2.14-14.el8.noarch. 872 kB/s | 109 kB 00:00 2024-05-10T04:19:03.516 INFO:teuthology.orchestra.run.smithi080.stdout:(75/146): python3-requests-oauthlib-1.0.0-1.el8 341 kB/s | 43 kB 00:00 2024-05-10T04:19:03.530 INFO:teuthology.orchestra.run.smithi106.stdout:(137/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 7.9 MB/s | 1.5 MB 00:00 2024-05-10T04:19:03.561 INFO:teuthology.orchestra.run.smithi106.stdout:(138/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 1.9 MB/s | 333 kB 00:00 2024-05-10T04:19:03.636 INFO:teuthology.orchestra.run.smithi106.stdout:(139/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.8 MB/s | 1.1 MB 00:00 2024-05-10T04:19:03.641 INFO:teuthology.orchestra.run.smithi080.stdout:(76/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 351 kB/s | 44 kB 00:00 2024-05-10T04:19:03.661 INFO:teuthology.orchestra.run.smithi106.stdout:(140/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.6 MB/s | 221 kB 00:00 2024-05-10T04:19:03.666 INFO:teuthology.orchestra.run.smithi080.stdout:(77/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 112 kB/s | 19 kB 00:00 2024-05-10T04:19:03.695 INFO:teuthology.orchestra.run.smithi106.stdout:(141/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.9 MB/s | 254 kB 00:00 2024-05-10T04:19:03.746 INFO:teuthology.orchestra.run.smithi106.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 2.1 MB/s | 237 kB 00:00 2024-05-10T04:19:03.813 INFO:teuthology.orchestra.run.smithi106.stdout:(143/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.2 MB/s | 180 kB 00:00 2024-05-10T04:19:03.816 INFO:teuthology.orchestra.run.smithi080.stdout:(78/146): pcre2-devel-10.32-2.el8.x86_64.rpm 3.4 MB/s | 605 kB 00:00 2024-05-10T04:19:03.850 INFO:teuthology.orchestra.run.smithi080.stdout:(79/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.2 MB/s | 229 kB 00:00 2024-05-10T04:19:03.887 INFO:teuthology.orchestra.run.smithi106.stdout:(144/146): util-linux-2.32.1-44.el8_9.1.x86_64. 17 MB/s | 2.5 MB 00:00 2024-05-10T04:19:03.913 INFO:teuthology.orchestra.run.smithi106.stdout:(145/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 456 kB/s | 99 kB 00:00 2024-05-10T04:19:03.938 INFO:teuthology.orchestra.run.smithi106.stdout:(146/146): util-linux-user-2.32.1-44.el8_9.1.x8 822 kB/s | 103 kB 00:00 2024-05-10T04:19:03.940 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-10T04:19:03.941 INFO:teuthology.orchestra.run.smithi106.stdout:Total 16 MB/s | 221 MB 00:13 2024-05-10T04:19:04.545 INFO:teuthology.orchestra.run.smithi080.stdout:(80/146): ceph-test-18.2.2-1330.g50174015.el8.x 8.0 MB/s | 49 MB 00:06 2024-05-10T04:19:04.585 INFO:teuthology.orchestra.run.smithi080.stdout:(81/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 287 kB/s | 220 kB 00:00 2024-05-10T04:19:04.618 INFO:teuthology.orchestra.run.smithi080.stdout:(82/146): libselinux-devel-2.9-5.el8.x86_64.rpm 260 kB/s | 200 kB 00:00 2024-05-10T04:19:04.701 INFO:teuthology.orchestra.run.smithi080.stdout:(83/146): libsepol-devel-2.9-3.el8.x86_64.rpm 784 kB/s | 87 kB 00:00 2024-05-10T04:19:04.735 INFO:teuthology.orchestra.run.smithi080.stdout:(84/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 254 kB/s | 48 kB 00:00 2024-05-10T04:19:04.760 INFO:teuthology.orchestra.run.smithi080.stdout:(85/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 406 kB/s | 58 kB 00:00 2024-05-10T04:19:04.854 INFO:teuthology.orchestra.run.smithi080.stdout:(86/146): libcom_err-devel-1.45.6-4.el8.x86_64. 256 kB/s | 39 kB 00:00 2024-05-10T04:19:04.886 INFO:teuthology.orchestra.run.smithi080.stdout:(87/146): libgfortran-8.5.0-20.el8.x86_64.rpm 5.0 MB/s | 645 kB 00:00 2024-05-10T04:19:04.928 INFO:teuthology.orchestra.run.smithi080.stdout:(88/146): fuse-2.9.7-17.el8.x86_64.rpm 431 kB/s | 83 kB 00:00 2024-05-10T04:19:04.987 INFO:teuthology.orchestra.run.smithi080.stdout:(89/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2024-05-10T04:19:05.012 INFO:teuthology.orchestra.run.smithi080.stdout:(90/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 238 kB 00:00 2024-05-10T04:19:05.079 INFO:teuthology.orchestra.run.smithi080.stdout:(91/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 483 kB/s | 73 kB 00:00 2024-05-10T04:19:05.129 INFO:teuthology.orchestra.run.smithi080.stdout:(92/146): elfutils-libelf-devel-0.189-3.el8.x86 435 kB/s | 62 kB 00:00 2024-05-10T04:19:05.221 INFO:teuthology.orchestra.run.smithi080.stdout:(93/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 2.6 MB/s | 562 kB 00:00 2024-05-10T04:19:05.296 INFO:teuthology.orchestra.run.smithi080.stdout:(94/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 11 MB/s | 2.3 MB 00:00 2024-05-10T04:19:05.321 INFO:teuthology.orchestra.run.smithi080.stdout:(95/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 245 kB/s | 47 kB 00:00 2024-05-10T04:19:05.395 INFO:teuthology.orchestra.run.smithi080.stdout:(96/146): python3-cryptography-3.2.1-7.el8_9.x8 3.1 MB/s | 559 kB 00:00 2024-05-10T04:19:05.430 INFO:teuthology.orchestra.run.smithi080.stdout:(97/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 919 kB/s | 100 kB 00:00 2024-05-10T04:19:05.456 INFO:teuthology.orchestra.run.smithi080.stdout:(98/146): NetworkManager-initscripts-updown-1.4 905 kB/s | 144 kB 00:00 2024-05-10T04:19:05.590 INFO:teuthology.orchestra.run.smithi080.stdout:(99/146): python3-jsonpointer-1.10-11.el8.noarc 126 kB/s | 20 kB 00:00 2024-05-10T04:19:05.615 INFO:teuthology.orchestra.run.smithi080.stdout:(100/146): python3-packaging-16.8-9.el8.noarch. 220 kB/s | 48 kB 00:00 2024-05-10T04:19:05.665 INFO:teuthology.orchestra.run.smithi080.stdout:(101/146): python3-prettytable-0.7.2-14.el8.noa 210 kB/s | 44 kB 00:00 2024-05-10T04:19:05.691 INFO:teuthology.orchestra.run.smithi080.stdout:(102/146): python3-jsonpatch-1.21-2.el8.noarch. 352 kB/s | 27 kB 00:00 2024-05-10T04:19:05.716 INFO:teuthology.orchestra.run.smithi080.stdout:(103/146): python3-pyasn1-modules-0.3.7-6.el8.n 875 kB/s | 110 kB 00:00 2024-05-10T04:19:05.841 INFO:teuthology.orchestra.run.smithi080.stdout:(104/146): python3-werkzeug-0.12.2-4.el8.noarch 3.0 MB/s | 457 kB 00:00 2024-05-10T04:19:05.866 INFO:teuthology.orchestra.run.smithi080.stdout:(105/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 629 kB/s | 126 kB 00:00 2024-05-10T04:19:05.925 INFO:teuthology.orchestra.run.smithi080.stdout:(106/146): bison-3.0.4-10.el8.x86_64.rpm 3.2 MB/s | 688 kB 00:00 2024-05-10T04:19:05.992 INFO:teuthology.orchestra.run.smithi080.stdout:(107/146): flex-2.6.1-9.el8.x86_64.rpm 2.1 MB/s | 320 kB 00:00 2024-05-10T04:19:06.042 INFO:teuthology.orchestra.run.smithi080.stdout:(108/146): libtool-2.4.6-25.el8.x86_64.rpm 3.9 MB/s | 709 kB 00:00 2024-05-10T04:19:06.067 INFO:teuthology.orchestra.run.smithi080.stdout:(109/146): python3-markupsafe-0.23-19.el8.x86_6 273 kB/s | 39 kB 00:00 2024-05-10T04:19:06.106 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-10T04:19:06.126 INFO:teuthology.orchestra.run.smithi080.stdout:(110/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2024-05-10T04:19:06.159 INFO:teuthology.orchestra.run.smithi080.stdout:(111/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.1 MB/s | 103 kB 00:00 2024-05-10T04:19:06.251 INFO:teuthology.orchestra.run.smithi080.stdout:(112/146): uuid-1.6.2-43.el8.x86_64.rpm 306 kB/s | 64 kB 00:00 2024-05-10T04:19:06.293 INFO:teuthology.orchestra.run.smithi080.stdout:(113/146): python3-jinja2-2.10.1-3.el8.noarch.r 3.9 MB/s | 538 kB 00:00 2024-05-10T04:19:06.435 INFO:teuthology.orchestra.run.smithi080.stdout:(114/146): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2024-05-10T04:19:06.469 INFO:teuthology.orchestra.run.smithi080.stdout:(115/146): socat-1.7.4.1-1.el8.x86_64.rpm 1.8 MB/s | 323 kB 00:00 2024-05-10T04:19:06.544 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-10T04:19:06.544 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-10T04:19:06.578 INFO:teuthology.orchestra.run.smithi080.stdout:(116/146): python3-numpy-1.14.3-10.el8.x86_64.r 11 MB/s | 3.7 MB 00:00 2024-05-10T04:19:06.603 INFO:teuthology.orchestra.run.smithi080.stdout:(117/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.3 MB/s | 225 kB 00:00 2024-05-10T04:19:06.661 INFO:teuthology.orchestra.run.smithi080.stdout:(118/146): librdkafka-0.11.4-3.el8.x86_64.rpm 1.8 MB/s | 354 kB 00:00 2024-05-10T04:19:06.720 INFO:teuthology.orchestra.run.smithi080.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.3 MB/s | 157 kB 00:00 2024-05-10T04:19:06.895 INFO:teuthology.orchestra.run.smithi080.stdout:(120/146): openblas-threads-0.3.15-6.el8.x86_64 16 MB/s | 5.2 MB 00:00 2024-05-10T04:19:06.937 INFO:teuthology.orchestra.run.smithi080.stdout:(121/146): automake-1.16.1-8.el8.noarch.rpm 3.2 MB/s | 714 kB 00:00 2024-05-10T04:19:07.029 INFO:teuthology.orchestra.run.smithi080.stdout:(122/146): openblas-0.3.15-6.el8.x86_64.rpm 14 MB/s | 5.0 MB 00:00 2024-05-10T04:19:07.088 INFO:teuthology.orchestra.run.smithi080.stdout:(123/146): libpq-13.11-1.el8.x86_64.rpm 1.0 MB/s | 198 kB 00:00 2024-05-10T04:19:07.113 INFO:teuthology.orchestra.run.smithi080.stdout:(124/146): jq-1.6-7.el8.x86_64.rpm 1.1 MB/s | 202 kB 00:00 2024-05-10T04:19:07.180 INFO:teuthology.orchestra.run.smithi080.stdout:(125/146): python3-pytz-2017.2-11.el8.noarch.rp 360 kB/s | 54 kB 00:00 2024-05-10T04:19:07.280 INFO:teuthology.orchestra.run.smithi080.stdout:(126/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-05-10T04:19:07.381 INFO:teuthology.orchestra.run.smithi080.stdout:(127/146): postgresql-10.23-4.module+el8.9.0+21 7.5 MB/s | 1.5 MB 00:00 2024-05-10T04:19:07.423 INFO:teuthology.orchestra.run.smithi080.stdout:(128/146): postgresql-contrib-10.23-4.module+el 5.6 MB/s | 812 kB 00:00 2024-05-10T04:19:07.615 INFO:teuthology.orchestra.run.smithi080.stdout:(129/146): python3-scipy-1.0.0-21.module+el8.9. 26 MB/s | 14 MB 00:00 2024-05-10T04:19:07.765 INFO:teuthology.orchestra.run.smithi080.stdout:(130/146): postgresql-server-10.23-4.module+el8 13 MB/s | 5.1 MB 00:00 2024-05-10T04:19:07.923 INFO:teuthology.orchestra.run.smithi080.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.4 MB/s | 232 kB 00:00 2024-05-10T04:19:08.040 INFO:teuthology.orchestra.run.smithi080.stdout:(132/146): elfutils-libs-0.189-3.el8.x86_64.rpm 2.5 MB/s | 303 kB 00:00 2024-05-10T04:19:08.174 INFO:teuthology.orchestra.run.smithi080.stdout:(133/146): librbd1-18.2.2-1330.g50174015.el8.x8 6.3 MB/s | 3.5 MB 00:00 2024-05-10T04:19:08.249 INFO:teuthology.orchestra.run.smithi080.stdout:(134/146): iproute-6.2.0-5.el8_9.x86_64.rpm 4.0 MB/s | 854 kB 00:00 2024-05-10T04:19:08.256 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-10T04:19:08.266 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-10T04:19:08.333 INFO:teuthology.orchestra.run.smithi080.stdout:(135/146): librados2-18.2.2-1330.g50174015.el8. 3.9 MB/s | 3.5 MB 00:00 2024-05-10T04:19:08.375 INFO:teuthology.orchestra.run.smithi080.stdout:(136/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 3.5 MB/s | 711 kB 00:00 2024-05-10T04:19:08.442 INFO:teuthology.orchestra.run.smithi080.stdout:(137/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 7.7 MB/s | 1.5 MB 00:00 2024-05-10T04:19:08.492 INFO:teuthology.orchestra.run.smithi080.stdout:(138/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 2.1 MB/s | 333 kB 00:00 2024-05-10T04:19:08.575 INFO:teuthology.orchestra.run.smithi080.stdout:(139/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.6 MB/s | 221 kB 00:00 2024-05-10T04:19:08.617 INFO:teuthology.orchestra.run.smithi080.stdout:(140/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 4.4 MB/s | 1.1 MB 00:00 2024-05-10T04:19:08.643 INFO:teuthology.orchestra.run.smithi080.stdout:(141/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.6 MB/s | 254 kB 00:00 2024-05-10T04:19:08.668 INFO:teuthology.orchestra.run.smithi080.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 2.5 MB/s | 237 kB 00:00 2024-05-10T04:19:08.763 INFO:teuthology.orchestra.run.smithi080.stdout:(143/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.2 MB/s | 180 kB 00:00 2024-05-10T04:19:08.793 INFO:teuthology.orchestra.run.smithi080.stdout:(144/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 659 kB/s | 99 kB 00:00 2024-05-10T04:19:08.827 INFO:teuthology.orchestra.run.smithi080.stdout:(145/146): util-linux-user-2.32.1-44.el8_9.1.x8 1.6 MB/s | 103 kB 00:00 2024-05-10T04:19:08.886 INFO:teuthology.orchestra.run.smithi080.stdout:(146/146): util-linux-2.32.1-44.el8_9.1.x86_64. 11 MB/s | 2.5 MB 00:00 2024-05-10T04:19:08.888 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-10T04:19:08.888 INFO:teuthology.orchestra.run.smithi080.stdout:Total 12 MB/s | 221 MB 00:17 2024-05-10T04:19:11.043 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-10T04:19:11.484 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-10T04:19:11.485 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-10T04:19:13.260 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-10T04:19:13.272 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-10T04:19:13.684 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-10T04:19:13.865 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-10T04:19:14.104 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-10T04:19:14.372 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-10T04:19:14.541 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-10T04:19:14.685 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-10T04:19:14.785 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-10T04:19:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-10T04:19:15.047 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-10T04:19:15.216 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-10T04:19:15.437 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-05-10T04:19:15.602 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-10T04:19:15.730 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-10T04:19:15.951 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-10T04:19:16.430 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-10T04:19:16.593 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librados2-2:18.2.2-1330.g50174015.el8.x86_64 9/162 2024-05-10T04:19:17.066 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-2:18.2.2-1330.g50174015.el8.x86_64 9/162 2024-05-10T04:19:17.718 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 10/162 2024-05-10T04:19:17.876 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 10/162 2024-05-10T04:19:18.010 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 11/162 2024-05-10T04:19:18.118 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 11/162 2024-05-10T04:19:18.413 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 12/162 2024-05-10T04:19:18.634 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-10T04:19:18.752 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-10T04:19:18.941 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-10T04:19:19.224 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-10T04:19:19.406 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-10T04:19:19.487 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-10T04:19:19.682 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-10T04:19:19.828 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-10T04:19:20.034 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-10T04:19:20.040 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-10T04:19:20.184 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/162 2024-05-10T04:19:20.295 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/162 2024-05-10T04:19:20.302 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-10T04:19:20.451 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/162 2024-05-10T04:19:20.507 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-10T04:19:20.556 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/162 2024-05-10T04:19:20.651 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-10T04:19:20.773 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-05-10T04:19:20.781 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-10T04:19:20.926 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-10T04:19:21.019 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-10T04:19:21.050 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-05-10T04:19:21.231 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-10T04:19:21.284 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-05-10T04:19:21.442 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-10T04:19:21.461 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-05-10T04:19:21.607 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-10T04:19:21.684 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-10T04:19:21.773 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-10T04:19:21.831 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-10T04:19:22.067 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-10T04:19:22.467 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-10T04:19:22.539 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-10T04:19:22.609 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-10T04:19:22.734 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librados2-2:18.2.2-1330.g50174015.el8.x86_64 9/162 2024-05-10T04:19:23.188 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:18.2.2-1330.g50174015.el8.x86_64 9/162 2024-05-10T04:19:23.281 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-10T04:19:23.384 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 10/162 2024-05-10T04:19:23.459 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-05-10T04:19:23.538 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 10/162 2024-05-10T04:19:23.717 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 11/162 2024-05-10T04:19:23.838 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 11/162 2024-05-10T04:19:24.163 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 12/162 2024-05-10T04:19:24.255 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-05-10T04:19:24.400 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-10T04:19:24.499 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-05-10T04:19:24.516 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-10T04:19:24.724 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-05-10T04:19:24.738 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-10T04:19:24.969 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-10T04:19:25.065 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-10T04:19:25.141 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 31/162 2024-05-10T04:19:25.239 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-10T04:19:25.313 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 32/162 2024-05-10T04:19:25.598 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 33/162 2024-05-10T04:19:25.671 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-10T04:19:25.834 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-10T04:19:25.939 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-10T04:19:26.080 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/162 2024-05-10T04:19:26.207 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/162 2024-05-10T04:19:26.400 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/162 2024-05-10T04:19:26.502 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/162 2024-05-10T04:19:26.714 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-05-10T04:19:26.998 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-05-10T04:19:27.264 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-05-10T04:19:27.416 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-10T04:19:27.617 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-10T04:19:27.794 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-10T04:19:27.888 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-10T04:19:28.265 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-05-10T04:19:28.462 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-10T04:19:28.632 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-10T04:19:29.303 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-10T04:19:29.338 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-05-10T04:19:29.499 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-05-10T04:19:29.701 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-05-10T04:19:29.955 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-05-10T04:19:30.177 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-10T04:19:30.311 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-05-10T04:19:30.375 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-10T04:19:30.590 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 41/162 2024-05-10T04:19:30.606 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-05-10T04:19:30.787 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 42/162 2024-05-10T04:19:30.816 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-05-10T04:19:30.974 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-10T04:19:31.074 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-10T04:19:31.093 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-10T04:19:31.264 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 31/162 2024-05-10T04:19:31.283 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-10T04:19:31.375 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-10T04:19:31.428 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 32/162 2024-05-10T04:19:31.592 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-10T04:19:31.735 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 33/162 2024-05-10T04:19:31.793 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-10T04:19:31.972 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-10T04:19:31.999 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-10T04:19:32.600 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-10T04:19:32.875 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-10T04:19:32.919 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-10T04:19:33.166 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-10T04:19:33.272 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-10T04:19:33.542 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-05-10T04:19:33.768 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-05-10T04:19:33.966 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-05-10T04:19:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-10T04:19:34.057 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-05-10T04:19:34.236 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-05-10T04:19:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-05-10T04:19:34.408 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-05-10T04:19:34.607 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-05-10T04:19:34.771 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/162 2024-05-10T04:19:34.979 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/162 2024-05-10T04:19:35.158 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/162 2024-05-10T04:19:35.326 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/162 2024-05-10T04:19:35.444 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-05-10T04:19:35.530 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/162 2024-05-10T04:19:35.841 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-05-10T04:19:35.860 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/162 2024-05-10T04:19:36.113 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-05-10T04:19:36.183 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/162 2024-05-10T04:19:36.342 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-10T04:19:36.421 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/162 2024-05-10T04:19:36.576 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/162 2024-05-10T04:19:36.579 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-10T04:19:36.808 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/162 2024-05-10T04:19:36.817 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 41/162 2024-05-10T04:19:37.019 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 42/162 2024-05-10T04:19:37.198 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-10T04:19:37.209 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/162 2024-05-10T04:19:37.306 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-10T04:19:37.522 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-10T04:19:37.624 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-10T04:19:37.647 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 67/162 2024-05-10T04:19:37.849 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-10T04:19:37.963 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/162 2024-05-10T04:19:38.052 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-10T04:19:38.217 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 69/162 2024-05-10T04:19:38.281 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-10T04:19:38.429 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/162 2024-05-10T04:19:38.688 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 71/162 2024-05-10T04:19:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-10T04:19:38.908 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 72/162 2024-05-10T04:19:39.151 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/162 2024-05-10T04:19:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-10T04:19:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-10T04:19:39.389 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/162 2024-05-10T04:19:39.472 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-10T04:19:39.572 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-10T04:19:39.615 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/162 2024-05-10T04:19:39.891 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-05-10T04:19:39.909 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/162 2024-05-10T04:19:40.099 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-05-10T04:19:40.109 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-05-10T04:19:40.267 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-10T04:19:40.355 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-05-10T04:19:40.455 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-10T04:19:40.458 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-05-10T04:19:40.654 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-05-10T04:19:40.744 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-10T04:19:40.839 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-05-10T04:19:40.948 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-10T04:19:41.055 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-05-10T04:19:41.129 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-10T04:19:41.209 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-packaging-16.8-9.el8.noarch 56/162 2024-05-10T04:19:41.312 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-10T04:19:41.462 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : fuse-2.9.7-17.el8.x86_64 57/162 2024-05-10T04:19:41.547 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-10T04:19:41.667 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 58/162 2024-05-10T04:19:41.774 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-10T04:19:41.838 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 59/162 2024-05-10T04:19:41.981 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-10T04:19:42.046 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 60/162 2024-05-10T04:19:42.140 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-10T04:19:42.260 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 61/162 2024-05-10T04:19:42.330 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-10T04:19:42.563 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-10T04:19:42.626 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 62/162 2024-05-10T04:19:42.787 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-10T04:19:42.963 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 63/162 2024-05-10T04:19:42.988 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-10T04:19:43.252 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 64/162 2024-05-10T04:19:43.263 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-10T04:19:43.415 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 65/162 2024-05-10T04:19:43.499 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-10T04:19:43.682 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 66/162 2024-05-10T04:19:43.700 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-10T04:19:43.932 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-10T04:19:44.107 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 67/162 2024-05-10T04:19:44.479 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 68/162 2024-05-10T04:19:44.788 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 69/162 2024-05-10T04:19:45.030 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 70/162 2024-05-10T04:19:45.159 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-10T04:19:45.277 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 71/162 2024-05-10T04:19:45.508 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-10T04:19:45.542 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 72/162 2024-05-10T04:19:45.752 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-10T04:19:45.813 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 73/162 2024-05-10T04:19:46.031 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 74/162 2024-05-10T04:19:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-10T04:19:46.325 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 75/162 2024-05-10T04:19:46.376 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-10T04:19:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 76/162 2024-05-10T04:19:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-10T04:19:46.859 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 77/162 2024-05-10T04:19:47.056 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-10T04:19:47.265 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-10T04:19:47.540 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-10T04:19:47.555 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-10T04:19:47.706 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 103/162 2024-05-10T04:19:47.761 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-10T04:19:47.975 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-10T04:19:48.150 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-10T04:19:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-10T04:19:48.516 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 103/162 2024-05-10T04:19:48.685 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-10T04:19:48.719 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 104/162 2024-05-10T04:19:48.902 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-10T04:19:49.110 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-10T04:19:49.260 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-10T04:19:49.493 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-10T04:19:49.717 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-10T04:19:49.935 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-10T04:19:50.206 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-10T04:19:50.930 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-10T04:19:51.114 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-10T04:19:51.368 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-10T04:19:52.614 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-10T04:19:52.938 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-10T04:19:53.207 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-10T04:19:53.599 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-10T04:19:53.912 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-10T04:19:53.933 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/162 2024-05-10T04:19:54.154 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-10T04:19:54.264 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/162 2024-05-10T04:19:54.993 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/162 2024-05-10T04:19:55.143 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-10T04:19:55.274 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/162 2024-05-10T04:19:55.310 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 103/162 2024-05-10T04:19:55.388 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 103/162 2024-05-10T04:19:55.418 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/162 2024-05-10T04:19:55.588 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/162 2024-05-10T04:19:55.630 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 104/162 2024-05-10T04:20:00.996 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/162 2024-05-10T04:20:02.035 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/162 2024-05-10T04:20:02.761 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/162 2024-05-10T04:20:03.067 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/162 2024-05-10T04:20:03.234 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/162 2024-05-10T04:20:03.433 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/162 2024-05-10T04:20:16.756 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/162 2024-05-10T04:20:16.756 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /sys 2024-05-10T04:20:16.756 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /proc 2024-05-10T04:20:16.756 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /dev 2024-05-10T04:20:16.756 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /run 2024-05-10T04:20:16.756 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /mnt 2024-05-10T04:20:16.757 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /var/tmp 2024-05-10T04:20:16.757 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /home 2024-05-10T04:20:16.757 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /tmp 2024-05-10T04:20:16.757 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /dev 2024-05-10T04:20:16.757 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:20:17.158 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/162 2024-05-10T04:20:19.045 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/162 2024-05-10T04:20:19.280 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/162 2024-05-10T04:20:19.570 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/162 2024-05-10T04:20:19.944 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/162 2024-05-10T04:20:20.572 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/162 2024-05-10T04:20:20.736 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/162 2024-05-10T04:20:20.787 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/162 2024-05-10T04:20:23.751 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephadm-2:18.2.2-1330.g50174015.el8.noarch 112/162 2024-05-10T04:20:23.899 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephadm-2:18.2.2-1330.g50174015.el8.noarch 112/162 2024-05-10T04:20:24.060 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 113/162 2024-05-10T04:20:24.282 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 114/162 2024-05-10T04:20:24.484 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 115/162 2024-05-10T04:20:24.767 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/162 2024-05-10T04:20:24.767 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /sys 2024-05-10T04:20:24.767 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /proc 2024-05-10T04:20:24.767 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /dev 2024-05-10T04:20:24.767 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /run 2024-05-10T04:20:24.768 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /mnt 2024-05-10T04:20:24.768 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /var/tmp 2024-05-10T04:20:24.768 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /home 2024-05-10T04:20:24.768 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /tmp 2024-05-10T04:20:24.768 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /dev 2024-05-10T04:20:24.768 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:20:25.214 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/162 2024-05-10T04:20:25.724 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 115/162 2024-05-10T04:20:25.995 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 116/162 2024-05-10T04:20:27.078 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/162 2024-05-10T04:20:27.136 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 116/162 2024-05-10T04:20:27.303 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/162 2024-05-10T04:20:27.325 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 117/162 2024-05-10T04:20:27.460 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 117/162 2024-05-10T04:20:27.586 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/162 2024-05-10T04:20:27.728 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/162 2024-05-10T04:20:27.858 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 118/162 2024-05-10T04:20:28.020 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 119/162 2024-05-10T04:20:28.096 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 119/162 2024-05-10T04:20:28.250 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 120/162 2024-05-10T04:20:28.280 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 120/162 2024-05-10T04:20:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/162 2024-05-10T04:20:28.504 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/162 2024-05-10T04:20:28.546 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/162 2024-05-10T04:20:29.945 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-2:18.2.2-1330.g50174015.el8.x86_64 121/162 2024-05-10T04:20:30.120 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 122/162 2024-05-10T04:20:30.183 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 122/162 2024-05-10T04:20:30.351 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1330.g50174 123/162 2024-05-10T04:20:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1330.g50174 123/162 2024-05-10T04:20:30.564 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 124/162 2024-05-10T04:20:30.990 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 124/162 2024-05-10T04:20:31.167 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 125/162 2024-05-10T04:20:31.503 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephadm-2:18.2.2-1330.g50174015.el8.noarch 112/162 2024-05-10T04:20:31.664 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephadm-2:18.2.2-1330.g50174015.el8.noarch 112/162 2024-05-10T04:20:31.836 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 113/162 2024-05-10T04:20:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 114/162 2024-05-10T04:20:32.310 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 115/162 2024-05-10T04:20:33.513 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 115/162 2024-05-10T04:20:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 116/162 2024-05-10T04:20:34.852 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 116/162 2024-05-10T04:20:35.034 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 117/162 2024-05-10T04:20:35.167 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 117/162 2024-05-10T04:20:35.571 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 118/162 2024-05-10T04:20:35.743 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 119/162 2024-05-10T04:20:35.813 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 119/162 2024-05-10T04:20:36.026 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 120/162 2024-05-10T04:20:36.056 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 120/162 2024-05-10T04:20:36.621 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 125/162 2024-05-10T04:20:37.661 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-2:18.2.2-1330.g50174015.el8.x86_64 121/162 2024-05-10T04:20:37.851 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 122/162 2024-05-10T04:20:37.914 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 122/162 2024-05-10T04:20:37.927 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 126/162 2024-05-10T04:20:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1330.g50174 123/162 2024-05-10T04:20:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1330.g50174 123/162 2024-05-10T04:20:38.185 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-05-10T04:20:38.303 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 124/162 2024-05-10T04:20:38.468 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-05-10T04:20:38.717 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 124/162 2024-05-10T04:20:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 125/162 2024-05-10T04:20:38.879 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 129/162 2024-05-10T04:20:39.202 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-05-10T04:20:39.357 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-05-10T04:20:39.388 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-05-10T04:20:39.596 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-10T04:20:39.804 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-10T04:20:40.043 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 134/162 2024-05-10T04:20:43.506 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-10T04:20:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-10T04:20:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-10T04:20:44.202 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 125/162 2024-05-10T04:20:44.330 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-10T04:20:45.104 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-10T04:20:45.329 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-10T04:20:45.508 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 139/162 2024-05-10T04:20:45.521 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 126/162 2024-05-10T04:20:45.775 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 140/162 2024-05-10T04:20:45.823 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-05-10T04:20:46.081 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-05-10T04:20:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 141/162 2024-05-10T04:20:46.440 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-10T04:20:46.493 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 129/162 2024-05-10T04:20:46.678 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-05-10T04:20:46.790 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-05-10T04:20:46.817 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-05-10T04:20:46.986 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-05-10T04:20:47.015 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-05-10T04:20:47.023 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-05-10T04:20:47.053 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-05-10T04:20:47.215 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-10T04:20:47.238 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-10T04:20:47.245 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-10T04:20:47.375 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-05-10T04:20:47.479 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-10T04:20:47.546 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-10T04:20:47.748 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 134/162 2024-05-10T04:20:47.749 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-10T04:20:47.902 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-10T04:20:47.902 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-10T04:20:48.169 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-10T04:20:48.169 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-10T04:20:48.379 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-10T04:20:48.379 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-10T04:20:48.680 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-10T04:20:48.891 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-10T04:20:49.052 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-10T04:20:49.291 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-10T04:20:49.291 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-10T04:20:49.560 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-10T04:20:49.560 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-10T04:20:49.793 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-10T04:20:49.793 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-10T04:20:50.026 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-10T04:20:50.026 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-10T04:20:51.133 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-10T04:20:51.335 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-10T04:20:51.335 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-10T04:20:51.434 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-10T04:20:51.517 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-10T04:20:51.567 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-10T04:20:51.717 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-10T04:20:51.718 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-10T04:20:51.988 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-10T04:20:52.297 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-10T04:20:52.297 INFO:teuthology.orchestra.run.smithi106.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-10T04:20:52.297 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:20:52.438 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-10T04:20:52.984 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-2:18.2.2-1330.g50174015.el8.x86_64 1/162 2024-05-10T04:20:52.984 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2/162 2024-05-10T04:20:52.984 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 3/162 2024-05-10T04:20:52.985 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 4/162 2024-05-10T04:20:52.985 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1330.g50174 5/162 2024-05-10T04:20:52.985 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 6/162 2024-05-10T04:20:52.985 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 7/162 2024-05-10T04:20:52.985 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 8/162 2024-05-10T04:20:52.985 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 9/162 2024-05-10T04:20:52.985 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 10/162 2024-05-10T04:20:52.985 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 11/162 2024-05-10T04:20:52.985 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 12/162 2024-05-10T04:20:52.985 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 13/162 2024-05-10T04:20:52.985 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 14/162 2024-05-10T04:20:52.985 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 15/162 2024-05-10T04:20:52.986 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 16/162 2024-05-10T04:20:52.986 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 17/162 2024-05-10T04:20:52.986 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 18/162 2024-05-10T04:20:52.986 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 19/162 2024-05-10T04:20:52.986 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 20/162 2024-05-10T04:20:52.986 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 21/162 2024-05-10T04:20:52.986 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 22/162 2024-05-10T04:20:52.986 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 23/162 2024-05-10T04:20:52.986 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 24/162 2024-05-10T04:20:52.986 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 25/162 2024-05-10T04:20:52.986 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 26/162 2024-05-10T04:20:52.986 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 27/162 2024-05-10T04:20:52.999 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 28/162 2024-05-10T04:20:52.999 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 29/162 2024-05-10T04:20:52.999 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 30/162 2024-05-10T04:20:52.999 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 31/162 2024-05-10T04:20:52.999 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 32/162 2024-05-10T04:20:52.999 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 33/162 2024-05-10T04:20:52.999 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 34/162 2024-05-10T04:20:52.999 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 35/162 2024-05-10T04:20:52.999 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 36/162 2024-05-10T04:20:53.000 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephadm-2:18.2.2-1330.g50174015.el8.noarch 37/162 2024-05-10T04:20:53.000 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 38/162 2024-05-10T04:20:53.000 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-10T04:20:53.000 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-10T04:20:53.000 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-10T04:20:53.000 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-10T04:20:53.000 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-10T04:20:53.000 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-10T04:20:53.000 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-10T04:20:53.000 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-10T04:20:53.000 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-10T04:20:53.000 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-10T04:20:53.000 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-10T04:20:53.000 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-10T04:20:53.001 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-10T04:20:53.001 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-10T04:20:53.001 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-10T04:20:53.001 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-10T04:20:53.001 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-10T04:20:53.001 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-10T04:20:53.001 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-10T04:20:53.001 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-10T04:20:53.001 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-10T04:20:53.001 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-10T04:20:53.001 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-10T04:20:53.001 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-10T04:20:53.001 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-10T04:20:53.001 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-10T04:20:53.002 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-10T04:20:53.002 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-10T04:20:53.002 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-10T04:20:53.002 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-10T04:20:53.002 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-10T04:20:53.002 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-10T04:20:53.002 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-10T04:20:53.002 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-05-10T04:20:53.002 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 73/162 2024-05-10T04:20:53.002 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/162 2024-05-10T04:20:53.002 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/162 2024-05-10T04:20:53.002 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/162 2024-05-10T04:20:53.002 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/162 2024-05-10T04:20:53.003 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/162 2024-05-10T04:20:53.003 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/162 2024-05-10T04:20:53.003 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 80/162 2024-05-10T04:20:53.003 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 81/162 2024-05-10T04:20:53.003 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 82/162 2024-05-10T04:20:53.003 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/162 2024-05-10T04:20:53.003 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/162 2024-05-10T04:20:53.003 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/162 2024-05-10T04:20:53.003 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 86/162 2024-05-10T04:20:53.003 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 87/162 2024-05-10T04:20:53.003 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 88/162 2024-05-10T04:20:53.003 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 89/162 2024-05-10T04:20:53.003 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 90/162 2024-05-10T04:20:53.003 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 91/162 2024-05-10T04:20:53.004 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 92/162 2024-05-10T04:20:53.004 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 93/162 2024-05-10T04:20:53.004 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 94/162 2024-05-10T04:20:53.004 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 95/162 2024-05-10T04:20:53.004 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 96/162 2024-05-10T04:20:53.004 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 97/162 2024-05-10T04:20:53.004 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 98/162 2024-05-10T04:20:53.004 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 99/162 2024-05-10T04:20:53.004 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-05-10T04:20:53.004 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-05-10T04:20:53.004 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-05-10T04:20:53.004 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-05-10T04:20:53.004 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-05-10T04:20:53.005 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-05-10T04:20:53.005 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-05-10T04:20:53.005 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-05-10T04:20:53.005 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-05-10T04:20:53.005 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-05-10T04:20:53.005 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-05-10T04:20:53.005 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-05-10T04:20:53.005 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-05-10T04:20:53.006 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-05-10T04:20:53.006 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-05-10T04:20:53.006 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-05-10T04:20:53.006 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-05-10T04:20:53.006 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-05-10T04:20:53.006 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-05-10T04:20:53.006 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-05-10T04:20:53.006 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-05-10T04:20:53.006 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-05-10T04:20:53.006 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-05-10T04:20:53.006 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-05-10T04:20:53.007 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-05-10T04:20:53.007 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-05-10T04:20:53.007 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-05-10T04:20:53.007 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-05-10T04:20:53.007 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-05-10T04:20:53.007 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-05-10T04:20:53.007 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-05-10T04:20:53.007 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-2:18.2.2-1330.g50174015.el8.x86_64 131/162 2024-05-10T04:20:53.007 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-10T04:20:53.007 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 133/162 2024-05-10T04:20:53.007 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-10T04:20:53.007 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-10T04:20:53.008 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-10T04:20:53.008 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-10T04:20:53.008 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-10T04:20:53.008 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-10T04:20:53.008 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-10T04:20:53.008 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-10T04:20:53.008 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-10T04:20:53.008 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-10T04:20:53.008 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-10T04:20:53.008 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-10T04:20:53.008 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-10T04:20:53.008 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-10T04:20:53.008 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-10T04:20:53.009 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-10T04:20:53.009 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-10T04:20:53.009 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-10T04:20:53.009 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-10T04:20:53.009 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-10T04:20:53.009 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-10T04:20:53.009 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-10T04:20:53.009 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-10T04:20:53.009 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-10T04:20:53.009 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-10T04:20:53.009 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-10T04:20:53.009 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-10T04:20:53.009 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-10T04:20:53.010 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-10T04:20:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 139/162 2024-05-10T04:20:53.449 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 140/162 2024-05-10T04:20:53.809 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 141/162 2024-05-10T04:20:54.139 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-10T04:20:54.402 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-05-10T04:20:54.515 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-05-10T04:20:54.749 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-05-10T04:20:54.779 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-05-10T04:20:54.972 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-10T04:20:54.996 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-10T04:20:55.124 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-05-10T04:20:55.310 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-10T04:20:55.552 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-10T04:20:55.712 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-10T04:20:55.712 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-10T04:20:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-10T04:20:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-10T04:20:56.278 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-10T04:20:56.279 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-10T04:20:56.537 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-10T04:20:56.767 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-10T04:20:56.926 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-10T04:20:57.209 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-10T04:20:57.209 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-10T04:20:57.466 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-10T04:20:57.467 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-10T04:20:57.700 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-10T04:20:57.700 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-10T04:20:58.000 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-10T04:20:58.000 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-10T04:20:59.266 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-10T04:20:59.267 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-10T04:20:59.516 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-10T04:20:59.649 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-10T04:20:59.649 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-10T04:21:00.247 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-10T04:21:00.247 INFO:teuthology.orchestra.run.smithi080.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-10T04:21:00.247 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:00.929 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-2:18.2.2-1330.g50174015.el8.x86_64 1/162 2024-05-10T04:21:00.929 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2/162 2024-05-10T04:21:00.929 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 3/162 2024-05-10T04:21:00.929 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 4/162 2024-05-10T04:21:00.929 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1330.g50174 5/162 2024-05-10T04:21:00.929 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 6/162 2024-05-10T04:21:00.929 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 7/162 2024-05-10T04:21:00.929 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 8/162 2024-05-10T04:21:00.929 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 9/162 2024-05-10T04:21:00.929 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 10/162 2024-05-10T04:21:00.929 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 11/162 2024-05-10T04:21:00.930 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 12/162 2024-05-10T04:21:00.930 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 13/162 2024-05-10T04:21:00.930 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 14/162 2024-05-10T04:21:00.930 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 15/162 2024-05-10T04:21:00.930 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 16/162 2024-05-10T04:21:00.930 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 17/162 2024-05-10T04:21:00.930 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 18/162 2024-05-10T04:21:00.930 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 19/162 2024-05-10T04:21:00.930 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 20/162 2024-05-10T04:21:00.930 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 21/162 2024-05-10T04:21:00.930 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 22/162 2024-05-10T04:21:00.931 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 23/162 2024-05-10T04:21:00.931 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 24/162 2024-05-10T04:21:00.931 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 25/162 2024-05-10T04:21:00.943 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 26/162 2024-05-10T04:21:00.943 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 27/162 2024-05-10T04:21:00.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 28/162 2024-05-10T04:21:00.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 29/162 2024-05-10T04:21:00.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 30/162 2024-05-10T04:21:00.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 31/162 2024-05-10T04:21:00.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 32/162 2024-05-10T04:21:00.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 33/162 2024-05-10T04:21:00.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 34/162 2024-05-10T04:21:00.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 35/162 2024-05-10T04:21:00.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 36/162 2024-05-10T04:21:00.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephadm-2:18.2.2-1330.g50174015.el8.noarch 37/162 2024-05-10T04:21:00.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 38/162 2024-05-10T04:21:00.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-10T04:21:00.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-10T04:21:00.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-10T04:21:00.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-10T04:21:00.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-10T04:21:00.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-10T04:21:00.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-10T04:21:00.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-10T04:21:00.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-10T04:21:00.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-10T04:21:00.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-10T04:21:00.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-10T04:21:00.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-10T04:21:00.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-10T04:21:00.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-10T04:21:00.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-10T04:21:00.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-10T04:21:00.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-10T04:21:00.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-10T04:21:00.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-10T04:21:00.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-10T04:21:00.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-10T04:21:00.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-10T04:21:00.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-10T04:21:00.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-10T04:21:00.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-10T04:21:00.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-10T04:21:00.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-10T04:21:00.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-10T04:21:00.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-10T04:21:00.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-10T04:21:00.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-10T04:21:00.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-10T04:21:00.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/162 2024-05-10T04:21:00.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/162 2024-05-10T04:21:00.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/162 2024-05-10T04:21:00.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 75/162 2024-05-10T04:21:00.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/162 2024-05-10T04:21:00.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 77/162 2024-05-10T04:21:00.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/162 2024-05-10T04:21:00.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/162 2024-05-10T04:21:00.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/162 2024-05-10T04:21:00.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/162 2024-05-10T04:21:00.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 82/162 2024-05-10T04:21:00.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/162 2024-05-10T04:21:00.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 84/162 2024-05-10T04:21:00.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/162 2024-05-10T04:21:00.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 86/162 2024-05-10T04:21:00.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 87/162 2024-05-10T04:21:00.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 88/162 2024-05-10T04:21:00.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 89/162 2024-05-10T04:21:00.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 90/162 2024-05-10T04:21:00.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 91/162 2024-05-10T04:21:00.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 92/162 2024-05-10T04:21:00.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 93/162 2024-05-10T04:21:00.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 94/162 2024-05-10T04:21:00.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 95/162 2024-05-10T04:21:00.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 96/162 2024-05-10T04:21:00.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 97/162 2024-05-10T04:21:00.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 98/162 2024-05-10T04:21:00.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 99/162 2024-05-10T04:21:00.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-05-10T04:21:00.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-05-10T04:21:00.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-05-10T04:21:00.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-05-10T04:21:00.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-05-10T04:21:00.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-05-10T04:21:00.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-05-10T04:21:00.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-05-10T04:21:00.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-05-10T04:21:00.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-05-10T04:21:00.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-05-10T04:21:00.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-05-10T04:21:00.950 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-05-10T04:21:00.950 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-05-10T04:21:00.950 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-05-10T04:21:00.950 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-05-10T04:21:00.950 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-05-10T04:21:00.950 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-05-10T04:21:00.950 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-05-10T04:21:00.950 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-05-10T04:21:00.950 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-05-10T04:21:00.950 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-05-10T04:21:00.950 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-05-10T04:21:00.950 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-05-10T04:21:00.950 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-05-10T04:21:00.950 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-05-10T04:21:00.951 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-05-10T04:21:00.951 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-05-10T04:21:00.951 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-05-10T04:21:00.951 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-05-10T04:21:00.951 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-05-10T04:21:00.951 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:18.2.2-1330.g50174015.el8.x86_64 131/162 2024-05-10T04:21:00.951 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-10T04:21:00.951 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 133/162 2024-05-10T04:21:00.951 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-10T04:21:00.951 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-10T04:21:00.951 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-10T04:21:00.951 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-10T04:21:00.951 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-10T04:21:00.951 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-10T04:21:00.952 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-10T04:21:00.952 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-10T04:21:00.952 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-10T04:21:00.952 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-10T04:21:00.952 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-10T04:21:00.952 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-10T04:21:00.952 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-10T04:21:00.952 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-10T04:21:00.952 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-10T04:21:00.952 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-10T04:21:00.952 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-10T04:21:00.952 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-10T04:21:00.952 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-10T04:21:00.952 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-10T04:21:00.953 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-10T04:21:00.953 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-10T04:21:00.953 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-10T04:21:00.953 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-10T04:21:00.953 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-10T04:21:00.953 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-10T04:21:00.953 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-10T04:21:00.953 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-10T04:21:10.178 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-10T04:21:10.178 INFO:teuthology.orchestra.run.smithi106.stdout:Installed products updated. 2024-05-10T04:21:10.860 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:10.860 INFO:teuthology.orchestra.run.smithi106.stdout:Upgraded: 2024-05-10T04:21:10.860 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-10T04:21:10.860 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-10T04:21:10.860 INFO:teuthology.orchestra.run.smithi106.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-10T04:21:10.860 INFO:teuthology.orchestra.run.smithi106.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-10T04:21:10.860 INFO:teuthology.orchestra.run.smithi106.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-10T04:21:10.860 INFO:teuthology.orchestra.run.smithi106.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-10T04:21:10.860 INFO:teuthology.orchestra.run.smithi106.stdout: librados2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.860 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.861 INFO:teuthology.orchestra.run.smithi106.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-10T04:21:10.861 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-10T04:21:10.861 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-10T04:21:10.861 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-10T04:21:10.861 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-10T04:21:10.861 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-10T04:21:10.861 INFO:teuthology.orchestra.run.smithi106.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-10T04:21:10.861 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-10T04:21:10.861 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-10T04:21:10.861 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-10T04:21:10.861 INFO:teuthology.orchestra.run.smithi106.stdout: automake-1.16.1-8.el8.noarch 2024-05-10T04:21:10.861 INFO:teuthology.orchestra.run.smithi106.stdout: bison-3.0.4-10.el8.x86_64 2024-05-10T04:21:10.861 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.862 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.862 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.862 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.862 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:10.862 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.862 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.862 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.862 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:10.862 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:10.862 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:10.862 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:10.862 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:10.862 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.863 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.863 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:10.863 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.863 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.863 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.863 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:10.863 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:10.863 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.863 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:10.863 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-10T04:21:10.863 INFO:teuthology.orchestra.run.smithi106.stdout: flex-2.6.1-9.el8.x86_64 2024-05-10T04:21:10.863 INFO:teuthology.orchestra.run.smithi106.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-10T04:21:10.863 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-10T04:21:10.864 INFO:teuthology.orchestra.run.smithi106.stdout: jq-1.6-7.el8.x86_64 2024-05-10T04:21:10.864 INFO:teuthology.orchestra.run.smithi106.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-10T04:21:10.864 INFO:teuthology.orchestra.run.smithi106.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-10T04:21:10.864 INFO:teuthology.orchestra.run.smithi106.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-10T04:21:10.864 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.864 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.864 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.864 INFO:teuthology.orchestra.run.smithi106.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-10T04:21:10.864 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-10T04:21:10.864 INFO:teuthology.orchestra.run.smithi106.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-10T04:21:10.864 INFO:teuthology.orchestra.run.smithi106.stdout: libpq-13.11-1.el8.x86_64 2024-05-10T04:21:10.864 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-10T04:21:10.864 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-10T04:21:10.864 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.865 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.865 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-10T04:21:10.865 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.865 INFO:teuthology.orchestra.run.smithi106.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-10T04:21:10.865 INFO:teuthology.orchestra.run.smithi106.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-10T04:21:10.865 INFO:teuthology.orchestra.run.smithi106.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-10T04:21:10.865 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-10T04:21:10.865 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-10T04:21:10.865 INFO:teuthology.orchestra.run.smithi106.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-10T04:21:10.865 INFO:teuthology.orchestra.run.smithi106.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-10T04:21:10.865 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-10T04:21:10.865 INFO:teuthology.orchestra.run.smithi106.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-10T04:21:10.865 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-10T04:21:10.866 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-10T04:21:10.866 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-10T04:21:10.866 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-10T04:21:10.866 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-10T04:21:10.866 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-10T04:21:10.866 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-10T04:21:10.866 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-10T04:21:10.866 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-10T04:21:10.866 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-10T04:21:10.866 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-10T04:21:10.866 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-10T04:21:10.866 INFO:teuthology.orchestra.run.smithi106.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-10T04:21:10.867 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-10T04:21:10.867 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.867 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.867 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.867 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-10T04:21:10.867 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-10T04:21:10.867 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-10T04:21:10.867 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-10T04:21:10.867 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-10T04:21:10.867 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-10T04:21:10.867 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-10T04:21:10.867 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-10T04:21:10.867 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-10T04:21:10.867 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-10T04:21:10.868 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-10T04:21:10.868 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-10T04:21:10.868 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-10T04:21:10.868 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-10T04:21:10.868 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-10T04:21:10.868 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-10T04:21:10.868 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-10T04:21:10.868 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-10T04:21:10.868 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-10T04:21:10.868 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-10T04:21:10.868 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-10T04:21:10.868 INFO:teuthology.orchestra.run.smithi106.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-10T04:21:10.869 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-10T04:21:10.869 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend-2.6-1.el8.noarch 2024-05-10T04:21:10.869 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-10T04:21:10.869 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-10T04:21:10.869 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-10T04:21:10.869 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-10T04:21:10.869 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-10T04:21:10.869 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-10T04:21:10.869 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.869 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.869 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-10T04:21:10.869 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-10T04:21:10.869 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.870 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-10T04:21:10.870 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-10T04:21:10.870 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-10T04:21:10.870 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-10T04:21:10.870 INFO:teuthology.orchestra.run.smithi106.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-10T04:21:10.870 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-10T04:21:10.870 INFO:teuthology.orchestra.run.smithi106.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-10T04:21:10.870 INFO:teuthology.orchestra.run.smithi106.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-10T04:21:10.870 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-10T04:21:10.870 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-10T04:21:10.870 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-10T04:21:10.870 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-10T04:21:10.870 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-10T04:21:10.871 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.871 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.871 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:10.871 INFO:teuthology.orchestra.run.smithi106.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-10T04:21:10.871 INFO:teuthology.orchestra.run.smithi106.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-10T04:21:10.871 INFO:teuthology.orchestra.run.smithi106.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-10T04:21:10.871 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-10T04:21:10.871 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-10T04:21:10.871 INFO:teuthology.orchestra.run.smithi106.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-10T04:21:10.872 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:10.872 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-10T04:21:11.234 DEBUG:teuthology.parallel:result is None 2024-05-10T04:21:18.859 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-10T04:21:18.859 INFO:teuthology.orchestra.run.smithi080.stdout:Installed products updated. 2024-05-10T04:21:19.499 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:19.499 INFO:teuthology.orchestra.run.smithi080.stdout:Upgraded: 2024-05-10T04:21:19.499 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-10T04:21:19.499 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-10T04:21:19.499 INFO:teuthology.orchestra.run.smithi080.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-10T04:21:19.499 INFO:teuthology.orchestra.run.smithi080.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-10T04:21:19.499 INFO:teuthology.orchestra.run.smithi080.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-10T04:21:19.500 INFO:teuthology.orchestra.run.smithi080.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-10T04:21:19.500 INFO:teuthology.orchestra.run.smithi080.stdout: librados2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.500 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.500 INFO:teuthology.orchestra.run.smithi080.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-10T04:21:19.500 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-10T04:21:19.500 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-10T04:21:19.500 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-10T04:21:19.500 INFO:teuthology.orchestra.run.smithi080.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-10T04:21:19.500 INFO:teuthology.orchestra.run.smithi080.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-10T04:21:19.500 INFO:teuthology.orchestra.run.smithi080.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-10T04:21:19.500 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-10T04:21:19.501 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-10T04:21:19.501 INFO:teuthology.orchestra.run.smithi080.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-10T04:21:19.501 INFO:teuthology.orchestra.run.smithi080.stdout: automake-1.16.1-8.el8.noarch 2024-05-10T04:21:19.501 INFO:teuthology.orchestra.run.smithi080.stdout: bison-3.0.4-10.el8.x86_64 2024-05-10T04:21:19.501 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.501 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.501 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.501 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.501 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:19.501 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.501 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.501 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.501 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:19.502 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:19.502 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:19.502 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:19.502 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:19.502 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.502 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.502 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:19.502 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.502 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.503 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.503 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:19.503 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:19.503 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.503 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:21:19.503 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-10T04:21:19.503 INFO:teuthology.orchestra.run.smithi080.stdout: flex-2.6.1-9.el8.x86_64 2024-05-10T04:21:19.503 INFO:teuthology.orchestra.run.smithi080.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-10T04:21:19.503 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-10T04:21:19.503 INFO:teuthology.orchestra.run.smithi080.stdout: jq-1.6-7.el8.x86_64 2024-05-10T04:21:19.503 INFO:teuthology.orchestra.run.smithi080.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-10T04:21:19.503 INFO:teuthology.orchestra.run.smithi080.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-10T04:21:19.504 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-10T04:21:19.504 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.504 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.504 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.504 INFO:teuthology.orchestra.run.smithi080.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-10T04:21:19.504 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-10T04:21:19.504 INFO:teuthology.orchestra.run.smithi080.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-10T04:21:19.504 INFO:teuthology.orchestra.run.smithi080.stdout: libpq-13.11-1.el8.x86_64 2024-05-10T04:21:19.504 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-10T04:21:19.504 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-10T04:21:19.504 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.504 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.504 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-10T04:21:19.505 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.505 INFO:teuthology.orchestra.run.smithi080.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-10T04:21:19.505 INFO:teuthology.orchestra.run.smithi080.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-10T04:21:19.505 INFO:teuthology.orchestra.run.smithi080.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-10T04:21:19.505 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-10T04:21:19.505 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-10T04:21:19.505 INFO:teuthology.orchestra.run.smithi080.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-10T04:21:19.505 INFO:teuthology.orchestra.run.smithi080.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-10T04:21:19.505 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-10T04:21:19.505 INFO:teuthology.orchestra.run.smithi080.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-10T04:21:19.505 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-10T04:21:19.505 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-10T04:21:19.505 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-10T04:21:19.506 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-10T04:21:19.506 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-10T04:21:19.506 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-10T04:21:19.506 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-10T04:21:19.506 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-10T04:21:19.506 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-10T04:21:19.506 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-10T04:21:19.506 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-10T04:21:19.506 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-10T04:21:19.506 INFO:teuthology.orchestra.run.smithi080.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-10T04:21:19.506 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-10T04:21:19.507 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.507 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.507 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.507 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-10T04:21:19.507 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-10T04:21:19.507 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-10T04:21:19.507 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-10T04:21:19.507 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-10T04:21:19.507 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-10T04:21:19.507 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-10T04:21:19.507 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-10T04:21:19.507 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-10T04:21:19.507 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-10T04:21:19.507 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-10T04:21:19.508 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-10T04:21:19.508 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-10T04:21:19.508 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-10T04:21:19.508 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-10T04:21:19.508 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-10T04:21:19.508 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-10T04:21:19.508 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-10T04:21:19.508 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-10T04:21:19.508 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-10T04:21:19.508 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-10T04:21:19.508 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-10T04:21:19.508 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-10T04:21:19.508 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend-2.6-1.el8.noarch 2024-05-10T04:21:19.509 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-10T04:21:19.509 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-10T04:21:19.509 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-10T04:21:19.509 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-10T04:21:19.509 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-10T04:21:19.509 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-10T04:21:19.509 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.509 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.509 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-10T04:21:19.509 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-10T04:21:19.510 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.510 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-10T04:21:19.510 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-10T04:21:19.510 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-10T04:21:19.510 INFO:teuthology.orchestra.run.smithi080.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-10T04:21:19.510 INFO:teuthology.orchestra.run.smithi080.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-10T04:21:19.510 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-10T04:21:19.510 INFO:teuthology.orchestra.run.smithi080.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-10T04:21:19.510 INFO:teuthology.orchestra.run.smithi080.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-10T04:21:19.510 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-10T04:21:19.510 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-10T04:21:19.510 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-10T04:21:19.511 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-10T04:21:19.511 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-10T04:21:19.511 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.511 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.511 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:21:19.511 INFO:teuthology.orchestra.run.smithi080.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-10T04:21:19.511 INFO:teuthology.orchestra.run.smithi080.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-10T04:21:19.511 INFO:teuthology.orchestra.run.smithi080.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-10T04:21:19.511 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-10T04:21:19.511 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-10T04:21:19.512 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-10T04:21:19.512 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:19.512 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-10T04:21:19.899 DEBUG:teuthology.parallel:result is None 2024-05-10T04:21:19.900 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:21:20.038 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T04:21:20.090 INFO:teuthology.orchestra.run.smithi080.stdout:18.2.2-1330.g50174015.el8 2024-05-10T04:21:20.091 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1330.g50174015.el8 2024-05-10T04:21:20.091 INFO:teuthology.task.install:The correct ceph version 18.2.2-1330.g50174015 is installed. 2024-05-10T04:21:20.093 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:21:20.232 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T04:21:20.293 INFO:teuthology.orchestra.run.smithi106.stdout:18.2.2-1330.g50174015.el8 2024-05-10T04:21:20.293 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1330.g50174015.el8 2024-05-10T04:21:20.293 INFO:teuthology.task.install:The correct ceph version 18.2.2-1330.g50174015 is installed. 2024-05-10T04:21:20.295 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-10T04:21:20.295 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:21:20.296 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T04:21:20.382 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:21:20.382 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T04:21:20.480 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-10T04:21:20.481 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:21:20.481 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T04:21:20.545 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T04:21:20.650 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:21:20.651 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T04:21:20.721 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T04:21:20.827 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-10T04:21:20.828 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:21:20.828 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T04:21:20.892 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T04:21:20.997 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:21:20.997 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T04:21:21.062 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T04:21:21.166 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-10T04:21:21.166 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:21:21.167 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T04:21:21.233 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T04:21:21.335 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:21:21.335 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T04:21:21.399 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T04:21:21.504 INFO:teuthology.run_tasks:Running task ceph... 2024-05-10T04:21:21.589 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-10T04:21:21.589 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 777 /var/log/ceph 2024-05-10T04:21:21.593 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /var/log/ceph 2024-05-10T04:21:21.657 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-10T04:21:21.657 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-10T04:21:21.661 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-10T04:21:21.725 INFO:tasks.ceph:Creating extra log directories... 2024-05-10T04:21:21.725 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-10T04:21:21.729 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-10T04:21:21.800 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-10T04:21:21.801 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-10T04:21:21.801 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-10T04:21:21.801 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:21:21.801 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-10T04:21:21.842 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-10T04:21:22.044 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-10T04:21:22.113 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:21:22.114 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-10T04:21:22.157 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-10T04:21:22.360 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-10T04:21:22.431 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-10T04:21:22.431 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-10T04:21:22.431 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700532', 'branch': 'wip-pdonnell-testing-20240509.171335-reef-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/acls}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7700532', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240509.171335-reef-debug'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '50174015a7e79f951b988949abe236791f52d4da'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '50174015a7e79f951b988949abe236791f52d4da'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240509.171335-reef-debug', 'sha1': '50174015a7e79f951b988949abe236791f52d4da'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 65, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4933, 'sha1': '50174015a7e79f951b988949abe236791f52d4da', 'sleep_before_teardown': 0, 'subset': '420/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240509.171335-reef-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '50174015a7e79f951b988949abe236791f52d4da', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi080.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCh2FomEvssRNqMzLCB3fmgTTzFffpg7e5Vf3OcGQ4j+Epq71LxJr1yeTgq3ElIZ74w0hZH+odJ4zPHylD4ttB8=', 'smithi106.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNgzKKP0QCQ0EFVoXY4vOvlRoJNXjX9cyALOQydkr+R3/L4WJbqWlClgl7faeLi9Kwvld1xoJwI3fonNTvFGFic='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50174015a7e79f951b988949abe236791f52d4da'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '50174015a7e79f951b988949abe236791f52d4da', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_acls']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-10_02:33:39', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-10T04:21:22.432 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-10T04:21:22.436 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-10T04:21:22.477 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/run/ceph 2024-05-10T04:21:22.519 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/run/ceph 2024-05-10T04:21:22.584 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:21:22.584 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T04:21:22.625 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T04:21:22.625 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 2024-05-10T04:21:22.707 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T04:21:22.707 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:21:22.707 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 452 Links: 1 2024-05-10T04:21:22.708 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:21:22.708 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:21:22.708 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-10 04:21:00.367441144 +0000 2024-05-10T04:21:22.708 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-10 04:17:07.923033518 +0000 2024-05-10T04:21:22.708 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-10 04:17:07.923033518 +0000 2024-05-10T04:21:22.708 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-05-10 04:17:07.897034082 +0000 2024-05-10T04:21:22.708 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T04:21:22.809 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-10T04:21:22.809 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-10T04:21:22.809 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000318583 s, 1.6 MB/s 2024-05-10T04:21:22.812 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T04:21:22.855 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 2024-05-10T04:21:22.939 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T04:21:22.939 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:21:22.939 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 458 Links: 1 2024-05-10T04:21:22.939 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:21:22.939 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:21:22.939 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-10 04:21:00.367441144 +0000 2024-05-10T04:21:22.939 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-10 04:17:08.437022373 +0000 2024-05-10T04:21:22.939 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-10 04:17:08.437022373 +0000 2024-05-10T04:21:22.939 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-05-10 04:17:08.414022872 +0000 2024-05-10T04:21:22.940 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T04:21:23.041 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-10T04:21:23.041 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-10T04:21:23.042 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.00044952 s, 1.1 MB/s 2024-05-10T04:21:23.044 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T04:21:23.088 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 2024-05-10T04:21:23.171 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T04:21:23.171 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:21:23.171 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 464 Links: 1 2024-05-10T04:21:23.171 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:21:23.171 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:21:23.172 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-10 04:21:00.368441122 +0000 2024-05-10T04:21:23.172 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-10 04:17:08.950011251 +0000 2024-05-10T04:21:23.172 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-10 04:17:08.950011251 +0000 2024-05-10T04:21:23.172 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-05-10 04:17:08.927011749 +0000 2024-05-10T04:21:23.172 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T04:21:23.273 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-10T04:21:23.273 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-10T04:21:23.273 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000274352 s, 1.9 MB/s 2024-05-10T04:21:23.280 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T04:21:23.323 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 2024-05-10T04:21:23.406 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T04:21:23.407 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:21:23.407 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 470 Links: 1 2024-05-10T04:21:23.407 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:21:23.407 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:21:23.407 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-10 04:21:00.368441122 +0000 2024-05-10T04:21:23.407 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-10 04:17:09.475999847 +0000 2024-05-10T04:21:23.407 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-10 04:17:09.475999847 +0000 2024-05-10T04:21:23.407 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-05-10 04:17:09.451000389 +0000 2024-05-10T04:21:23.407 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T04:21:23.508 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-10T04:21:23.509 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-10T04:21:23.509 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000326233 s, 1.6 MB/s 2024-05-10T04:21:23.511 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T04:21:23.554 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T04:21:23.554 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:21:23.554 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T04:21:23.599 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T04:21:23.599 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 2024-05-10T04:21:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T04:21:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:21:23.690 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 448 Links: 1 2024-05-10T04:21:23.690 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:21:23.690 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:21:23.690 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-10 04:20:52.419471349 +0000 2024-05-10T04:21:23.690 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-10 04:17:05.895937822 +0000 2024-05-10T04:21:23.691 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-10 04:17:05.895937822 +0000 2024-05-10T04:21:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-05-10 04:17:05.872938354 +0000 2024-05-10T04:21:23.691 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T04:21:23.793 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-10T04:21:23.794 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-10T04:21:23.794 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000337906 s, 1.5 MB/s 2024-05-10T04:21:23.797 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T04:21:23.840 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 2024-05-10T04:21:23.924 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T04:21:23.924 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:21:23.924 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 454 Links: 1 2024-05-10T04:21:23.924 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:21:23.924 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:21:23.924 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-10 04:20:52.419471349 +0000 2024-05-10T04:21:23.924 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-10 04:17:06.402926119 +0000 2024-05-10T04:21:23.924 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-10 04:17:06.402926119 +0000 2024-05-10T04:21:23.924 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-05-10 04:17:06.377926696 +0000 2024-05-10T04:21:23.925 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T04:21:24.026 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-10T04:21:24.026 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-10T04:21:24.026 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.00029368 s, 1.7 MB/s 2024-05-10T04:21:24.029 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T04:21:24.073 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 2024-05-10T04:21:24.157 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T04:21:24.157 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:21:24.157 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 460 Links: 1 2024-05-10T04:21:24.157 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:21:24.157 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:21:24.157 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-10 04:20:52.419471349 +0000 2024-05-10T04:21:24.157 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-10 04:17:06.919914181 +0000 2024-05-10T04:21:24.157 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-10 04:17:06.919914181 +0000 2024-05-10T04:21:24.157 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-05-10 04:17:06.893914782 +0000 2024-05-10T04:21:24.158 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T04:21:24.259 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-10T04:21:24.259 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-10T04:21:24.260 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000303428 s, 1.7 MB/s 2024-05-10T04:21:24.262 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T04:21:24.306 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 2024-05-10T04:21:24.388 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T04:21:24.389 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:21:24.389 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 466 Links: 1 2024-05-10T04:21:24.389 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:21:24.389 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:21:24.389 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-10 04:20:52.419471349 +0000 2024-05-10T04:21:24.389 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-10 04:17:07.437902221 +0000 2024-05-10T04:21:24.389 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-10 04:17:07.437902221 +0000 2024-05-10T04:21:24.389 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-05-10 04:17:07.413902775 +0000 2024-05-10T04:21:24.389 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T04:21:24.490 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-10T04:21:24.490 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-10T04:21:24.491 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000309042 s, 1.7 MB/s 2024-05-10T04:21:24.493 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T04:21:24.536 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T04:21:24.536 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-10T04:21:24.536 INFO:tasks.ceph:Generating config... 2024-05-10T04:21:24.538 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-10T04:21:24.538 INFO:tasks.ceph:[client] debug client = 20 2024-05-10T04:21:24.538 INFO:tasks.ceph:[client] debug ms = 1 2024-05-10T04:21:24.538 INFO:tasks.ceph:[client] pid file = 2024-05-10T04:21:24.538 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-10T04:21:24.538 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-10T04:21:24.538 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-10T04:21:24.538 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-10T04:21:24.538 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-10T04:21:24.538 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-10T04:21:24.538 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-10T04:21:24.538 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-10T04:21:24.539 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-10T04:21:24.539 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-10T04:21:24.539 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-10T04:21:24.539 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-10T04:21:24.539 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-10T04:21:24.539 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-10T04:21:24.539 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-10T04:21:24.539 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-10T04:21:24.539 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-10T04:21:24.539 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-10T04:21:24.539 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-10T04:21:24.539 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-10T04:21:24.539 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-10T04:21:24.539 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-10T04:21:24.539 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-10T04:21:24.539 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-10T04:21:24.540 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-10T04:21:24.540 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-10T04:21:24.540 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-10T04:21:24.540 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-10T04:21:24.540 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-10T04:21:24.540 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-10T04:21:24.540 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-10T04:21:24.540 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-10T04:21:24.540 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-10T04:21:24.540 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-10T04:21:24.540 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-10T04:21:24.540 INFO:tasks.ceph:Setting up mon.a... 2024-05-10T04:21:24.541 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-10T04:21:24.728 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.keyring 2024-05-10T04:21:24.743 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-10T04:21:24.915 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T04:21:24.978 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.80'), ('mon.b', '172.21.15.106'), ('mon.c', '[v2:172.21.15.106:3301,v1:172.21.15.106:6790]')] 2024-05-10T04:21:24.979 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.80,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-10T04:21:24.980 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:21:24.980 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-10T04:21:25.021 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.80 --add b 172.21.15.106 --addv c '[v2:172.21.15.106:3301,v1:172.21.15.106:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:21:25.213 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:21:25.213 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: generated fsid 7fdf09a1-1b63-4484-b77e-59e97b1b5367 2024-05-10T04:21:25.213 INFO:teuthology.orchestra.run.smithi080.stdout:setting min_mon_release = pacific 2024-05-10T04:21:25.213 INFO:teuthology.orchestra.run.smithi080.stdout:epoch 0 2024-05-10T04:21:25.213 INFO:teuthology.orchestra.run.smithi080.stdout:fsid 7fdf09a1-1b63-4484-b77e-59e97b1b5367 2024-05-10T04:21:25.213 INFO:teuthology.orchestra.run.smithi080.stdout:last_changed 2024-05-10T04:21:25.213297+0000 2024-05-10T04:21:25.214 INFO:teuthology.orchestra.run.smithi080.stdout:created 2024-05-10T04:21:25.213297+0000 2024-05-10T04:21:25.214 INFO:teuthology.orchestra.run.smithi080.stdout:min_mon_release 16 (pacific) 2024-05-10T04:21:25.214 INFO:teuthology.orchestra.run.smithi080.stdout:election_strategy: 1 2024-05-10T04:21:25.214 INFO:teuthology.orchestra.run.smithi080.stdout:0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-05-10T04:21:25.214 INFO:teuthology.orchestra.run.smithi080.stdout:1: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.b 2024-05-10T04:21:25.214 INFO:teuthology.orchestra.run.smithi080.stdout:2: [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] mon.c 2024-05-10T04:21:25.214 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-10T04:21:25.223 DEBUG:teuthology.orchestra.run.smithi080:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-10T04:21:25.264 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7fdf09a1-1b63-4484-b77e-59e97b1b5367... 2024-05-10T04:21:25.265 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T04:21:25.308 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T04:21:25.417 INFO:teuthology.orchestra.run.smithi080.stdout:[global] 2024-05-10T04:21:25.417 INFO:teuthology.orchestra.run.smithi080.stdout: chdir = "" 2024-05-10T04:21:25.417 INFO:teuthology.orchestra.run.smithi080.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T04:21:25.417 INFO:teuthology.orchestra.run.smithi080.stdout: auth supported = cephx 2024-05-10T04:21:25.417 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.417 INFO:teuthology.orchestra.run.smithi080.stdout: filestore xattr use omap = true 2024-05-10T04:21:25.417 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.417 INFO:teuthology.orchestra.run.smithi080.stdout: mon clock drift allowed = 1.000 2024-05-10T04:21:25.417 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.417 INFO:teuthology.orchestra.run.smithi080.stdout: osd crush chooseleaf type = 0 2024-05-10T04:21:25.417 INFO:teuthology.orchestra.run.smithi080.stdout: auth debug = true 2024-05-10T04:21:25.417 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.418 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on old message = true 2024-05-10T04:21:25.418 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on bug = true 2024-05-10T04:21:25.418 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.418 INFO:teuthology.orchestra.run.smithi080.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T04:21:25.418 INFO:teuthology.orchestra.run.smithi080.stdout: mon pg warn max object skew = 0 2024-05-10T04:21:25.418 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.418 INFO:teuthology.orchestra.run.smithi080.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T04:21:25.418 INFO:teuthology.orchestra.run.smithi080.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T04:21:25.418 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.418 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default size = 2 2024-05-10T04:21:25.418 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.418 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow primary affinity = true 2024-05-10T04:21:25.418 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow pg remap = true 2024-05-10T04:21:25.419 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on legacy crush tunables = false 2024-05-10T04:21:25.419 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on crush straw calc version zero = false 2024-05-10T04:21:25.419 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on no sortbitwise = false 2024-05-10T04:21:25.419 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on osd down out interval zero = false 2024-05-10T04:21:25.419 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on too few osds = false 2024-05-10T04:21:25.419 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T04:21:25.419 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T04:21:25.419 INFO:teuthology.orchestra.run.smithi080.stdout: mon_allow_pool_size_one = true 2024-05-10T04:21:25.419 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.419 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T04:21:25.419 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.419 INFO:teuthology.orchestra.run.smithi080.stdout: osd default data pool replay window = 5 2024-05-10T04:21:25.420 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.420 INFO:teuthology.orchestra.run.smithi080.stdout: mon allow pool delete = true 2024-05-10T04:21:25.420 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.420 INFO:teuthology.orchestra.run.smithi080.stdout: mon cluster log file level = debug 2024-05-10T04:21:25.420 INFO:teuthology.orchestra.run.smithi080.stdout: debug asserts on shutdown = true 2024-05-10T04:21:25.420 INFO:teuthology.orchestra.run.smithi080.stdout: mon health detail to clog = false 2024-05-10T04:21:25.420 INFO:teuthology.orchestra.run.smithi080.stdout: mon host = "172.21.15.80,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]" 2024-05-10T04:21:25.420 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on skipped message = False 2024-05-10T04:21:25.420 INFO:teuthology.orchestra.run.smithi080.stdout: fsid = 7fdf09a1-1b63-4484-b77e-59e97b1b5367 2024-05-10T04:21:25.420 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.420 INFO:teuthology.orchestra.run.smithi080.stdout:[osd] 2024-05-10T04:21:25.420 INFO:teuthology.orchestra.run.smithi080.stdout: osd journal size = 100 2024-05-10T04:21:25.420 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.421 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub load threshold = 5.0 2024-05-10T04:21:25.421 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub max interval = 600 2024-05-10T04:21:25.421 INFO:teuthology.orchestra.run.smithi080.stdout: osd mclock profile = high_recovery_ops 2024-05-10T04:21:25.421 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.421 INFO:teuthology.orchestra.run.smithi080.stdout: osd recover clone overlap = true 2024-05-10T04:21:25.421 INFO:teuthology.orchestra.run.smithi080.stdout: osd recovery max chunk = 1048576 2024-05-10T04:21:25.421 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.421 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug shutdown = true 2024-05-10T04:21:25.421 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug op order = true 2024-05-10T04:21:25.421 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug verify stray on activate = true 2024-05-10T04:21:25.421 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.421 INFO:teuthology.orchestra.run.smithi080.stdout: osd open classes on start = true 2024-05-10T04:21:25.421 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug pg log writeout = true 2024-05-10T04:21:25.421 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.422 INFO:teuthology.orchestra.run.smithi080.stdout: osd deep scrub update digest min age = 30 2024-05-10T04:21:25.422 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.422 INFO:teuthology.orchestra.run.smithi080.stdout: osd map max advance = 10 2024-05-10T04:21:25.422 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.422 INFO:teuthology.orchestra.run.smithi080.stdout: journal zero on create = true 2024-05-10T04:21:25.422 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.422 INFO:teuthology.orchestra.run.smithi080.stdout: filestore ondisk finisher threads = 3 2024-05-10T04:21:25.422 INFO:teuthology.orchestra.run.smithi080.stdout: filestore apply finisher threads = 3 2024-05-10T04:21:25.422 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.422 INFO:teuthology.orchestra.run.smithi080.stdout: bdev debug aio = true 2024-05-10T04:21:25.422 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug misdirected ops = true 2024-05-10T04:21:25.422 INFO:teuthology.orchestra.run.smithi080.stdout: bdev async discard = True 2024-05-10T04:21:25.422 INFO:teuthology.orchestra.run.smithi080.stdout: bdev enable discard = True 2024-05-10T04:21:25.422 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore allocator = bitmap 2024-05-10T04:21:25.422 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore block size = 96636764160 2024-05-10T04:21:25.423 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore fsck on mount = True 2024-05-10T04:21:25.423 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluefs = 1/20 2024-05-10T04:21:25.423 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluestore = 1/20 2024-05-10T04:21:25.423 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-10T04:21:25.423 INFO:teuthology.orchestra.run.smithi080.stdout: debug osd = 20 2024-05-10T04:21:25.423 INFO:teuthology.orchestra.run.smithi080.stdout: debug rocksdb = 4/10 2024-05-10T04:21:25.423 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T04:21:25.423 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd full ratio = 0.9 2024-05-10T04:21:25.423 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd nearfull ratio = 0.8 2024-05-10T04:21:25.423 INFO:teuthology.orchestra.run.smithi080.stdout: osd failsafe full ratio = 0.95 2024-05-10T04:21:25.423 INFO:teuthology.orchestra.run.smithi080.stdout: osd objectstore = bluestore 2024-05-10T04:21:25.423 INFO:teuthology.orchestra.run.smithi080.stdout: osd op complaint time = 180 2024-05-10T04:21:25.423 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.423 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr] 2024-05-10T04:21:25.424 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-10T04:21:25.424 INFO:teuthology.orchestra.run.smithi080.stdout: debug mgr = 20 2024-05-10T04:21:25.424 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-05-10T04:21:25.424 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-05-10T04:21:25.424 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-05-10T04:21:25.424 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-05-10T04:21:25.424 INFO:teuthology.orchestra.run.smithi080.stdout: mgr/telemetry/nag = false 2024-05-10T04:21:25.424 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.424 INFO:teuthology.orchestra.run.smithi080.stdout:[mon] 2024-05-10T04:21:25.424 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-10T04:21:25.424 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-05-10T04:21:25.424 INFO:teuthology.orchestra.run.smithi080.stdout: debug paxos = 20 2024-05-10T04:21:25.424 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-05-10T04:21:25.424 INFO:teuthology.orchestra.run.smithi080.stdout: mon data avail warn = 5 2024-05-10T04:21:25.424 INFO:teuthology.orchestra.run.smithi080.stdout: mon mgr mkfs grace = 240 2024-05-10T04:21:25.424 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-05-10T04:21:25.425 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd reporter subtree level = osd 2024-05-10T04:21:25.425 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd prime pg temp = true 2024-05-10T04:21:25.425 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-05-10T04:21:25.425 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.425 INFO:teuthology.orchestra.run.smithi080.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T04:21:25.425 INFO:teuthology.orchestra.run.smithi080.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T04:21:25.425 INFO:teuthology.orchestra.run.smithi080.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T04:21:25.425 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.425 INFO:teuthology.orchestra.run.smithi080.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T04:21:25.425 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T04:21:25.425 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T04:21:25.425 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.425 INFO:teuthology.orchestra.run.smithi080.stdout: # 1m isn't quite enough 2024-05-10T04:21:25.425 INFO:teuthology.orchestra.run.smithi080.stdout: mon_down_mkfs_grace = 2m 2024-05-10T04:21:25.425 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.426 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_filestore_osds = false 2024-05-10T04:21:25.426 INFO:teuthology.orchestra.run.smithi080.stdout: mon op complaint time = 120 2024-05-10T04:21:25.426 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:21:25.426 INFO:teuthology.orchestra.run.smithi080.stdout:[client] 2024-05-10T04:21:25.426 INFO:teuthology.orchestra.run.smithi080.stdout: rgw cache enabled = true 2024-05-10T04:21:25.426 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable ops log = true 2024-05-10T04:21:25.426 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable usage log = true 2024-05-10T04:21:25.426 INFO:teuthology.orchestra.run.smithi080.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T04:21:25.426 INFO:teuthology.orchestra.run.smithi080.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T04:21:25.426 INFO:teuthology.orchestra.run.smithi080.stdout: client mount timeout = 600 2024-05-10T04:21:25.426 INFO:teuthology.orchestra.run.smithi080.stdout: debug client = 20 2024-05-10T04:21:25.426 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-10T04:21:25.426 INFO:teuthology.orchestra.run.smithi080.stdout: pid file = "" 2024-05-10T04:21:25.426 INFO:teuthology.orchestra.run.smithi080.stdout: rados mon op timeout = 900 2024-05-10T04:21:25.427 INFO:teuthology.orchestra.run.smithi080.stdout: rados osd op timeout = 900 2024-05-10T04:21:25.427 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.a] 2024-05-10T04:21:25.427 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.b] 2024-05-10T04:21:25.427 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.c] 2024-05-10T04:21:25.427 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.a] 2024-05-10T04:21:25.427 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.c] 2024-05-10T04:21:25.427 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.b] 2024-05-10T04:21:25.427 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.d] 2024-05-10T04:21:25.427 INFO:teuthology.orchestra.run.smithi080.stdout:[mds] 2024-05-10T04:21:25.427 INFO:teuthology.orchestra.run.smithi080.stdout: debug mds = 20 2024-05-10T04:21:25.427 INFO:teuthology.orchestra.run.smithi080.stdout: debug mds balancer = 20 2024-05-10T04:21:25.427 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-10T04:21:25.427 INFO:teuthology.orchestra.run.smithi080.stdout: mds debug frag = True 2024-05-10T04:21:25.427 INFO:teuthology.orchestra.run.smithi080.stdout: mds debug scatterstat = True 2024-05-10T04:21:25.427 INFO:teuthology.orchestra.run.smithi080.stdout: mds op complaint time = 180 2024-05-10T04:21:25.427 INFO:teuthology.orchestra.run.smithi080.stdout: mds verify scatter = True 2024-05-10T04:21:25.428 INFO:teuthology.orchestra.run.smithi080.stdout: osd op complaint time = 180 2024-05-10T04:21:25.428 INFO:teuthology.orchestra.run.smithi080.stdout: rados mon op timeout = 900 2024-05-10T04:21:25.428 INFO:teuthology.orchestra.run.smithi080.stdout: rados osd op timeout = 900 2024-05-10T04:21:25.428 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2024-05-10T04:21:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2024-05-10T04:21:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T04:21:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2024-05-10T04:21:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2024-05-10T04:21:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2024-05-10T04:21:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2024-05-10T04:21:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2024-05-10T04:21:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2024-05-10T04:21:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2024-05-10T04:21:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T04:21:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2024-05-10T04:21:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T04:21:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T04:21:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2024-05-10T04:21:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2024-05-10T04:21:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2024-05-10T04:21:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2024-05-10T04:21:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2024-05-10T04:21:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2024-05-10T04:21:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2024-05-10T04:21:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2024-05-10T04:21:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T04:21:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T04:21:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2024-05-10T04:21:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T04:21:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2024-05-10T04:21:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2024-05-10T04:21:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2024-05-10T04:21:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2024-05-10T04:21:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2024-05-10T04:21:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "172.21.15.80,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]" 2024-05-10T04:21:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on skipped message = False 2024-05-10T04:21:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = 7fdf09a1-1b63-4484-b77e-59e97b1b5367 2024-05-10T04:21:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.432 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2024-05-10T04:21:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2024-05-10T04:21:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2024-05-10T04:21:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2024-05-10T04:21:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: osd mclock profile = high_recovery_ops 2024-05-10T04:21:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2024-05-10T04:21:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2024-05-10T04:21:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2024-05-10T04:21:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2024-05-10T04:21:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2024-05-10T04:21:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2024-05-10T04:21:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2024-05-10T04:21:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2024-05-10T04:21:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2024-05-10T04:21:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2024-05-10T04:21:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2024-05-10T04:21:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2024-05-10T04:21:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2024-05-10T04:21:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2024-05-10T04:21:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: bdev async discard = True 2024-05-10T04:21:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: bdev enable discard = True 2024-05-10T04:21:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore allocator = bitmap 2024-05-10T04:21:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2024-05-10T04:21:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2024-05-10T04:21:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 1/20 2024-05-10T04:21:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 1/20 2024-05-10T04:21:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-05-10T04:21:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 20 2024-05-10T04:21:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 4/10 2024-05-10T04:21:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T04:21:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2024-05-10T04:21:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2024-05-10T04:21:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2024-05-10T04:21:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2024-05-10T04:21:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-05-10T04:21:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.435 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2024-05-10T04:21:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-05-10T04:21:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2024-05-10T04:21:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-05-10T04:21:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-05-10T04:21:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-05-10T04:21:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-05-10T04:21:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2024-05-10T04:21:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.435 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2024-05-10T04:21:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-05-10T04:21:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-05-10T04:21:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2024-05-10T04:21:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-05-10T04:21:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2024-05-10T04:21:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2024-05-10T04:21:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-05-10T04:21:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2024-05-10T04:21:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2024-05-10T04:21:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-05-10T04:21:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T04:21:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T04:21:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T04:21:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T04:21:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T04:21:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T04:21:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: # 1m isn't quite enough 2024-05-10T04:21:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: mon_down_mkfs_grace = 2m 2024-05-10T04:21:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_filestore_osds = false 2024-05-10T04:21:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: mon op complaint time = 120 2024-05-10T04:21:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T04:21:25.437 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2024-05-10T04:21:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2024-05-10T04:21:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2024-05-10T04:21:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2024-05-10T04:21:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T04:21:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T04:21:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: client mount timeout = 600 2024-05-10T04:21:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: debug client = 20 2024-05-10T04:21:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-05-10T04:21:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = "" 2024-05-10T04:21:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-05-10T04:21:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-05-10T04:21:25.438 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2024-05-10T04:21:25.438 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2024-05-10T04:21:25.438 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2024-05-10T04:21:25.438 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2024-05-10T04:21:25.438 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2024-05-10T04:21:25.438 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2024-05-10T04:21:25.438 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2024-05-10T04:21:25.438 INFO:teuthology.orchestra.run.smithi106.stdout:[mds] 2024-05-10T04:21:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds = 20 2024-05-10T04:21:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds balancer = 20 2024-05-10T04:21:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-05-10T04:21:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug frag = True 2024-05-10T04:21:25.439 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug scatterstat = True 2024-05-10T04:21:25.439 INFO:teuthology.orchestra.run.smithi106.stdout: mds op complaint time = 180 2024-05-10T04:21:25.439 INFO:teuthology.orchestra.run.smithi106.stdout: mds verify scatter = True 2024-05-10T04:21:25.439 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-05-10T04:21:25.439 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-05-10T04:21:25.439 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-05-10T04:21:25.453 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-10T04:21:25.453 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-10T04:21:25.634 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-10T04:21:25.634 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:21:25.634 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-10T04:21:25.675 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:21:25.675 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-10T04:21:25.756 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi080.front.sepia.ceph.com 2024-05-10T04:21:25.756 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:21:25.756 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-10T04:21:25.756 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T04:21:25.885 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:21:25.885 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:21:25.966 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi106.front.sepia.ceph.com 2024-05-10T04:21:25.966 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:21:25.966 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-10T04:21:25.966 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T04:21:26.059 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:21:26.059 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:21:26.141 INFO:tasks.ceph:Setting up mon nodes... 2024-05-10T04:21:26.141 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-10T04:21:26.141 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-10T04:21:26.325 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-10T04:21:26.338 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-10T04:21:26.536 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-10T04:21:26.553 INFO:tasks.ceph:Setting up mds nodes... 2024-05-10T04:21:26.553 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-10T04:21:26.736 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-10T04:21:26.749 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-10T04:21:26.815 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-10T04:21:26.999 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-10T04:21:27.012 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-10T04:21:27.078 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-10T04:21:27.266 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-10T04:21:27.279 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-10T04:21:27.344 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-10T04:21:27.528 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-10T04:21:27.541 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-10T04:21:27.606 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-10T04:21:27.606 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-10T04:21:27.767 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-10T04:21:27.804 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-10T04:21:27.961 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-10T04:21:27.999 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-10T04:21:28.160 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-10T04:21:28.198 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-10T04:21:28.357 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-10T04:21:28.394 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-10T04:21:28.394 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-10T04:21:28.395 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-10T04:21:28.461 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T04:21:28.461 INFO:tasks.ceph:role: osd.0 2024-05-10T04:21:28.461 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-10T04:21:28.462 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-10T04:21:28.533 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:21:28.533 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:21:28.533 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:21:28.533 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:21:28.533 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:21:28.533 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:21:28.533 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:21:28.533 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:21:28.533 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:21:28.534 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:21:28.907 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-10T04:21:28.912 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-10T04:21:28.912 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-10T04:21:29.059 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-10T04:21:29.134 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-10T04:21:29.199 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T04:21:29.200 INFO:tasks.ceph:role: osd.1 2024-05-10T04:21:29.200 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-10T04:21:29.200 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-10T04:21:29.272 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:21:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:21:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:21:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:21:29.272 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:21:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:21:29.272 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:21:29.273 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:21:29.273 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:21:29.273 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:21:29.628 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-10T04:21:29.632 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-10T04:21:29.632 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-10T04:21:29.739 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-10T04:21:29.810 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-10T04:21:29.876 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T04:21:29.876 INFO:tasks.ceph:role: osd.2 2024-05-10T04:21:29.876 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-10T04:21:29.876 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-10T04:21:29.947 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:21:29.947 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:21:29.947 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:21:29.947 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:21:29.947 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:21:29.947 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:21:29.947 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:21:29.947 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:21:29.947 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:21:29.947 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:21:30.323 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-10T04:21:30.327 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-10T04:21:30.328 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-10T04:21:30.458 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-10T04:21:30.530 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-10T04:21:30.595 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T04:21:30.595 INFO:tasks.ceph:role: osd.3 2024-05-10T04:21:30.595 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-10T04:21:30.595 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-10T04:21:30.667 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:21:30.667 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:21:30.667 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:21:30.667 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:21:30.667 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:21:30.667 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:21:30.667 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:21:30.667 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:21:30.667 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:21:30.667 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:21:31.053 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-10T04:21:31.057 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-10T04:21:31.058 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-10T04:21:31.222 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-10T04:21:31.294 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:21:31.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:31.472+0000 7f5a529ab7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-10T04:21:31.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:31.475+0000 7f5a529ab7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-10T04:21:31.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:31.475+0000 7f5a529ab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T04:21:31.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:31.475+0000 7f5a529ab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T04:21:31.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:31.475+0000 7f5a529ab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T04:21:31.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:31.480+0000 7f5a529ab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-10T04:21:34.457 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-10T04:21:34.522 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:21:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:34.689+0000 7fd9e1d097c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-10T04:21:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:34.689+0000 7fd9e1d097c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-10T04:21:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:34.689+0000 7fd9e1d097c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T04:21:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:34.690+0000 7fd9e1d097c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T04:21:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:34.690+0000 7fd9e1d097c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T04:21:34.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:34.691+0000 7fd9e1d097c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-10T04:21:37.619 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-10T04:21:37.688 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:21:37.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:37.856+0000 7feb0aac77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-10T04:21:37.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:37.856+0000 7feb0aac77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-10T04:21:37.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:37.857+0000 7feb0aac77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T04:21:37.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:37.857+0000 7feb0aac77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T04:21:37.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:37.857+0000 7feb0aac77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T04:21:37.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:37.858+0000 7feb0aac77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-10T04:21:40.795 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-10T04:21:40.861 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:21:41.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:41.026+0000 7f5e50a507c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-10T04:21:41.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:41.026+0000 7f5e50a507c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-10T04:21:41.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:41.026+0000 7f5e50a507c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T04:21:41.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:41.026+0000 7f5e50a507c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T04:21:41.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:41.026+0000 7f5e50a507c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T04:21:41.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:21:41.028+0000 7f5e50a507c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-10T04:21:43.950 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-10T04:21:44.015 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-10T04:21:44.090 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T04:21:44.090 INFO:tasks.ceph:role: osd.4 2024-05-10T04:21:44.090 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-10T04:21:44.090 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-10T04:21:44.164 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:21:44.164 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:21:44.164 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:21:44.164 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:21:44.164 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:21:44.164 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:21:44.164 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:21:44.164 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:21:44.164 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:21:44.164 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:21:44.536 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-05-10T04:21:44.541 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-05-10T04:21:44.541 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-10T04:21:44.703 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-10T04:21:44.778 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-10T04:21:44.844 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T04:21:44.844 INFO:tasks.ceph:role: osd.5 2024-05-10T04:21:44.844 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-10T04:21:44.845 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-10T04:21:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:21:44.917 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:21:44.917 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:21:44.917 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:21:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:21:44.917 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:21:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:21:44.918 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:21:44.918 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:21:44.918 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:21:45.272 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-05-10T04:21:45.276 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-05-10T04:21:45.276 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-10T04:21:45.385 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-10T04:21:45.457 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-10T04:21:45.522 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T04:21:45.522 INFO:tasks.ceph:role: osd.6 2024-05-10T04:21:45.522 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-10T04:21:45.522 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-10T04:21:45.594 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:21:45.594 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:21:45.594 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:21:45.594 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:21:45.594 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:21:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:21:45.595 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:21:45.595 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:21:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:21:45.595 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:21:45.974 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-05-10T04:21:45.979 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-05-10T04:21:45.979 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-10T04:21:46.113 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-10T04:21:46.185 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-10T04:21:46.250 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T04:21:46.251 INFO:tasks.ceph:role: osd.7 2024-05-10T04:21:46.251 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-10T04:21:46.251 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-10T04:21:46.322 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:21:46.322 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:21:46.322 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:21:46.322 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:21:46.322 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:21:46.322 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:21:46.322 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:21:46.322 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:21:46.322 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:21:46.322 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:21:46.705 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-05-10T04:21:46.709 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-05-10T04:21:46.710 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-10T04:21:46.873 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-10T04:21:46.945 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:21:47.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:47.133+0000 7f8a357aa7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-10T04:21:47.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:47.133+0000 7f8a357aa7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-10T04:21:47.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:47.133+0000 7f8a357aa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T04:21:47.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:47.133+0000 7f8a357aa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T04:21:47.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:47.133+0000 7f8a357aa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T04:21:47.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:47.136+0000 7f8a357aa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-10T04:21:50.084 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-10T04:21:50.150 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:21:50.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:50.316+0000 7fe50b61a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-10T04:21:50.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:50.316+0000 7fe50b61a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-10T04:21:50.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:50.316+0000 7fe50b61a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T04:21:50.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:50.316+0000 7fe50b61a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T04:21:50.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:50.316+0000 7fe50b61a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T04:21:50.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:50.318+0000 7fe50b61a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-10T04:21:52.432 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:21:52.437 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:21:53.245 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-10T04:21:53.311 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:21:53.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:53.478+0000 7f407caad7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-10T04:21:53.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:53.479+0000 7f407caad7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-10T04:21:53.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:53.479+0000 7f407caad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T04:21:53.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:53.479+0000 7f407caad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T04:21:53.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:53.479+0000 7f407caad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T04:21:53.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:53.481+0000 7f407caad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-10T04:21:56.432 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-10T04:21:56.499 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:21:56.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:56.665+0000 7fa985dd77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-10T04:21:56.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:56.665+0000 7fa985dd77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-10T04:21:56.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:56.665+0000 7fa985dd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T04:21:56.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:56.665+0000 7fa985dd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T04:21:56.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:56.665+0000 7fa985dd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T04:21:56.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:21:56.667+0000 7fa985dd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-10T04:21:59.601 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-10T04:21:59.667 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-10T04:21:59.669 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:21:59.669 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-10T04:21:59.740 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:21:59.740 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-10T04:21:59.847 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:21:59.848 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-10T04:21:59.951 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:21:59.952 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-10T04:22:00.056 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:22:00.057 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-10T04:22:00.161 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:22:00.161 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-10T04:22:00.265 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:22:00.265 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-10T04:22:00.371 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:22:00.371 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-10T04:22:00.438 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:22:00.438 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-10T04:22:00.543 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:22:00.543 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-10T04:22:00.648 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:22:00.648 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-10T04:22:00.753 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:22:00.754 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-10T04:22:00.859 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:22:00.859 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-10T04:22:00.964 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:22:00.964 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-10T04:22:01.070 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:22:01.070 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-10T04:22:01.114 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:22:01.114 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-10T04:22:01.197 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:22:01.197 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-10T04:22:01.238 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:22:01.238 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-10T04:22:01.325 INFO:tasks.ceph:Adding keys to all mons... 2024-05-10T04:22:01.422 DEBUG:teuthology.orchestra.run.smithi080:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-10T04:22:01.427 DEBUG:teuthology.orchestra.run.smithi106:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-10T04:22:01.485 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr.y] 2024-05-10T04:22:01.486 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDGoD1m1cZmExAACGbS5fhje6yneHUUPhMZuA== 2024-05-10T04:22:01.486 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.a] 2024-05-10T04:22:01.486 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDGoD1m34zmKxAAUCHW2XaT2Q45OSlRqUCxDg== 2024-05-10T04:22:01.486 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.c] 2024-05-10T04:22:01.486 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDGoD1mEYCPOxAAVc7+qVTvMPc+qABqLNr8hw== 2024-05-10T04:22:01.486 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.0] 2024-05-10T04:22:01.486 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDLoD1mVLw5HBAAUsnruzjDsMY+cuW/HW6IsQ== 2024-05-10T04:22:01.486 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.1] 2024-05-10T04:22:01.486 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDOoD1m4zcqKRAAacm/DDheLNuiFbVxcZE2LQ== 2024-05-10T04:22:01.486 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.2] 2024-05-10T04:22:01.486 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDRoD1m6JMeMxAA4k8/i/r4mfD40NqwPymaEw== 2024-05-10T04:22:01.487 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.3] 2024-05-10T04:22:01.487 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDVoD1mGoqjARAA/g68PExdsrPSGDOtiNGIRg== 2024-05-10T04:22:01.487 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr.x] 2024-05-10T04:22:01.487 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDGoD1mwXL4HxAAKhdbtPVg4ChNdKenYaVA5A== 2024-05-10T04:22:01.487 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.b] 2024-05-10T04:22:01.487 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDHoD1mcwHnDxAAENHJrQ6P8FLrtp/ubn2LdQ== 2024-05-10T04:22:01.487 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.d] 2024-05-10T04:22:01.487 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDHoD1mcR+BHxAArW9grhTXRDMy1J+CCqnsUw== 2024-05-10T04:22:01.487 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.4] 2024-05-10T04:22:01.487 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDboD1mWGXzBxAAsLr9tqCb7XjCIO+hI+Y0iA== 2024-05-10T04:22:01.487 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.5] 2024-05-10T04:22:01.487 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDeoD1mjJ7hEhAA+nZTvDCVnoD7hWJjnGQNeg== 2024-05-10T04:22:01.487 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.6] 2024-05-10T04:22:01.487 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDhoD1mLXmNHBAAJ1sJMT7TT1WxOiPJg3RxBw== 2024-05-10T04:22:01.487 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.7] 2024-05-10T04:22:01.488 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDkoD1mOmu8JxAANe+x9Ys3s/tee2qYi7nOyg== 2024-05-10T04:22:01.488 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-05-10T04:22:01.488 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDHoD1mwGm7LRAAkiB5+STAX0Cl6GvpfB97Qw== 2024-05-10T04:22:01.488 INFO:teuthology.orchestra.run.smithi080.stdout:[client.2] 2024-05-10T04:22:01.488 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDHoD1mzPVTORAAymg1tI2s217pkyyzNefajg== 2024-05-10T04:22:01.488 INFO:teuthology.orchestra.run.smithi080.stdout:[client.1] 2024-05-10T04:22:01.488 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDIoD1mmkWXCRAAMRsK/7+gcsQcSF6tQAu/Jw== 2024-05-10T04:22:01.488 INFO:teuthology.orchestra.run.smithi080.stdout:[client.3] 2024-05-10T04:22:01.488 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDIoD1m+mlIFRAAhjrkUf30qqb3N5nyV6Gsnw== 2024-05-10T04:22:01.489 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.y] 2024-05-10T04:22:01.489 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDGoD1m1cZmExAACGbS5fhje6yneHUUPhMZuA== 2024-05-10T04:22:01.489 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2024-05-10T04:22:01.489 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDGoD1m34zmKxAAUCHW2XaT2Q45OSlRqUCxDg== 2024-05-10T04:22:01.489 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2024-05-10T04:22:01.489 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDGoD1mEYCPOxAAVc7+qVTvMPc+qABqLNr8hw== 2024-05-10T04:22:01.489 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.0] 2024-05-10T04:22:01.489 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDLoD1mVLw5HBAAUsnruzjDsMY+cuW/HW6IsQ== 2024-05-10T04:22:01.489 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.1] 2024-05-10T04:22:01.489 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDOoD1m4zcqKRAAacm/DDheLNuiFbVxcZE2LQ== 2024-05-10T04:22:01.489 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.2] 2024-05-10T04:22:01.489 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDRoD1m6JMeMxAA4k8/i/r4mfD40NqwPymaEw== 2024-05-10T04:22:01.489 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.3] 2024-05-10T04:22:01.490 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDVoD1mGoqjARAA/g68PExdsrPSGDOtiNGIRg== 2024-05-10T04:22:01.490 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.x] 2024-05-10T04:22:01.490 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDGoD1mwXL4HxAAKhdbtPVg4ChNdKenYaVA5A== 2024-05-10T04:22:01.490 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2024-05-10T04:22:01.490 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDHoD1mcwHnDxAAENHJrQ6P8FLrtp/ubn2LdQ== 2024-05-10T04:22:01.490 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2024-05-10T04:22:01.490 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDHoD1mcR+BHxAArW9grhTXRDMy1J+CCqnsUw== 2024-05-10T04:22:01.490 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.4] 2024-05-10T04:22:01.490 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDboD1mWGXzBxAAsLr9tqCb7XjCIO+hI+Y0iA== 2024-05-10T04:22:01.490 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.5] 2024-05-10T04:22:01.490 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDeoD1mjJ7hEhAA+nZTvDCVnoD7hWJjnGQNeg== 2024-05-10T04:22:01.490 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.6] 2024-05-10T04:22:01.490 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDhoD1mLXmNHBAAJ1sJMT7TT1WxOiPJg3RxBw== 2024-05-10T04:22:01.490 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.7] 2024-05-10T04:22:01.491 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDkoD1mOmu8JxAANe+x9Ys3s/tee2qYi7nOyg== 2024-05-10T04:22:01.491 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2024-05-10T04:22:01.491 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDHoD1mwGm7LRAAkiB5+STAX0Cl6GvpfB97Qw== 2024-05-10T04:22:01.491 INFO:teuthology.orchestra.run.smithi106.stdout:[client.2] 2024-05-10T04:22:01.491 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDHoD1mzPVTORAAymg1tI2s217pkyyzNefajg== 2024-05-10T04:22:01.491 INFO:teuthology.orchestra.run.smithi106.stdout:[client.1] 2024-05-10T04:22:01.491 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDIoD1mmkWXCRAAMRsK/7+gcsQcSF6tQAu/Jw== 2024-05-10T04:22:01.491 INFO:teuthology.orchestra.run.smithi106.stdout:[client.3] 2024-05-10T04:22:01.491 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDIoD1m+mlIFRAAhjrkUf30qqb3N5nyV6Gsnw== 2024-05-10T04:22:01.493 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T04:22:01.536 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T04:22:01.714 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:22:01.721 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:22:01.901 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:22:01.905 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:22:02.084 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:22:02.088 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:22:02.267 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:22:02.272 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:22:02.450 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:22:02.454 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:22:02.632 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:22:02.636 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:22:02.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T04:22:02.818 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T04:22:02.995 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:22:02.999 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:22:03.181 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:22:03.185 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:22:03.367 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:22:03.371 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:22:03.548 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:22:03.552 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:22:03.729 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:22:03.733 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:22:03.911 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:22:03.915 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:22:04.093 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:22:04.097 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:22:04.278 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:22:04.282 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:22:04.462 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:22:04.466 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:22:04.645 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:22:04.649 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:22:04.830 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-10T04:22:04.830 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-10T04:22:04.896 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T04:22:05.091 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-10T04:22:05.156 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-10T04:22:05.221 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T04:22:05.417 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-10T04:22:05.482 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-10T04:22:05.547 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T04:22:05.739 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-10T04:22:05.804 DEBUG:teuthology.orchestra.run.smithi080:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:22:05.808 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:22:05.849 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-10T04:22:05.849 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-10T04:22:05.849 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-10T04:22:05.891 INFO:tasks.ceph.mon.a:Started 2024-05-10T04:22:05.891 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-10T04:22:05.891 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-10T04:22:05.895 INFO:tasks.ceph.mon.b:Started 2024-05-10T04:22:05.895 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-10T04:22:05.896 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-10T04:22:05.899 INFO:tasks.ceph.mon.c:Started 2024-05-10T04:22:05.899 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-10T04:22:05.899 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-10T04:22:05.900 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-10T04:22:05.903 INFO:tasks.ceph.mgr.y:Started 2024-05-10T04:22:05.903 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-10T04:22:05.903 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-10T04:22:05.907 INFO:tasks.ceph.mgr.x:Started 2024-05-10T04:22:05.907 INFO:tasks.ceph:Setting crush tunables to default 2024-05-10T04:22:05.907 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd crush tunables default 2024-05-10T04:22:06.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.171+0000 7fc6c5400700 1 Processor -- start 2024-05-10T04:22:06.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.172+0000 7fc6c5400700 1 -- start start 2024-05-10T04:22:06.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.173+0000 7fc6c5400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 0x7fc6c0072330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:06.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.173+0000 7fc6c5400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 0x7fc6c00b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:06.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.173+0000 7fc6c5400700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c00cc5f0 con 0x7fc6c00cc1e0 2024-05-10T04:22:06.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.173+0000 7fc6c5400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c006e610 con 0x7fc6c00b2c30 2024-05-10T04:22:06.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.173+0000 7fc6c5400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0072870 con 0x7fc6c0071f20 2024-05-10T04:22:06.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.174+0000 7fc6be800700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc6c00cc1e0 0x7fc6c015b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:41014/0 (socket says 172.21.15.80:41014) 2024-05-10T04:22:06.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.174+0000 7fc6be800700 1 -- 172.21.15.80:0/2652187870 learned_addr learned my addr 172.21.15.80:0/2652187870 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:06.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.174+0000 7fc6bf200700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 0x7fc6c00b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:06.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.174+0000 7fc6bf200700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 msgr2=0x7fc6c00b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-10T04:22:06.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.174+0000 7fc6bf200700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 msgr2=0x7fc6c00b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T04:22:06.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.174+0000 7fc6bf200700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 0x7fc6c00b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T04:22:06.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.174+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 0x7fc6c0072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:06.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.174+0000 7fc6bf200700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 0x7fc6c00b3040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T04:22:06.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.174+0000 7fc6bde00700 1 -- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 msgr2=0x7fc6c0072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-10T04:22:06.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.174+0000 7fc6bde00700 1 -- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 msgr2=0x7fc6c0072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T04:22:06.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.174+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 0x7fc6c0072330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T04:22:06.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.174+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 0x7fc6c0072330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T04:22:06.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.375+0000 7fc6bf200700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 0x7fc6c00b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:06.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.375+0000 7fc6bf200700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 msgr2=0x7fc6c00b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-10T04:22:06.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.375+0000 7fc6bf200700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 msgr2=0x7fc6c00b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T04:22:06.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.375+0000 7fc6bf200700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 0x7fc6c00b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T04:22:06.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.375+0000 7fc6bf200700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 0x7fc6c00b3040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-10T04:22:06.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.375+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 0x7fc6c0072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:06.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.375+0000 7fc6bde00700 1 -- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 msgr2=0x7fc6c0072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-10T04:22:06.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.375+0000 7fc6bde00700 1 -- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 msgr2=0x7fc6c0072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T04:22:06.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.375+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 0x7fc6c0072330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T04:22:06.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.375+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 0x7fc6c0072330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-10T04:22:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.776+0000 7fc6bf200700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 0x7fc6c00b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.776+0000 7fc6bf200700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 msgr2=0x7fc6c00b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-10T04:22:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.776+0000 7fc6bf200700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 msgr2=0x7fc6c00b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T04:22:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.776+0000 7fc6bf200700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 0x7fc6c00b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T04:22:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.776+0000 7fc6bf200700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 0x7fc6c00b3040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-10T04:22:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.776+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 0x7fc6c0072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.777+0000 7fc6bde00700 1 -- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 msgr2=0x7fc6c0072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-10T04:22:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.777+0000 7fc6bde00700 1 -- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 msgr2=0x7fc6c0072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T04:22:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.777+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 0x7fc6c0072330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T04:22:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:06.777+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 0x7fc6c0072330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-10T04:22:07.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:07.576+0000 7fc6bf200700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 0x7fc6c00b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:07.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:07.576+0000 7fc6bf200700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 msgr2=0x7fc6c00b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-10T04:22:07.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:07.576+0000 7fc6bf200700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 msgr2=0x7fc6c00b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T04:22:07.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:07.576+0000 7fc6bf200700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 0x7fc6c00b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T04:22:07.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:07.576+0000 7fc6bf200700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 0x7fc6c00b3040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-10T04:22:07.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:07.577+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 0x7fc6c0072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:07.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:07.577+0000 7fc6bde00700 1 -- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 msgr2=0x7fc6c0072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-10T04:22:07.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:07.577+0000 7fc6bde00700 1 -- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 msgr2=0x7fc6c0072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T04:22:07.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:07.577+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 0x7fc6c0072330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T04:22:07.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:07.577+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 0x7fc6c0072330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-10T04:22:09.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.173+0000 7fc6b7e00700 1 -- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 msgr2=0x7fc6c0072330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T04:22:09.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.173+0000 7fc6b7e00700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6c0071f20 0x7fc6c0072330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:09.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.173+0000 7fc6b7e00700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 msgr2=0x7fc6c00b3040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T04:22:09.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.173+0000 7fc6b7e00700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.80:3300/0 conn(0x7fc6c00b2c30 0x7fc6c00b3040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:09.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.173+0000 7fc6b7e00700 1 -- 172.21.15.80:0/2652187870 >> v1:172.21.15.106:6789/0 conn(0x7fc6c00cc1e0 legacy=0x7fc6c015b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:09.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.173+0000 7fc6b7e00700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 0x7fc6a000bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:09.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.173+0000 7fc6b7e00700 1 -- 172.21.15.80:0/2652187870 --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c006d6f0 con 0x7fc6a0005940 2024-05-10T04:22:09.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.173+0000 7fc6b7e00700 1 -- 172.21.15.80:0/2652187870 --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c006e610 con 0x7fc6a0009640 2024-05-10T04:22:09.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.173+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 0x7fc6a000bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:09.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.173+0000 7fc6bde00700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 msgr2=0x7fc6a000bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-10T04:22:09.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.173+0000 7fc6bde00700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 msgr2=0x7fc6a000bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T04:22:09.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.173+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 0x7fc6a000bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T04:22:09.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.174+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 0x7fc6a000bb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T04:22:09.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.375+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 0x7fc6a000bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:09.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.375+0000 7fc6bde00700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 msgr2=0x7fc6a000bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-10T04:22:09.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.375+0000 7fc6bde00700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 msgr2=0x7fc6a000bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T04:22:09.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.375+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 0x7fc6a000bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T04:22:09.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.375+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 0x7fc6a000bb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-10T04:22:09.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.776+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 0x7fc6a000bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:09.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.776+0000 7fc6bde00700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 msgr2=0x7fc6a000bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-10T04:22:09.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.776+0000 7fc6bde00700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 msgr2=0x7fc6a000bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T04:22:09.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.776+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 0x7fc6a000bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T04:22:09.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:09.776+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 0x7fc6a000bb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-10T04:22:10.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:10.578+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 0x7fc6a000bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:10.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:10.578+0000 7fc6bde00700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 msgr2=0x7fc6a000bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-10T04:22:10.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:10.578+0000 7fc6bde00700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 msgr2=0x7fc6a000bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T04:22:10.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:10.578+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 0x7fc6a000bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T04:22:10.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:10.578+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 0x7fc6a000bb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-10T04:22:11.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.385+0000 7fc6bd400700 1 -- 172.21.15.80:0/2652187870 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990832266 0 0) 0x7fc6c006d6f0 con 0x7fc6a0005940 2024-05-10T04:22:11.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.385+0000 7fc6bd400700 1 -- 172.21.15.80:0/2652187870 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a40035b0 con 0x7fc6a0005940 2024-05-10T04:22:11.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.385+0000 7fc6bd400700 1 -- 172.21.15.80:0/2652187870 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 587945339 0 0) 0x7fc6a40035b0 con 0x7fc6a0005940 2024-05-10T04:22:11.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.385+0000 7fc6bd400700 1 -- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 msgr2=0x7fc6a000bb50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T04:22:11.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.385+0000 7fc6bd400700 1 --2- 172.21.15.80:0/2652187870 >> v2:172.21.15.106:3300/0 conn(0x7fc6a0009640 0x7fc6a000bb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:11.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.385+0000 7fc6bd400700 1 -- 172.21.15.80:0/2652187870 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a000d2c0 con 0x7fc6a0005940 2024-05-10T04:22:11.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.385+0000 7fc6bd400700 1 -- 172.21.15.80:0/2652187870 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7fc6b00016f0 con 0x7fc6a0005940 2024-05-10T04:22:11.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.385+0000 7fc6bd400700 1 -- 172.21.15.80:0/2652187870 >> v1:172.21.15.80:6789/0 conn(0x7fc6a0005940 legacy=0x7fc6a0007e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:11.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.385+0000 7fc6bf200700 1 -- 172.21.15.80:0/2652187870 reap_dead start 2024-05-10T04:22:11.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.385+0000 7fc6bd400700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a4003a00 0x7fc6a4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:11.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.386+0000 7fc6bd400700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a4004850 0x7fc6a4004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:11.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.386+0000 7fc6bd400700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a40053d0 0x7fc6a400ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:11.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.386+0000 7fc6bd400700 1 -- 172.21.15.80:0/2652187870 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c006e610 con 0x7fc6a4004850 2024-05-10T04:22:11.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.386+0000 7fc6bd400700 1 -- 172.21.15.80:0/2652187870 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a400c370 con 0x7fc6a40053d0 2024-05-10T04:22:11.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.386+0000 7fc6bd400700 1 -- 172.21.15.80:0/2652187870 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a400c530 con 0x7fc6a4003a00 2024-05-10T04:22:11.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.386+0000 7fc6bf200700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a40053d0 0x7fc6a400ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:11.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.386+0000 7fc6be800700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a4003a00 0x7fc6a4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:11.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.386+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a4004850 0x7fc6a4004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:11.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.387+0000 7fc6bf200700 1 -- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a4003a00 msgr2=0x7fc6a4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:11.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.387+0000 7fc6bf200700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a4003a00 0x7fc6a4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:11.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.387+0000 7fc6bf200700 1 -- 172.21.15.80:0/2652187870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a4004850 msgr2=0x7fc6a4004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:11.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.387+0000 7fc6bf200700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a4004850 0x7fc6a4004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:11.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.387+0000 7fc6bf200700 1 -- 172.21.15.80:0/2652187870 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40035b0 con 0x7fc6a40053d0 2024-05-10T04:22:11.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.387+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a4004850 0x7fc6a4004c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:11.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.387+0000 7fc6bf200700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a40053d0 0x7fc6a400ba90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc6c006e510 tx=0x7fc6a4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97c1bee002b033f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:11.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.388+0000 7fc6bd400700 1 -- 172.21.15.80:0/2652187870 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8004100 con 0x7fc6a40053d0 2024-05-10T04:22:11.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.388+0000 7fc6bd400700 1 -- 172.21.15.80:0/2652187870 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b8004260 con 0x7fc6a40053d0 2024-05-10T04:22:11.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.388+0000 7fc6bd400700 1 -- 172.21.15.80:0/2652187870 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8004610 con 0x7fc6a40053d0 2024-05-10T04:22:11.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.389+0000 7fc6c5400700 1 -- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a40053d0 msgr2=0x7fc6a400ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:11.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.389+0000 7fc6c5400700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a40053d0 0x7fc6a400ba90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc6c006e510 tx=0x7fc6a4005880 comp rx=0 tx=0).stop 2024-05-10T04:22:11.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.389+0000 7fc6c5400700 1 -- 172.21.15.80:0/2652187870 shutdown_connections 2024-05-10T04:22:11.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.389+0000 7fc6c5400700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a4004850 0x7fc6a4004c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:11.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.389+0000 7fc6c5400700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a40053d0 0x7fc6a400ba90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:11.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.389+0000 7fc6c5400700 1 --2- 172.21.15.80:0/2652187870 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a4003a00 0x7fc6a4003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:11.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.389+0000 7fc6c5400700 1 -- 172.21.15.80:0/2652187870 >> 172.21.15.80:0/2652187870 conn(0x7fc6c00b1830 msgr2=0x7fc6c00b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:11.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.389+0000 7fc6c5400700 1 -- 172.21.15.80:0/2652187870 shutdown_connections 2024-05-10T04:22:11.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.389+0000 7fc6c5400700 1 -- 172.21.15.80:0/2652187870 wait complete. 2024-05-10T04:22:11.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.392+0000 7fc6c5400700 1 Processor -- start 2024-05-10T04:22:11.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.392+0000 7fc6c5400700 1 -- start start 2024-05-10T04:22:11.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.394+0000 7fc6c5400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a4003a00 0x7fc6c013d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:11.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.394+0000 7fc6c5400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a4004850 0x7fc6c013f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:11.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.394+0000 7fc6c5400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a40053d0 0x7fc6c013cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:11.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.394+0000 7fc6c5400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00c9ac0 con 0x7fc6a4003a00 2024-05-10T04:22:11.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.394+0000 7fc6c5400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c013de00 con 0x7fc6a4004850 2024-05-10T04:22:11.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.394+0000 7fc6c5400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c013f630 con 0x7fc6a40053d0 2024-05-10T04:22:11.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.394+0000 7fc6bde00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a4004850 0x7fc6c013f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:11.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.394+0000 7fc6bde00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a4004850 0x7fc6c013f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:55282/0 (socket says 172.21.15.80:55282) 2024-05-10T04:22:11.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.394+0000 7fc6bde00700 1 -- 172.21.15.80:0/2170435119 learned_addr learned my addr 172.21.15.80:0/2170435119 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:11.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.394+0000 7fc6bf200700 1 --2- 172.21.15.80:0/2170435119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a40053d0 0x7fc6c013cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:11.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.395+0000 7fc6be800700 1 --2- 172.21.15.80:0/2170435119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a4003a00 0x7fc6c013d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:11.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.395+0000 7fc6bde00700 1 -- 172.21.15.80:0/2170435119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a40053d0 msgr2=0x7fc6c013cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:11.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.395+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2170435119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a40053d0 0x7fc6c013cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:11.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.395+0000 7fc6bde00700 1 -- 172.21.15.80:0/2170435119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a4003a00 msgr2=0x7fc6c013d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:11.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.395+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2170435119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a4003a00 0x7fc6c013d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:11.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.395+0000 7fc6bde00700 1 -- 172.21.15.80:0/2170435119 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c013d500 con 0x7fc6a4004850 2024-05-10T04:22:11.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.395+0000 7fc6bde00700 1 --2- 172.21.15.80:0/2170435119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a4004850 0x7fc6c013f0f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac017a50 tx=0x7fc6ac017d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:11.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.398+0000 7fc6b6a00700 1 -- 172.21.15.80:0/2170435119 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac016cd0 con 0x7fc6a4004850 2024-05-10T04:22:11.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.398+0000 7fc6b6a00700 1 -- 172.21.15.80:0/2170435119 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ac01f040 con 0x7fc6a4004850 2024-05-10T04:22:11.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.398+0000 7fc6c5400700 1 -- 172.21.15.80:0/2170435119 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c013e050 con 0x7fc6a4004850 2024-05-10T04:22:11.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.398+0000 7fc6b6a00700 1 -- 172.21.15.80:0/2170435119 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac017e80 con 0x7fc6a4004850 2024-05-10T04:22:11.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.398+0000 7fc6c5400700 1 -- 172.21.15.80:0/2170435119 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c013e610 con 0x7fc6a4004850 2024-05-10T04:22:11.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.398+0000 7fc6b6a00700 1 -- 172.21.15.80:0/2170435119 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc6ac02d760 con 0x7fc6a4004850 2024-05-10T04:22:11.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.398+0000 7fc6b6a00700 1 -- 172.21.15.80:0/2170435119 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc6ac023920 con 0x7fc6a4004850 2024-05-10T04:22:11.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.399+0000 7fc6c5400700 1 -- 172.21.15.80:0/2170435119 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c0074af0 con 0x7fc6a4004850 2024-05-10T04:22:11.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.403+0000 7fc6b6a00700 1 -- 172.21.15.80:0/2170435119 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fc6ac00f040 con 0x7fc6a4004850 2024-05-10T04:22:11.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.484+0000 7fc6c5400700 1 -- 172.21.15.80:0/2170435119 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc6c006ed80 con 0x7fc6a4004850 2024-05-10T04:22:11.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.492+0000 7fc6b6a00700 1 -- 172.21.15.80:0/2170435119 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc6ac0233f0 con 0x7fc6a4004850 2024-05-10T04:22:11.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.493+0000 7fc6c5400700 1 -- 172.21.15.80:0/2170435119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a4004850 msgr2=0x7fc6c013f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:11.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.493+0000 7fc6c5400700 1 --2- 172.21.15.80:0/2170435119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a4004850 0x7fc6c013f0f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac017a50 tx=0x7fc6ac017d60 comp rx=0 tx=0).stop 2024-05-10T04:22:11.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.493+0000 7fc6c5400700 1 -- 172.21.15.80:0/2170435119 shutdown_connections 2024-05-10T04:22:11.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.493+0000 7fc6c5400700 1 --2- 172.21.15.80:0/2170435119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a4003a00 0x7fc6c013d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:11.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.493+0000 7fc6c5400700 1 --2- 172.21.15.80:0/2170435119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a40053d0 0x7fc6c013cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:11.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.493+0000 7fc6c5400700 1 --2- 172.21.15.80:0/2170435119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a4004850 0x7fc6c013f0f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:11.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.493+0000 7fc6c5400700 1 -- 172.21.15.80:0/2170435119 >> 172.21.15.80:0/2170435119 conn(0x7fc6c00b1830 msgr2=0x7fc6c00d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:11.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.493+0000 7fc6c5400700 1 -- 172.21.15.80:0/2170435119 shutdown_connections 2024-05-10T04:22:11.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:11.493+0000 7fc6c5400700 1 -- 172.21.15.80:0/2170435119 wait complete. 2024-05-10T04:22:11.496 INFO:teuthology.orchestra.run.smithi080.stderr:adjusted tunables profile to default 2024-05-10T04:22:11.521 INFO:tasks.ceph:check_enable_crimson: False 2024-05-10T04:22:11.521 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-10T04:22:11.521 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:22:11.521 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-10T04:22:11.590 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:22:11.590 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-10T04:22:11.702 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:22:11.702 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-10T04:22:11.813 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:22:11.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-10T04:22:11.898 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:11.897+0000 7f38d48cd200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T04:22:11.921 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:22:11.921 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-10T04:22:11.995 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:22:11.995 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-10T04:22:12.002 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:12.001+0000 7f38d48cd200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T04:22:12.069 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:22:12.069 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-10T04:22:12.100 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:12.099+0000 7f38d48cd200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T04:22:12.176 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:22:12.177 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-10T04:22:12.208 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:12.207+0000 7f38d48cd200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T04:22:12.274 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 8ea50853-2dac-4082-82e4-e7a7f31edcbd 0 2024-05-10T04:22:12.454 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:12.453+0000 7f38d48cd200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T04:22:12.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.589+0000 7fe958c00700 1 Processor -- start 2024-05-10T04:22:12.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.589+0000 7fe958c00700 1 -- start start 2024-05-10T04:22:12.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.591+0000 7fe958c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe954162150 0x7fe95415e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:12.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.591+0000 7fe958c00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe9540cf4d0 0x7fe9540b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:12.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.591+0000 7fe958c00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe9540b7910 0x7fe95406c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:12.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.591+0000 7fe958c00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9540d2c00 con 0x7fe9540b7910 2024-05-10T04:22:12.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.591+0000 7fe958c00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe954162630 con 0x7fe9540cf4d0 2024-05-10T04:22:12.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.591+0000 7fe958c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe954162910 con 0x7fe954162150 2024-05-10T04:22:12.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.591+0000 7fe951e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe954162150 0x7fe95415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:12.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.591+0000 7fe951400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe9540cf4d0 0x7fe9540b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:12.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.592+0000 7fe951e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe954162150 0x7fe95415e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:48570/0 (socket says 172.21.15.106:48570) 2024-05-10T04:22:12.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.592+0000 7fe951e00700 1 -- 172.21.15.106:0/2558473942 learned_addr learned my addr 172.21.15.106:0/2558473942 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T04:22:12.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.592+0000 7fe952800700 1 --2- 172.21.15.106:0/2558473942 >> v2:172.21.15.80:3300/0 conn(0x7fe9540b7910 0x7fe95406c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:12.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.592+0000 7fe951400700 1 -- 172.21.15.106:0/2558473942 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe954162150 msgr2=0x7fe95415e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:12.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.592+0000 7fe951400700 1 --2- 172.21.15.106:0/2558473942 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe954162150 0x7fe95415e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:12.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.592+0000 7fe951400700 1 -- 172.21.15.106:0/2558473942 >> v2:172.21.15.80:3300/0 conn(0x7fe9540b7910 msgr2=0x7fe95406c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:12.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.592+0000 7fe951400700 1 --2- 172.21.15.106:0/2558473942 >> v2:172.21.15.80:3300/0 conn(0x7fe9540b7910 0x7fe95406c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:12.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.592+0000 7fe951400700 1 -- 172.21.15.106:0/2558473942 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe954162bf0 con 0x7fe9540cf4d0 2024-05-10T04:22:12.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.592+0000 7fe951e00700 1 --2- 172.21.15.106:0/2558473942 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe954162150 0x7fe95415e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:12.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.592+0000 7fe951400700 1 --2- 172.21.15.106:0/2558473942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9540cf4d0 0x7fe9540b73d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe95404f600 tx=0x7fe940009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3a91f88da09b29d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:12.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.592+0000 7fe950a00700 1 -- 172.21.15.106:0/2558473942 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe940011830 con 0x7fe9540cf4d0 2024-05-10T04:22:12.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.593+0000 7fe950a00700 1 -- 172.21.15.106:0/2558473942 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe940011990 con 0x7fe9540cf4d0 2024-05-10T04:22:12.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.593+0000 7fe950a00700 1 -- 172.21.15.106:0/2558473942 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe940011d20 con 0x7fe9540cf4d0 2024-05-10T04:22:12.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.593+0000 7fe958c00700 1 -- 172.21.15.106:0/2558473942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9540cf4d0 msgr2=0x7fe9540b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:12.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.593+0000 7fe958c00700 1 --2- 172.21.15.106:0/2558473942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9540cf4d0 0x7fe9540b73d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe95404f600 tx=0x7fe940009b20 comp rx=0 tx=0).stop 2024-05-10T04:22:12.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.593+0000 7fe958c00700 1 -- 172.21.15.106:0/2558473942 shutdown_connections 2024-05-10T04:22:12.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.593+0000 7fe958c00700 1 --2- 172.21.15.106:0/2558473942 >> v2:172.21.15.80:3300/0 conn(0x7fe9540b7910 0x7fe95406c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:12.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.593+0000 7fe958c00700 1 --2- 172.21.15.106:0/2558473942 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe954162150 0x7fe95415e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:12.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.593+0000 7fe958c00700 1 --2- 172.21.15.106:0/2558473942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9540cf4d0 0x7fe9540b73d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:12.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.593+0000 7fe958c00700 1 -- 172.21.15.106:0/2558473942 >> 172.21.15.106:0/2558473942 conn(0x7fe9540d3e10 msgr2=0x7fe9540d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:12.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.594+0000 7fe958c00700 1 -- 172.21.15.106:0/2558473942 shutdown_connections 2024-05-10T04:22:12.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.594+0000 7fe958c00700 1 -- 172.21.15.106:0/2558473942 wait complete. 2024-05-10T04:22:12.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.596+0000 7fe958c00700 1 Processor -- start 2024-05-10T04:22:12.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.596+0000 7fe958c00700 1 -- start start 2024-05-10T04:22:12.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.598+0000 7fe958c00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9540b7910 0x7fe9541614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:12.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.598+0000 7fe958c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9540cf4d0 0x7fe9541f8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:12.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.598+0000 7fe958c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe954162150 0x7fe9540c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:12.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.598+0000 7fe958c00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe954160ac0 con 0x7fe954162150 2024-05-10T04:22:12.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.598+0000 7fe958c00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe954150b70 con 0x7fe9540b7910 2024-05-10T04:22:12.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.598+0000 7fe958c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9541f8af0 con 0x7fe9540cf4d0 2024-05-10T04:22:12.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.598+0000 7fe951400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9540cf4d0 0x7fe9541f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:12.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.598+0000 7fe951e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9540b7910 0x7fe9541614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:12.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.598+0000 7fe951e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9540b7910 0x7fe9541614d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53332/0 (socket says 172.21.15.106:53332) 2024-05-10T04:22:12.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.598+0000 7fe951e00700 1 -- 172.21.15.106:0/12220885 learned_addr learned my addr 172.21.15.106:0/12220885 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T04:22:12.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.598+0000 7fe952800700 1 --2- 172.21.15.106:0/12220885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe954162150 0x7fe9540c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:12.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.598+0000 7fe951400700 1 -- 172.21.15.106:0/12220885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9540b7910 msgr2=0x7fe9541614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:12.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.598+0000 7fe951400700 1 --2- 172.21.15.106:0/12220885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9540b7910 0x7fe9541614d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:12.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.598+0000 7fe951400700 1 -- 172.21.15.106:0/12220885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe954162150 msgr2=0x7fe9540c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:12.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.598+0000 7fe951400700 1 --2- 172.21.15.106:0/12220885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe954162150 0x7fe9540c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:12.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.598+0000 7fe951400700 1 -- 172.21.15.106:0/12220885 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe944009550 con 0x7fe9540cf4d0 2024-05-10T04:22:12.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.598+0000 7fe951e00700 1 --2- 172.21.15.106:0/12220885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9540b7910 0x7fe9541614d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:12.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.599+0000 7fe951400700 1 --2- 172.21.15.106:0/12220885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9540cf4d0 0x7fe9541f8280 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe940016000 tx=0x7fe940004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:12.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.599+0000 7fe94a000700 1 -- 172.21.15.106:0/12220885 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe940004510 con 0x7fe9540cf4d0 2024-05-10T04:22:12.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.599+0000 7fe94a000700 1 -- 172.21.15.106:0/12220885 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94001e070 con 0x7fe9540cf4d0 2024-05-10T04:22:12.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.599+0000 7fe958c00700 1 -- 172.21.15.106:0/12220885 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9400094a0 con 0x7fe9540cf4d0 2024-05-10T04:22:12.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.599+0000 7fe94a000700 1 -- 172.21.15.106:0/12220885 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9400038e0 con 0x7fe9540cf4d0 2024-05-10T04:22:12.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.599+0000 7fe958c00700 1 -- 172.21.15.106:0/12220885 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9541f8d40 con 0x7fe9540cf4d0 2024-05-10T04:22:12.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.600+0000 7fe94a000700 1 -- 172.21.15.106:0/12220885 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe940003d40 con 0x7fe9540cf4d0 2024-05-10T04:22:12.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.600+0000 7fe94a000700 1 -- 172.21.15.106:0/12220885 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe94001abf0 con 0x7fe9540cf4d0 2024-05-10T04:22:12.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.600+0000 7fe958c00700 1 -- 172.21.15.106:0/12220885 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe954161320 con 0x7fe9540cf4d0 2024-05-10T04:22:12.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.604+0000 7fe94a000700 1 -- 172.21.15.106:0/12220885 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fe940020070 con 0x7fe9540cf4d0 2024-05-10T04:22:12.635 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:12.634+0000 7f9d1303c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T04:22:12.673 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:12.672+0000 7f38d48cd200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T04:22:12.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.692+0000 7fe958c00700 1 -- 172.21.15.106:0/12220885 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8ea50853-2dac-4082-82e4-e7a7f31edcbd", "id": 0} v 0) v1 -- 0x7fe9540b69b0 con 0x7fe9540cf4d0 2024-05-10T04:22:12.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.701+0000 7fe94a000700 1 -- 172.21.15.106:0/12220885 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8ea50853-2dac-4082-82e4-e7a7f31edcbd", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe940015020 con 0x7fe9540cf4d0 2024-05-10T04:22:12.703 INFO:teuthology.orchestra.run.smithi106.stdout:0 2024-05-10T04:22:12.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.702+0000 7fe958c00700 1 -- 172.21.15.106:0/12220885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9540cf4d0 msgr2=0x7fe9541f8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:12.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.702+0000 7fe958c00700 1 --2- 172.21.15.106:0/12220885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9540cf4d0 0x7fe9541f8280 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe940016000 tx=0x7fe940004750 comp rx=0 tx=0).stop 2024-05-10T04:22:12.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.702+0000 7fe958c00700 1 -- 172.21.15.106:0/12220885 shutdown_connections 2024-05-10T04:22:12.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.703+0000 7fe958c00700 1 --2- 172.21.15.106:0/12220885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe954162150 0x7fe9540c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:12.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.703+0000 7fe958c00700 1 --2- 172.21.15.106:0/12220885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9540b7910 0x7fe9541614d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:12.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.703+0000 7fe958c00700 1 --2- 172.21.15.106:0/12220885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9540cf4d0 0x7fe9541f8280 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:12.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.703+0000 7fe958c00700 1 -- 172.21.15.106:0/12220885 >> 172.21.15.106:0/12220885 conn(0x7fe9540d3e10 msgr2=0x7fe954158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:12.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.703+0000 7fe958c00700 1 -- 172.21.15.106:0/12220885 shutdown_connections 2024-05-10T04:22:12.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.703+0000 7fe958c00700 1 -- 172.21.15.106:0/12220885 wait complete. 2024-05-10T04:22:12.730 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new bae4dbab-b1ed-442e-bac8-0316117f1026 1 2024-05-10T04:22:12.737 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:12.736+0000 7f9d1303c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T04:22:12.822 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:12.820+0000 7f38d48cd200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T04:22:12.830 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:12.829+0000 7f9d1303c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T04:22:12.922 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:12.921+0000 7f9d1303c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T04:22:12.948 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:12.946+0000 7f38d48cd200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T04:22:12.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.987+0000 7f5d94c00700 1 Processor -- start 2024-05-10T04:22:12.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.987+0000 7f5d94c00700 1 -- start start 2024-05-10T04:22:12.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.989+0000 7f5d94c00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5d9015bfd0 0x7f5d900d3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:12.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.989+0000 7f5d94c00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5d900d09a0 0x7f5d900d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:12.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.989+0000 7f5d94c00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d900d12f0 con 0x7f5d9015e880 2024-05-10T04:22:12.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.989+0000 7f5d94c00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d9015f3a0 con 0x7f5d9015bfd0 2024-05-10T04:22:12.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.989+0000 7f5d94c00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d900d2840 con 0x7f5d900d09a0 2024-05-10T04:22:12.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.989+0000 7f5d8ea00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5d900d09a0 0x7f5d900d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:12.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.989+0000 7f5d8ea00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5d900d09a0 0x7f5d900d0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53336/0 (socket says 172.21.15.106:53336) 2024-05-10T04:22:12.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.989+0000 7f5d8ea00700 1 -- 172.21.15.106:0/2667671167 learned_addr learned my addr 172.21.15.106:0/2667671167 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T04:22:12.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.990+0000 7f5d8f400700 1 --2- 172.21.15.106:0/2667671167 >> v2:172.21.15.80:3300/0 conn(0x7f5d9015bfd0 0x7f5d900d3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:12.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.990+0000 7f5d8ea00700 1 -- 172.21.15.106:0/2667671167 >> v2:172.21.15.80:3300/0 conn(0x7f5d9015bfd0 msgr2=0x7f5d900d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:12.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.990+0000 7f5d8ea00700 1 --2- 172.21.15.106:0/2667671167 >> v2:172.21.15.80:3300/0 conn(0x7f5d9015bfd0 0x7f5d900d3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:12.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.990+0000 7f5d8ea00700 1 -- 172.21.15.106:0/2667671167 >> v1:172.21.15.80:6789/0 conn(0x7f5d9015e880 legacy=0x7f5d9015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:12.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.990+0000 7f5d8ea00700 1 -- 172.21.15.106:0/2667671167 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9015f620 con 0x7f5d900d09a0 2024-05-10T04:22:12.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.990+0000 7f5d8ea00700 1 --2- 172.21.15.106:0/2667671167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900d09a0 0x7f5d900d0db0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5d900d2480 tx=0x7f5d7c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3fb069d1af599e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:12.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.990+0000 7f5d8e000700 1 -- 172.21.15.106:0/2667671167 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c00b870 con 0x7f5d900d09a0 2024-05-10T04:22:12.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.990+0000 7f5d8e000700 1 -- 172.21.15.106:0/2667671167 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c00b9d0 con 0x7f5d900d09a0 2024-05-10T04:22:12.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.990+0000 7f5d8e000700 1 -- 172.21.15.106:0/2667671167 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c00bd60 con 0x7f5d900d09a0 2024-05-10T04:22:12.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.991+0000 7f5d94c00700 1 -- 172.21.15.106:0/2667671167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900d09a0 msgr2=0x7f5d900d0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:12.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.991+0000 7f5d94c00700 1 --2- 172.21.15.106:0/2667671167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900d09a0 0x7f5d900d0db0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5d900d2480 tx=0x7f5d7c009bd0 comp rx=0 tx=0).stop 2024-05-10T04:22:12.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.991+0000 7f5d94c00700 1 -- 172.21.15.106:0/2667671167 shutdown_connections 2024-05-10T04:22:12.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.991+0000 7f5d94c00700 1 --2- 172.21.15.106:0/2667671167 >> v2:172.21.15.80:3300/0 conn(0x7f5d9015bfd0 0x7f5d900d3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:12.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.991+0000 7f5d94c00700 1 --2- 172.21.15.106:0/2667671167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900d09a0 0x7f5d900d0db0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:12.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.991+0000 7f5d94c00700 1 -- 172.21.15.106:0/2667671167 >> 172.21.15.106:0/2667671167 conn(0x7f5d9006c4e0 msgr2=0x7f5d9006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:12.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.991+0000 7f5d94c00700 1 -- 172.21.15.106:0/2667671167 shutdown_connections 2024-05-10T04:22:12.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.991+0000 7f5d94c00700 1 -- 172.21.15.106:0/2667671167 wait complete. 2024-05-10T04:22:12.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.994+0000 7f5d94c00700 1 Processor -- start 2024-05-10T04:22:12.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.994+0000 7f5d94c00700 1 -- start start 2024-05-10T04:22:12.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.995+0000 7f5d94c00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900d09a0 0x7f5d900b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:12.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.995+0000 7f5d94c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d9015bfd0 0x7f5d90153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:12.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.995+0000 7f5d94c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d9015e880 0x7f5d90159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:12.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.995+0000 7f5d94c00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900b3a50 con 0x7f5d9015e880 2024-05-10T04:22:12.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.995+0000 7f5d94c00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900b3bf0 con 0x7f5d900d09a0 2024-05-10T04:22:12.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.995+0000 7f5d94c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d90159980 con 0x7f5d9015bfd0 2024-05-10T04:22:12.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.995+0000 7f5d8f400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900d09a0 0x7f5d900b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:12.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.995+0000 7f5d8ea00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d9015bfd0 0x7f5d90153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:12.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.995+0000 7f5d8f400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900d09a0 0x7f5d900b3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53342/0 (socket says 172.21.15.106:53342) 2024-05-10T04:22:12.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.995+0000 7f5d8f400700 1 -- 172.21.15.106:0/777814364 learned_addr learned my addr 172.21.15.106:0/777814364 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T04:22:12.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.996+0000 7f5d8fe00700 1 --2- 172.21.15.106:0/777814364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d9015e880 0x7f5d90159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:12.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.996+0000 7f5d8f400700 1 -- 172.21.15.106:0/777814364 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d9015bfd0 msgr2=0x7f5d90153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:12.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.996+0000 7f5d8f400700 1 --2- 172.21.15.106:0/777814364 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d9015bfd0 0x7f5d90153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:12.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.996+0000 7f5d8f400700 1 -- 172.21.15.106:0/777814364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d9015e880 msgr2=0x7f5d90159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:12.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.996+0000 7f5d8f400700 1 --2- 172.21.15.106:0/777814364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d9015e880 0x7f5d90159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:12.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.996+0000 7f5d8f400700 1 -- 172.21.15.106:0/777814364 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c009550 con 0x7f5d900d09a0 2024-05-10T04:22:12.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.996+0000 7f5d8ea00700 1 --2- 172.21.15.106:0/777814364 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d9015bfd0 0x7f5d90153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:12.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.996+0000 7f5d8f400700 1 --2- 172.21.15.106:0/777814364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900d09a0 0x7f5d900b3510 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5d8000d860 tx=0x7f5d8000db70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:12.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.996+0000 7f5d87400700 1 -- 172.21.15.106:0/777814364 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800125f0 con 0x7f5d900d09a0 2024-05-10T04:22:12.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.996+0000 7f5d87400700 1 -- 172.21.15.106:0/777814364 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d80012750 con 0x7f5d900d09a0 2024-05-10T04:22:12.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.996+0000 7f5d94c00700 1 -- 172.21.15.106:0/777814364 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d90153770 con 0x7f5d900d09a0 2024-05-10T04:22:12.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.996+0000 7f5d87400700 1 -- 172.21.15.106:0/777814364 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d80012b00 con 0x7f5d900d09a0 2024-05-10T04:22:12.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.997+0000 7f5d94c00700 1 -- 172.21.15.106:0/777814364 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d90154ce0 con 0x7f5d900d09a0 2024-05-10T04:22:13.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.997+0000 7f5d87400700 1 -- 172.21.15.106:0/777814364 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5d80013480 con 0x7f5d900d09a0 2024-05-10T04:22:13.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.997+0000 7f5d87400700 1 -- 172.21.15.106:0/777814364 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f5d8001da10 con 0x7f5d900d09a0 2024-05-10T04:22:13.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:12.998+0000 7f5d94c00700 1 -- 172.21.15.106:0/777814364 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d90074af0 con 0x7f5d900d09a0 2024-05-10T04:22:13.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.000+0000 7f5d87400700 1 -- 172.21.15.106:0/777814364 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f5d8001dbd0 con 0x7f5d900d09a0 2024-05-10T04:22:13.052 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:13.050+0000 7f38d48cd200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T04:22:13.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.090+0000 7f5d94c00700 1 -- 172.21.15.106:0/777814364 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bae4dbab-b1ed-442e-bac8-0316117f1026", "id": 1} v 0) v1 -- 0x7f5d900b6a90 con 0x7f5d900d09a0 2024-05-10T04:22:13.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.099+0000 7f5d87400700 1 -- 172.21.15.106:0/777814364 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bae4dbab-b1ed-442e-bac8-0316117f1026", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5d8001de40 con 0x7f5d900d09a0 2024-05-10T04:22:13.101 INFO:teuthology.orchestra.run.smithi106.stdout:1 2024-05-10T04:22:13.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.100+0000 7f5d94c00700 1 -- 172.21.15.106:0/777814364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900d09a0 msgr2=0x7f5d900b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:13.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.100+0000 7f5d94c00700 1 --2- 172.21.15.106:0/777814364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900d09a0 0x7f5d900b3510 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5d8000d860 tx=0x7f5d8000db70 comp rx=0 tx=0).stop 2024-05-10T04:22:13.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.100+0000 7f5d94c00700 1 -- 172.21.15.106:0/777814364 shutdown_connections 2024-05-10T04:22:13.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.100+0000 7f5d94c00700 1 --2- 172.21.15.106:0/777814364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d9015e880 0x7f5d90159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.100+0000 7f5d94c00700 1 --2- 172.21.15.106:0/777814364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900d09a0 0x7f5d900b3510 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.100+0000 7f5d94c00700 1 --2- 172.21.15.106:0/777814364 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d9015bfd0 0x7f5d90153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.100+0000 7f5d94c00700 1 -- 172.21.15.106:0/777814364 >> 172.21.15.106:0/777814364 conn(0x7f5d9006c4e0 msgr2=0x7f5d9015ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:13.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.101+0000 7f5d94c00700 1 -- 172.21.15.106:0/777814364 shutdown_connections 2024-05-10T04:22:13.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.101+0000 7f5d94c00700 1 -- 172.21.15.106:0/777814364 wait complete. 2024-05-10T04:22:13.128 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new c09be638-0a47-46f6-960d-cf120a06e596 2 2024-05-10T04:22:13.140 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:13.139+0000 7f9d1303c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T04:22:13.349 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:13.348+0000 7f9d1303c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T04:22:13.351 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:13.350+0000 7f38d48cd200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T04:22:13.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.422+0000 7fd263000700 1 Processor -- start 2024-05-10T04:22:13.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.422+0000 7fd263000700 1 -- start start 2024-05-10T04:22:13.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.424+0000 7fd263000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd25c162150 0x7fd25c15e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:13.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.424+0000 7fd263000700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd25c0cf4d0 0x7fd25c0b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:13.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.424+0000 7fd263000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd25c0b7910 0x7fd25c06c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:13.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.424+0000 7fd263000700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25c0d2c00 con 0x7fd25c162150 2024-05-10T04:22:13.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.424+0000 7fd263000700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25c162630 con 0x7fd25c0cf4d0 2024-05-10T04:22:13.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.424+0000 7fd263000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c162910 con 0x7fd25c0b7910 2024-05-10T04:22:13.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.425+0000 7fd261000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd25c0b7910 0x7fd25c06c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:13.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.425+0000 7fd25b400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd25c0cf4d0 0x7fd25c0b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:13.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.425+0000 7fd261000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd25c0b7910 0x7fd25c06c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:48596/0 (socket says 172.21.15.106:48596) 2024-05-10T04:22:13.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.425+0000 7fd25b400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd25c0cf4d0 0x7fd25c0b73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53350/0 (socket says 172.21.15.106:53350) 2024-05-10T04:22:13.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.425+0000 7fd261000700 1 -- 172.21.15.106:0/1513680129 learned_addr learned my addr 172.21.15.106:0/1513680129 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T04:22:13.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.425+0000 7fd25be00700 1 --2- 172.21.15.106:0/1513680129 >> v2:172.21.15.80:3300/0 conn(0x7fd25c162150 0x7fd25c15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:13.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.425+0000 7fd261000700 1 -- 172.21.15.106:0/1513680129 >> v2:172.21.15.106:3300/0 conn(0x7fd25c0cf4d0 msgr2=0x7fd25c0b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:13.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.425+0000 7fd261000700 1 --2- 172.21.15.106:0/1513680129 >> v2:172.21.15.106:3300/0 conn(0x7fd25c0cf4d0 0x7fd25c0b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.425+0000 7fd261000700 1 -- 172.21.15.106:0/1513680129 >> v2:172.21.15.80:3300/0 conn(0x7fd25c162150 msgr2=0x7fd25c15e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:13.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.425+0000 7fd261000700 1 --2- 172.21.15.106:0/1513680129 >> v2:172.21.15.80:3300/0 conn(0x7fd25c162150 0x7fd25c15e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.425+0000 7fd261000700 1 -- 172.21.15.106:0/1513680129 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25c162bf0 con 0x7fd25c0b7910 2024-05-10T04:22:13.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.425+0000 7fd261000700 1 --2- 172.21.15.106:0/1513680129 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd25c0b7910 0x7fd25c06c160 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd254009e50 tx=0x7fd25400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6cc7de4db8b09d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:13.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.426+0000 7fd25aa00700 1 -- 172.21.15.106:0/1513680129 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25400e070 con 0x7fd25c0b7910 2024-05-10T04:22:13.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.426+0000 7fd25aa00700 1 -- 172.21.15.106:0/1513680129 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25400b8d0 con 0x7fd25c0b7910 2024-05-10T04:22:13.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.426+0000 7fd25aa00700 1 -- 172.21.15.106:0/1513680129 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25400bc80 con 0x7fd25c0b7910 2024-05-10T04:22:13.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.426+0000 7fd263000700 1 -- 172.21.15.106:0/1513680129 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd25c0b7910 msgr2=0x7fd25c06c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:13.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.426+0000 7fd263000700 1 --2- 172.21.15.106:0/1513680129 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd25c0b7910 0x7fd25c06c160 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd254009e50 tx=0x7fd25400b330 comp rx=0 tx=0).stop 2024-05-10T04:22:13.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.427+0000 7fd263000700 1 -- 172.21.15.106:0/1513680129 shutdown_connections 2024-05-10T04:22:13.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.427+0000 7fd263000700 1 --2- 172.21.15.106:0/1513680129 >> v2:172.21.15.80:3300/0 conn(0x7fd25c162150 0x7fd25c15e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.427+0000 7fd263000700 1 --2- 172.21.15.106:0/1513680129 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd25c0b7910 0x7fd25c06c160 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.427+0000 7fd263000700 1 --2- 172.21.15.106:0/1513680129 >> v2:172.21.15.106:3300/0 conn(0x7fd25c0cf4d0 0x7fd25c0b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.427+0000 7fd263000700 1 -- 172.21.15.106:0/1513680129 >> 172.21.15.106:0/1513680129 conn(0x7fd25c0d3e10 msgr2=0x7fd25c0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:13.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.427+0000 7fd263000700 1 -- 172.21.15.106:0/1513680129 shutdown_connections 2024-05-10T04:22:13.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.427+0000 7fd263000700 1 -- 172.21.15.106:0/1513680129 wait complete. 2024-05-10T04:22:13.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.429+0000 7fd263000700 1 Processor -- start 2024-05-10T04:22:13.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.429+0000 7fd263000700 1 -- start start 2024-05-10T04:22:13.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.430+0000 7fd263000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd25c0b7910 0x7fd25c1f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:13.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.430+0000 7fd263000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd25c0cf4d0 0x7fd25c0c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:13.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.430+0000 7fd263000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd25c162150 0x7fd25c148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:13.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.430+0000 7fd263000700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c1f5430 con 0x7fd25c0b7910 2024-05-10T04:22:13.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.430+0000 7fd263000700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c147380 con 0x7fd25c162150 2024-05-10T04:22:13.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.430+0000 7fd263000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c147660 con 0x7fd25c0cf4d0 2024-05-10T04:22:13.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.431+0000 7fd261000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd25c162150 0x7fd25c148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:13.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.431+0000 7fd25b400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd25c0cf4d0 0x7fd25c0c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:13.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.431+0000 7fd25be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd25c0b7910 0x7fd25c1f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:13.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.431+0000 7fd25be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd25c0b7910 0x7fd25c1f4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.106:33428/0 (socket says 172.21.15.106:33428) 2024-05-10T04:22:13.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.431+0000 7fd25be00700 1 -- 172.21.15.106:0/2709278084 learned_addr learned my addr 172.21.15.106:0/2709278084 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T04:22:13.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.431+0000 7fd25b400700 1 -- 172.21.15.106:0/2709278084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd25c162150 msgr2=0x7fd25c148420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:13.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.431+0000 7fd25b400700 1 --2- 172.21.15.106:0/2709278084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd25c162150 0x7fd25c148420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.431+0000 7fd25b400700 1 -- 172.21.15.106:0/2709278084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd25c0b7910 msgr2=0x7fd25c1f4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:13.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.431+0000 7fd25b400700 1 --2- 172.21.15.106:0/2709278084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd25c0b7910 0x7fd25c1f4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.431+0000 7fd25b400700 1 -- 172.21.15.106:0/2709278084 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd254009b30 con 0x7fd25c0cf4d0 2024-05-10T04:22:13.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.431+0000 7fd261000700 1 --2- 172.21.15.106:0/2709278084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd25c162150 0x7fd25c148420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:13.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.432+0000 7fd25b400700 1 --2- 172.21.15.106:0/2709278084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd25c0cf4d0 0x7fd25c0c6660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd24800e840 tx=0x7fd24800eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:13.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.432+0000 7fd253e00700 1 -- 172.21.15.106:0/2709278084 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248013680 con 0x7fd25c0cf4d0 2024-05-10T04:22:13.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.432+0000 7fd253e00700 1 -- 172.21.15.106:0/2709278084 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2480137e0 con 0x7fd25c0cf4d0 2024-05-10T04:22:13.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.432+0000 7fd263000700 1 -- 172.21.15.106:0/2709278084 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25c147940 con 0x7fd25c0cf4d0 2024-05-10T04:22:13.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.432+0000 7fd253e00700 1 -- 172.21.15.106:0/2709278084 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248013b70 con 0x7fd25c0cf4d0 2024-05-10T04:22:13.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.432+0000 7fd263000700 1 -- 172.21.15.106:0/2709278084 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25c147f00 con 0x7fd25c0cf4d0 2024-05-10T04:22:13.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.432+0000 7fd253e00700 1 -- 172.21.15.106:0/2709278084 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd248005a20 con 0x7fd25c0cf4d0 2024-05-10T04:22:13.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.432+0000 7fd253e00700 1 -- 172.21.15.106:0/2709278084 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fd2480067a0 con 0x7fd25c0cf4d0 2024-05-10T04:22:13.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.433+0000 7fd263000700 1 -- 172.21.15.106:0/2709278084 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25c074af0 con 0x7fd25c0cf4d0 2024-05-10T04:22:13.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.436+0000 7fd253e00700 1 -- 172.21.15.106:0/2709278084 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fd248021060 con 0x7fd25c0cf4d0 2024-05-10T04:22:13.451 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:13.450+0000 7f38d48cd200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T04:22:13.487 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:13.486+0000 7f9d1303c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T04:22:13.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.525+0000 7fd263000700 1 -- 172.21.15.106:0/2709278084 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c09be638-0a47-46f6-960d-cf120a06e596", "id": 2} v 0) v1 -- 0x7fd25c161ec0 con 0x7fd25c0cf4d0 2024-05-10T04:22:13.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.534+0000 7fd253e00700 1 -- 172.21.15.106:0/2709278084 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c09be638-0a47-46f6-960d-cf120a06e596", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd248017070 con 0x7fd25c0cf4d0 2024-05-10T04:22:13.535 INFO:teuthology.orchestra.run.smithi106.stdout:2 2024-05-10T04:22:13.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.535+0000 7fd263000700 1 -- 172.21.15.106:0/2709278084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd25c0cf4d0 msgr2=0x7fd25c0c6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:13.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.535+0000 7fd263000700 1 --2- 172.21.15.106:0/2709278084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd25c0cf4d0 0x7fd25c0c6660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd24800e840 tx=0x7fd24800eb50 comp rx=0 tx=0).stop 2024-05-10T04:22:13.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.535+0000 7fd263000700 1 -- 172.21.15.106:0/2709278084 shutdown_connections 2024-05-10T04:22:13.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.535+0000 7fd263000700 1 --2- 172.21.15.106:0/2709278084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd25c0b7910 0x7fd25c1f4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.535+0000 7fd263000700 1 --2- 172.21.15.106:0/2709278084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd25c162150 0x7fd25c148420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.535+0000 7fd263000700 1 --2- 172.21.15.106:0/2709278084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd25c0cf4d0 0x7fd25c0c6660 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.535+0000 7fd263000700 1 -- 172.21.15.106:0/2709278084 >> 172.21.15.106:0/2709278084 conn(0x7fd25c0d3e10 msgr2=0x7fd25c0b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:13.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.535+0000 7fd263000700 1 -- 172.21.15.106:0/2709278084 shutdown_connections 2024-05-10T04:22:13.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.535+0000 7fd263000700 1 -- 172.21.15.106:0/2709278084 wait complete. 2024-05-10T04:22:13.562 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 4ea63c20-7567-46f3-aa79-fee68b744c43 3 2024-05-10T04:22:13.609 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:13.607+0000 7f9d1303c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T04:22:13.706 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:13.705+0000 7f9d1303c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T04:22:13.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.820+0000 7f14c2000700 1 Processor -- start 2024-05-10T04:22:13.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.820+0000 7f14c2000700 1 -- start start 2024-05-10T04:22:13.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.822+0000 7f14c2000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc158c30 0x7f14bc0b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:13.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.822+0000 7f14c2000700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f14bc15f6a0 0x7f14bc0b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:13.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.822+0000 7f14c2000700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14bc15e970 con 0x7f14bc161fc0 2024-05-10T04:22:13.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.822+0000 7f14c2000700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14bc0cf860 con 0x7f14bc15f6a0 2024-05-10T04:22:13.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.822+0000 7f14c2000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc162c60 con 0x7f14bc158c30 2024-05-10T04:22:13.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.822+0000 7f14baa00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f14bc15f6a0 0x7f14bc0b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:13.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.822+0000 7f14bb400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc158c30 0x7f14bc0b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:13.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.822+0000 7f14baa00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f14bc15f6a0 0x7f14bc0b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53374/0 (socket says 172.21.15.106:53374) 2024-05-10T04:22:13.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.822+0000 7f14bb400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc158c30 0x7f14bc0b58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:48618/0 (socket says 172.21.15.106:48618) 2024-05-10T04:22:13.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.822+0000 7f14baa00700 1 -- 172.21.15.106:0/2230964955 learned_addr learned my addr 172.21.15.106:0/2230964955 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T04:22:13.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.823+0000 7f14baa00700 1 -- 172.21.15.106:0/2230964955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc158c30 msgr2=0x7f14bc0b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:13.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.823+0000 7f14baa00700 1 --2- 172.21.15.106:0/2230964955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc158c30 0x7f14bc0b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.823+0000 7f14baa00700 1 -- 172.21.15.106:0/2230964955 >> v1:172.21.15.80:6789/0 conn(0x7f14bc161fc0 legacy=0x7f14bc1623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:13.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.823+0000 7f14baa00700 1 -- 172.21.15.106:0/2230964955 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc15ebc0 con 0x7f14bc15f6a0 2024-05-10T04:22:13.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.823+0000 7f14bb400700 1 --2- 172.21.15.106:0/2230964955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc158c30 0x7f14bc0b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:13.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.823+0000 7f14baa00700 1 --2- 172.21.15.106:0/2230964955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14bc15f6a0 0x7f14bc0b5e10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f14a80098f0 tx=0x7f14a8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb832147edf2d80e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:13.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.824+0000 7f14ba000700 1 -- 172.21.15.106:0/2230964955 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a8004230 con 0x7f14bc15f6a0 2024-05-10T04:22:13.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.824+0000 7f14ba000700 1 -- 172.21.15.106:0/2230964955 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a8004390 con 0x7f14bc15f6a0 2024-05-10T04:22:13.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.824+0000 7f14ba000700 1 -- 172.21.15.106:0/2230964955 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a80036a0 con 0x7f14bc15f6a0 2024-05-10T04:22:13.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.824+0000 7f14c2000700 1 -- 172.21.15.106:0/2230964955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14bc15f6a0 msgr2=0x7f14bc0b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:13.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.824+0000 7f14c2000700 1 --2- 172.21.15.106:0/2230964955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14bc15f6a0 0x7f14bc0b5e10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f14a80098f0 tx=0x7f14a8009c00 comp rx=0 tx=0).stop 2024-05-10T04:22:13.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.824+0000 7f14c2000700 1 -- 172.21.15.106:0/2230964955 shutdown_connections 2024-05-10T04:22:13.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.824+0000 7f14c2000700 1 --2- 172.21.15.106:0/2230964955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc158c30 0x7f14bc0b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.825+0000 7f14c2000700 1 --2- 172.21.15.106:0/2230964955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14bc15f6a0 0x7f14bc0b5e10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.825+0000 7f14c2000700 1 -- 172.21.15.106:0/2230964955 >> 172.21.15.106:0/2230964955 conn(0x7f14bc0d0ab0 msgr2=0x7f14bc0d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:13.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.825+0000 7f14c2000700 1 -- 172.21.15.106:0/2230964955 shutdown_connections 2024-05-10T04:22:13.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.825+0000 7f14c2000700 1 -- 172.21.15.106:0/2230964955 wait complete. 2024-05-10T04:22:13.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.827+0000 7f14c2000700 1 Processor -- start 2024-05-10T04:22:13.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.827+0000 7f14c2000700 1 -- start start 2024-05-10T04:22:13.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.828+0000 7f14c2000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc158c30 0x7f14bc0c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:13.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.828+0000 7f14c2000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14bc15f6a0 0x7f14bc1e9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:13.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.828+0000 7f14c2000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14bc161fc0 0x7f14bc1ea440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:13.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.828+0000 7f14c2000700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0b62e0 con 0x7f14bc161fc0 2024-05-10T04:22:13.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.828+0000 7f14c2000700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc155ce0 con 0x7f14bc15f6a0 2024-05-10T04:22:13.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.828+0000 7f14c2000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc153620 con 0x7f14bc158c30 2024-05-10T04:22:13.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.829+0000 7f14baa00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14bc15f6a0 0x7f14bc1e9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:13.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.829+0000 7f14bb400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc158c30 0x7f14bc0c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:13.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.829+0000 7f14baa00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14bc15f6a0 0x7f14bc1e9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53380/0 (socket says 172.21.15.106:53380) 2024-05-10T04:22:13.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.829+0000 7f14baa00700 1 -- 172.21.15.106:0/2779966919 learned_addr learned my addr 172.21.15.106:0/2779966919 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T04:22:13.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.829+0000 7f14bbe00700 1 --2- 172.21.15.106:0/2779966919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14bc161fc0 0x7f14bc1ea440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:13.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.829+0000 7f14bb400700 1 -- 172.21.15.106:0/2779966919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14bc15f6a0 msgr2=0x7f14bc1e9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:13.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.829+0000 7f14bb400700 1 --2- 172.21.15.106:0/2779966919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14bc15f6a0 0x7f14bc1e9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.829+0000 7f14bb400700 1 -- 172.21.15.106:0/2779966919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14bc161fc0 msgr2=0x7f14bc1ea440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:13.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.829+0000 7f14bb400700 1 --2- 172.21.15.106:0/2779966919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14bc161fc0 0x7f14bc1ea440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.829+0000 7f14bb400700 1 -- 172.21.15.106:0/2779966919 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac0094a0 con 0x7f14bc158c30 2024-05-10T04:22:13.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.829+0000 7f14bbe00700 1 --2- 172.21.15.106:0/2779966919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14bc161fc0 0x7f14bc1ea440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:13.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.829+0000 7f14baa00700 1 --2- 172.21.15.106:0/2779966919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14bc15f6a0 0x7f14bc1e9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:13.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.829+0000 7f14bb400700 1 --2- 172.21.15.106:0/2779966919 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc158c30 0x7f14bc0c6890 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00e8d0 tx=0x7f14ac00ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:13.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.830+0000 7f14b3400700 1 -- 172.21.15.106:0/2779966919 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00c690 con 0x7f14bc158c30 2024-05-10T04:22:13.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.830+0000 7f14b3400700 1 -- 172.21.15.106:0/2779966919 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac00c7f0 con 0x7f14bc158c30 2024-05-10T04:22:13.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.830+0000 7f14c2000700 1 -- 172.21.15.106:0/2779966919 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a8009550 con 0x7f14bc158c30 2024-05-10T04:22:13.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.830+0000 7f14b3400700 1 -- 172.21.15.106:0/2779966919 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00cb80 con 0x7f14bc158c30 2024-05-10T04:22:13.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.830+0000 7f14c2000700 1 -- 172.21.15.106:0/2779966919 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14bc0c6dd0 con 0x7f14bc158c30 2024-05-10T04:22:13.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.830+0000 7f14b3400700 1 -- 172.21.15.106:0/2779966919 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f14ac005a20 con 0x7f14bc158c30 2024-05-10T04:22:13.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.830+0000 7f14b3400700 1 -- 172.21.15.106:0/2779966919 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f14ac005cd0 con 0x7f14bc158c30 2024-05-10T04:22:13.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.831+0000 7f14c2000700 1 -- 172.21.15.106:0/2779966919 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14bc1547f0 con 0x7f14bc158c30 2024-05-10T04:22:13.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.833+0000 7f14b3400700 1 -- 172.21.15.106:0/2779966919 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f14ac021060 con 0x7f14bc158c30 2024-05-10T04:22:13.917 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:13.916+0000 7f38d48cd200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T04:22:13.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.922+0000 7f14c2000700 1 -- 172.21.15.106:0/2779966919 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4ea63c20-7567-46f3-aa79-fee68b744c43", "id": 3} v 0) v1 -- 0x7f14bc155b20 con 0x7f14bc158c30 2024-05-10T04:22:13.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.933+0000 7f14b3400700 1 -- 172.21.15.106:0/2779966919 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ea63c20-7567-46f3-aa79-fee68b744c43", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f14bc155b20 con 0x7f14bc158c30 2024-05-10T04:22:13.935 INFO:teuthology.orchestra.run.smithi106.stdout:3 2024-05-10T04:22:13.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.934+0000 7f14c2000700 1 -- 172.21.15.106:0/2779966919 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc158c30 msgr2=0x7f14bc0c6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:13.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.934+0000 7f14c2000700 1 --2- 172.21.15.106:0/2779966919 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc158c30 0x7f14bc0c6890 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00e8d0 tx=0x7f14ac00ebe0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.934+0000 7f14c2000700 1 -- 172.21.15.106:0/2779966919 shutdown_connections 2024-05-10T04:22:13.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.935+0000 7f14c2000700 1 --2- 172.21.15.106:0/2779966919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14bc161fc0 0x7f14bc1ea440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.935+0000 7f14c2000700 1 --2- 172.21.15.106:0/2779966919 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc158c30 0x7f14bc0c6890 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.935+0000 7f14c2000700 1 --2- 172.21.15.106:0/2779966919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14bc15f6a0 0x7f14bc1e9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:13.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.935+0000 7f14c2000700 1 -- 172.21.15.106:0/2779966919 >> 172.21.15.106:0/2779966919 conn(0x7f14bc0d0ab0 msgr2=0x7f14bc06c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:13.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.935+0000 7f14c2000700 1 -- 172.21.15.106:0/2779966919 shutdown_connections 2024-05-10T04:22:13.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:13.935+0000 7f14c2000700 1 -- 172.21.15.106:0/2779966919 wait complete. 2024-05-10T04:22:13.963 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 246468bd-b6e2-4307-8f5b-63bbd29df2c8 4 2024-05-10T04:22:13.989 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:13.988+0000 7f9d1303c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T04:22:14.080 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:14.079+0000 7f9d1303c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T04:22:14.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.222+0000 7fd860000700 1 Processor -- start 2024-05-10T04:22:14.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.222+0000 7fd860000700 1 -- start start 2024-05-10T04:22:14.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.224+0000 7fd860000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd85815e610 0x7fd8580b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:14.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.224+0000 7fd860000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd8580b7910 0x7fd85806c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:14.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.224+0000 7fd860000700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8580d2c00 con 0x7fd858162150 2024-05-10T04:22:14.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.224+0000 7fd860000700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85815ea20 con 0x7fd8580b7910 2024-05-10T04:22:14.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.224+0000 7fd860000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd858162630 con 0x7fd85815e610 2024-05-10T04:22:14.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.224+0000 7fd85cc00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd85815e610 0x7fd8580b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:14.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.224+0000 7fd85cc00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd85815e610 0x7fd8580b73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:48648/0 (socket says 172.21.15.106:48648) 2024-05-10T04:22:14.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.224+0000 7fd85cc00700 1 -- 172.21.15.106:0/3980625706 learned_addr learned my addr 172.21.15.106:0/3980625706 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T04:22:14.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.225+0000 7fd85e000700 1 --2- 172.21.15.106:0/3980625706 >> v2:172.21.15.80:3300/0 conn(0x7fd8580b7910 0x7fd85806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:14.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.225+0000 7fd85cc00700 1 -- 172.21.15.106:0/3980625706 >> v2:172.21.15.80:3300/0 conn(0x7fd8580b7910 msgr2=0x7fd85806c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:14.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.225+0000 7fd85cc00700 1 --2- 172.21.15.106:0/3980625706 >> v2:172.21.15.80:3300/0 conn(0x7fd8580b7910 0x7fd85806c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:14.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.225+0000 7fd85cc00700 1 -- 172.21.15.106:0/3980625706 >> v1:172.21.15.80:6789/0 conn(0x7fd858162150 legacy=0x7fd8580cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:14.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.225+0000 7fd85cc00700 1 -- 172.21.15.106:0/3980625706 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd858162910 con 0x7fd85815e610 2024-05-10T04:22:14.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.225+0000 7fd857e00700 1 -- 172.21.15.106:0/3980625706 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808286197 0 0) 0x7fd8580d2c00 con 0x7fd858162150 2024-05-10T04:22:14.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.225+0000 7fd85cc00700 1 --2- 172.21.15.106:0/3980625706 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd85815e610 0x7fd8580b73d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd8440098f0 tx=0x7fd844009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b04c19dbe73dcf9f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:14.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.225+0000 7fd857e00700 1 -- 172.21.15.106:0/3980625706 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd844011830 con 0x7fd85815e610 2024-05-10T04:22:14.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.225+0000 7fd857e00700 1 -- 172.21.15.106:0/3980625706 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd844011990 con 0x7fd85815e610 2024-05-10T04:22:14.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.225+0000 7fd857e00700 1 -- 172.21.15.106:0/3980625706 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd844011d20 con 0x7fd85815e610 2024-05-10T04:22:14.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.226+0000 7fd860000700 1 -- 172.21.15.106:0/3980625706 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd85815e610 msgr2=0x7fd8580b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:14.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.226+0000 7fd860000700 1 --2- 172.21.15.106:0/3980625706 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd85815e610 0x7fd8580b73d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd8440098f0 tx=0x7fd844009c00 comp rx=0 tx=0).stop 2024-05-10T04:22:14.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.226+0000 7fd860000700 1 -- 172.21.15.106:0/3980625706 shutdown_connections 2024-05-10T04:22:14.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.226+0000 7fd860000700 1 --2- 172.21.15.106:0/3980625706 >> v2:172.21.15.80:3300/0 conn(0x7fd8580b7910 0x7fd85806c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:14.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.226+0000 7fd860000700 1 --2- 172.21.15.106:0/3980625706 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd85815e610 0x7fd8580b73d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:14.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.226+0000 7fd860000700 1 -- 172.21.15.106:0/3980625706 >> 172.21.15.106:0/3980625706 conn(0x7fd8580d3e10 msgr2=0x7fd8580d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:14.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.226+0000 7fd860000700 1 -- 172.21.15.106:0/3980625706 shutdown_connections 2024-05-10T04:22:14.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.226+0000 7fd860000700 1 -- 172.21.15.106:0/3980625706 wait complete. 2024-05-10T04:22:14.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.229+0000 7fd860000700 1 Processor -- start 2024-05-10T04:22:14.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.229+0000 7fd860000700 1 -- start start 2024-05-10T04:22:14.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.230+0000 7fd860000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8580b7910 0x7fd8580c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:14.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.230+0000 7fd860000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd85815e610 0x7fd858154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:14.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.230+0000 7fd860000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd858162150 0x7fd858154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:14.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.230+0000 7fd860000700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd858153df0 con 0x7fd8580b7910 2024-05-10T04:22:14.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.230+0000 7fd860000700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd858146380 con 0x7fd85815e610 2024-05-10T04:22:14.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.230+0000 7fd860000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd858152f20 con 0x7fd858162150 2024-05-10T04:22:14.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.230+0000 7fd85cc00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd85815e610 0x7fd858154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:14.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.230+0000 7fd85e000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd858162150 0x7fd858154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:14.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.230+0000 7fd85d600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8580b7910 0x7fd8580c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:14.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.230+0000 7fd85e000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd858162150 0x7fd858154750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:48664/0 (socket says 172.21.15.106:48664) 2024-05-10T04:22:14.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.230+0000 7fd85cc00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd85815e610 0x7fd858154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53394/0 (socket says 172.21.15.106:53394) 2024-05-10T04:22:14.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.230+0000 7fd85e000700 1 -- 172.21.15.106:0/4036354486 learned_addr learned my addr 172.21.15.106:0/4036354486 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T04:22:14.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.231+0000 7fd85cc00700 1 -- 172.21.15.106:0/4036354486 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd858162150 msgr2=0x7fd858154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:14.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.231+0000 7fd85cc00700 1 --2- 172.21.15.106:0/4036354486 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd858162150 0x7fd858154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:14.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.231+0000 7fd85cc00700 1 -- 172.21.15.106:0/4036354486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8580b7910 msgr2=0x7fd8580c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:14.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.231+0000 7fd85cc00700 1 --2- 172.21.15.106:0/4036354486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8580b7910 0x7fd8580c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:14.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.231+0000 7fd85cc00700 1 -- 172.21.15.106:0/4036354486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd844009550 con 0x7fd85815e610 2024-05-10T04:22:14.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.231+0000 7fd85e000700 1 --2- 172.21.15.106:0/4036354486 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd858162150 0x7fd858154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:14.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.231+0000 7fd85cc00700 1 --2- 172.21.15.106:0/4036354486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd85815e610 0x7fd858154210 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd858073340 tx=0x7fd844004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:14.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.231+0000 7fd855600700 1 -- 172.21.15.106:0/4036354486 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd844004510 con 0x7fd85815e610 2024-05-10T04:22:14.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.231+0000 7fd855600700 1 -- 172.21.15.106:0/4036354486 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84401e070 con 0x7fd85815e610 2024-05-10T04:22:14.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.231+0000 7fd860000700 1 -- 172.21.15.106:0/4036354486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd858154c90 con 0x7fd85815e610 2024-05-10T04:22:14.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.232+0000 7fd855600700 1 -- 172.21.15.106:0/4036354486 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8440038e0 con 0x7fd85815e610 2024-05-10T04:22:14.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.232+0000 7fd860000700 1 -- 172.21.15.106:0/4036354486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd858153450 con 0x7fd85815e610 2024-05-10T04:22:14.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.232+0000 7fd855600700 1 -- 172.21.15.106:0/4036354486 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd844003d40 con 0x7fd85815e610 2024-05-10T04:22:14.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.232+0000 7fd855600700 1 -- 172.21.15.106:0/4036354486 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fd84401ac70 con 0x7fd85815e610 2024-05-10T04:22:14.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.233+0000 7fd860000700 1 -- 172.21.15.106:0/4036354486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd858161ec0 con 0x7fd85815e610 2024-05-10T04:22:14.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.236+0000 7fd855600700 1 -- 172.21.15.106:0/4036354486 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fd844032060 con 0x7fd85815e610 2024-05-10T04:22:14.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.321+0000 7fd860000700 1 -- 172.21.15.106:0/4036354486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd new", "uuid": "246468bd-b6e2-4307-8f5b-63bbd29df2c8", "id": 4} v 0) v1 -- 0x7fd8580b3550 con 0x7fd85815e610 2024-05-10T04:22:14.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.328+0000 7fd855600700 1 -- 172.21.15.106:0/4036354486 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "246468bd-b6e2-4307-8f5b-63bbd29df2c8", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd844020070 con 0x7fd85815e610 2024-05-10T04:22:14.329 INFO:teuthology.orchestra.run.smithi106.stdout:4 2024-05-10T04:22:14.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.329+0000 7fd860000700 1 -- 172.21.15.106:0/4036354486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd85815e610 msgr2=0x7fd858154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:14.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.329+0000 7fd860000700 1 --2- 172.21.15.106:0/4036354486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd85815e610 0x7fd858154210 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd858073340 tx=0x7fd844004750 comp rx=0 tx=0).stop 2024-05-10T04:22:14.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.329+0000 7fd860000700 1 -- 172.21.15.106:0/4036354486 shutdown_connections 2024-05-10T04:22:14.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.329+0000 7fd860000700 1 --2- 172.21.15.106:0/4036354486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8580b7910 0x7fd8580c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:14.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.329+0000 7fd860000700 1 --2- 172.21.15.106:0/4036354486 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd858162150 0x7fd858154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:14.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.329+0000 7fd860000700 1 --2- 172.21.15.106:0/4036354486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd85815e610 0x7fd858154210 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:14.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.329+0000 7fd860000700 1 -- 172.21.15.106:0/4036354486 >> 172.21.15.106:0/4036354486 conn(0x7fd8580d3e10 msgr2=0x7fd85815a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:14.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.329+0000 7fd860000700 1 -- 172.21.15.106:0/4036354486 shutdown_connections 2024-05-10T04:22:14.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.329+0000 7fd860000700 1 -- 172.21.15.106:0/4036354486 wait complete. 2024-05-10T04:22:14.347 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:14.346+0000 7f38d48cd200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T04:22:14.355 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 9a570758-5f58-4e32-814d-a26b4844dd85 5 2024-05-10T04:22:14.551 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:14.550+0000 7f9d1303c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T04:22:14.574 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:14.572+0000 7f38d48cd200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T04:22:14.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.624+0000 7feb00600700 1 Processor -- start 2024-05-10T04:22:14.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.624+0000 7feb00600700 1 -- start start 2024-05-10T04:22:14.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.626+0000 7feb00600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaf80af7e0 0x7feaf80afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:14.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.627+0000 7feb00600700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf80b0130 con 0x7feaf815dce0 2024-05-10T04:22:14.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.627+0000 7feb00600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf8099d10 con 0x7feaf815c390 2024-05-10T04:22:14.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.627+0000 7feb00600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf815cc40 con 0x7feaf80af7e0 2024-05-10T04:22:14.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.627+0000 7feafdc00700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7feaf815c390 0x7feaf80b1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:56040/0 (socket says 172.21.15.106:56040) 2024-05-10T04:22:14.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.627+0000 7feafdc00700 1 -- 172.21.15.106:0/2047152099 learned_addr learned my addr 172.21.15.106:0/2047152099 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-05-10T04:22:14.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.627+0000 7feafd200700 1 --2- 172.21.15.106:0/2047152099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaf80af7e0 0x7feaf80afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:14.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.627+0000 7feaf7e00700 1 -- 172.21.15.106:0/2047152099 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112667569 0 0) 0x7feaf8099d10 con 0x7feaf815c390 2024-05-10T04:22:14.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.627+0000 7feaf7e00700 1 -- 172.21.15.106:0/2047152099 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feae00035b0 con 0x7feaf815c390 2024-05-10T04:22:14.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.627+0000 7feafd200700 1 -- 172.21.15.106:0/2047152099 >> v1:172.21.15.106:6789/0 conn(0x7feaf815c390 legacy=0x7feaf80b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:14.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.627+0000 7feafd200700 1 -- 172.21.15.106:0/2047152099 >> v1:172.21.15.80:6789/0 conn(0x7feaf815dce0 legacy=0x7feaf815e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:14.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.627+0000 7feafd200700 1 -- 172.21.15.106:0/2047152099 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf815cf20 con 0x7feaf80af7e0 2024-05-10T04:22:14.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.628+0000 7feafd200700 1 --2- 172.21.15.106:0/2047152099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaf80af7e0 0x7feaf80afbf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feae4009870 tx=0x7feae4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=409dc8edeb6ee607 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:14.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.628+0000 7feaf7e00700 1 -- 172.21.15.106:0/2047152099 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4011830 con 0x7feaf80af7e0 2024-05-10T04:22:14.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.628+0000 7feaf7e00700 1 -- 172.21.15.106:0/2047152099 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae4011990 con 0x7feaf80af7e0 2024-05-10T04:22:14.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.628+0000 7feaf7e00700 1 -- 172.21.15.106:0/2047152099 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4011d20 con 0x7feaf80af7e0 2024-05-10T04:22:14.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.628+0000 7feb00600700 1 -- 172.21.15.106:0/2047152099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaf80af7e0 msgr2=0x7feaf80afbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:14.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.628+0000 7feb00600700 1 --2- 172.21.15.106:0/2047152099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaf80af7e0 0x7feaf80afbf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feae4009870 tx=0x7feae4009b80 comp rx=0 tx=0).stop 2024-05-10T04:22:14.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.629+0000 7feb00600700 1 -- 172.21.15.106:0/2047152099 shutdown_connections 2024-05-10T04:22:14.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.629+0000 7feb00600700 1 --2- 172.21.15.106:0/2047152099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaf80af7e0 0x7feaf80afbf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:14.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.629+0000 7feb00600700 1 -- 172.21.15.106:0/2047152099 >> 172.21.15.106:0/2047152099 conn(0x7feaf8072110 msgr2=0x7feaf80b56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:14.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.629+0000 7feb00600700 1 -- 172.21.15.106:0/2047152099 shutdown_connections 2024-05-10T04:22:14.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.629+0000 7feb00600700 1 -- 172.21.15.106:0/2047152099 wait complete. 2024-05-10T04:22:14.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.631+0000 7feb00600700 1 Processor -- start 2024-05-10T04:22:14.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.631+0000 7feb00600700 1 -- start start 2024-05-10T04:22:14.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.632+0000 7feb00600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feaf80af7e0 0x7feaf8149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:14.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.633+0000 7feb00600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaf815c390 0x7feaf8152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:14.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.633+0000 7feb00600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaf815dce0 0x7feaf80caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:14.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.633+0000 7feb00600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8153240 con 0x7feaf815dce0 2024-05-10T04:22:14.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.633+0000 7feb00600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80c9520 con 0x7feaf80af7e0 2024-05-10T04:22:14.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.633+0000 7feb00600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80c9760 con 0x7feaf815c390 2024-05-10T04:22:14.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.633+0000 7feafdc00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feaf80af7e0 0x7feaf8149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:14.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.633+0000 7feafd200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaf815c390 0x7feaf8152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:14.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.633+0000 7feafdc00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feaf80af7e0 0x7feaf8149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53402/0 (socket says 172.21.15.106:53402) 2024-05-10T04:22:14.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.633+0000 7feafdc00700 1 -- 172.21.15.106:0/3942614450 learned_addr learned my addr 172.21.15.106:0/3942614450 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T04:22:14.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.633+0000 7feafe600700 1 --2- 172.21.15.106:0/3942614450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaf815dce0 0x7feaf80caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:14.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.633+0000 7feafd200700 1 -- 172.21.15.106:0/3942614450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feaf80af7e0 msgr2=0x7feaf8149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:14.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.633+0000 7feafd200700 1 --2- 172.21.15.106:0/3942614450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feaf80af7e0 0x7feaf8149e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:14.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.633+0000 7feafd200700 1 -- 172.21.15.106:0/3942614450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaf815dce0 msgr2=0x7feaf80caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:14.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.633+0000 7feafd200700 1 --2- 172.21.15.106:0/3942614450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaf815dce0 0x7feaf80caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:14.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.633+0000 7feafd200700 1 -- 172.21.15.106:0/3942614450 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae40094a0 con 0x7feaf815c390 2024-05-10T04:22:14.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.633+0000 7feafdc00700 1 --2- 172.21.15.106:0/3942614450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feaf80af7e0 0x7feaf8149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:14.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.634+0000 7feafd200700 1 --2- 172.21.15.106:0/3942614450 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaf815c390 0x7feaf8152750 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feaf8072850 tx=0x7feae4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:14.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.634+0000 7feaf5600700 1 -- 172.21.15.106:0/3942614450 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae40036a0 con 0x7feaf815c390 2024-05-10T04:22:14.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.634+0000 7feaf5600700 1 -- 172.21.15.106:0/3942614450 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae401e070 con 0x7feaf815c390 2024-05-10T04:22:14.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.634+0000 7feaf5600700 1 -- 172.21.15.106:0/3942614450 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4003a40 con 0x7feaf815c390 2024-05-10T04:22:14.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.634+0000 7feb00600700 1 -- 172.21.15.106:0/3942614450 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf80c99b0 con 0x7feaf815c390 2024-05-10T04:22:14.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.634+0000 7feb00600700 1 -- 172.21.15.106:0/3942614450 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf80c9f70 con 0x7feaf815c390 2024-05-10T04:22:14.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.634+0000 7feaf5600700 1 -- 172.21.15.106:0/3942614450 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7feae402d450 con 0x7feaf815c390 2024-05-10T04:22:14.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.634+0000 7feaf5600700 1 -- 172.21.15.106:0/3942614450 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7feae402dc80 con 0x7feaf815c390 2024-05-10T04:22:14.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.635+0000 7feb00600700 1 -- 172.21.15.106:0/3942614450 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf80ca8a0 con 0x7feaf815c390 2024-05-10T04:22:14.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.638+0000 7feaf5600700 1 -- 172.21.15.106:0/3942614450 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7feae4044dc0 con 0x7feaf815c390 2024-05-10T04:22:14.682 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:14.680+0000 7f38d48cd200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T04:22:14.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.724+0000 7feb00600700 1 -- 172.21.15.106:0/3942614450 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9a570758-5f58-4e32-814d-a26b4844dd85", "id": 5} v 0) v1 -- 0x7feaf8074af0 con 0x7feaf815c390 2024-05-10T04:22:14.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.733+0000 7feaf5600700 1 -- 172.21.15.106:0/3942614450 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9a570758-5f58-4e32-814d-a26b4844dd85", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7feae4033070 con 0x7feaf815c390 2024-05-10T04:22:14.734 INFO:teuthology.orchestra.run.smithi106.stdout:5 2024-05-10T04:22:14.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.734+0000 7feb00600700 1 -- 172.21.15.106:0/3942614450 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaf815c390 msgr2=0x7feaf8152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:14.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.734+0000 7feb00600700 1 --2- 172.21.15.106:0/3942614450 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaf815c390 0x7feaf8152750 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feaf8072850 tx=0x7feae4004750 comp rx=0 tx=0).stop 2024-05-10T04:22:14.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.734+0000 7feb00600700 1 -- 172.21.15.106:0/3942614450 shutdown_connections 2024-05-10T04:22:14.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.734+0000 7feb00600700 1 --2- 172.21.15.106:0/3942614450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaf815dce0 0x7feaf80caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:14.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.734+0000 7feb00600700 1 --2- 172.21.15.106:0/3942614450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feaf80af7e0 0x7feaf8149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:14.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.734+0000 7feb00600700 1 --2- 172.21.15.106:0/3942614450 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaf815c390 0x7feaf8152750 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:14.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.734+0000 7feb00600700 1 -- 172.21.15.106:0/3942614450 >> 172.21.15.106:0/3942614450 conn(0x7feaf8072110 msgr2=0x7feaf80b1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:14.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.734+0000 7feb00600700 1 -- 172.21.15.106:0/3942614450 shutdown_connections 2024-05-10T04:22:14.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:14.734+0000 7feb00600700 1 -- 172.21.15.106:0/3942614450 wait complete. 2024-05-10T04:22:14.759 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca 6 2024-05-10T04:22:14.959 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:14.958+0000 7f9d1303c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T04:22:15.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.011+0000 7f26f9600700 1 Processor -- start 2024-05-10T04:22:15.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.011+0000 7f26f9600700 1 -- start start 2024-05-10T04:22:15.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.013+0000 7f26f9600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26f4162150 0x7f26f415e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:15.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.013+0000 7f26f9600700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f40d2c00 con 0x7f26f40cf4d0 2024-05-10T04:22:15.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.013+0000 7f26f9600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f4162630 con 0x7f26f406c160 2024-05-10T04:22:15.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.013+0000 7f26f9600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f4162910 con 0x7f26f4162150 2024-05-10T04:22:15.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.013+0000 7f26f2a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26f4162150 0x7f26f415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:15.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.013+0000 7f26f2a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26f4162150 0x7f26f415e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:48680/0 (socket says 172.21.15.106:48680) 2024-05-10T04:22:15.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.013+0000 7f26f2a00700 1 -- 172.21.15.106:0/3204437710 learned_addr learned my addr 172.21.15.106:0/3204437710 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T04:22:15.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.014+0000 7f26f2a00700 1 -- 172.21.15.106:0/3204437710 >> v1:172.21.15.106:6789/0 conn(0x7f26f406c160 legacy=0x7f26f406c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:15.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.014+0000 7f26f2a00700 1 -- 172.21.15.106:0/3204437710 >> v1:172.21.15.80:6789/0 conn(0x7f26f40cf4d0 legacy=0x7f26f40b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:15.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.014+0000 7f26f2a00700 1 -- 172.21.15.106:0/3204437710 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f4162bf0 con 0x7f26f4162150 2024-05-10T04:22:15.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.014+0000 7f26f2a00700 1 --2- 172.21.15.106:0/3204437710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26f4162150 0x7f26f415e610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009920 tx=0x7f26e4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f2d7243c49d3be2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:15.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.014+0000 7f26f1600700 1 -- 172.21.15.106:0/3204437710 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e400ba60 con 0x7f26f4162150 2024-05-10T04:22:15.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.014+0000 7f26f1600700 1 -- 172.21.15.106:0/3204437710 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e400bbc0 con 0x7f26f4162150 2024-05-10T04:22:15.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.014+0000 7f26f1600700 1 -- 172.21.15.106:0/3204437710 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4009e70 con 0x7f26f4162150 2024-05-10T04:22:15.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.015+0000 7f26f9600700 1 -- 172.21.15.106:0/3204437710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26f4162150 msgr2=0x7f26f415e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:15.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.015+0000 7f26f9600700 1 --2- 172.21.15.106:0/3204437710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26f4162150 0x7f26f415e610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009920 tx=0x7f26e4009c30 comp rx=0 tx=0).stop 2024-05-10T04:22:15.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.015+0000 7f26f9600700 1 -- 172.21.15.106:0/3204437710 shutdown_connections 2024-05-10T04:22:15.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.015+0000 7f26f9600700 1 --2- 172.21.15.106:0/3204437710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26f4162150 0x7f26f415e610 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:15.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.015+0000 7f26f9600700 1 -- 172.21.15.106:0/3204437710 >> 172.21.15.106:0/3204437710 conn(0x7f26f40d3e10 msgr2=0x7f26f40d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:15.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.015+0000 7f26f9600700 1 -- 172.21.15.106:0/3204437710 shutdown_connections 2024-05-10T04:22:15.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.015+0000 7f26f9600700 1 -- 172.21.15.106:0/3204437710 wait complete. 2024-05-10T04:22:15.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.017+0000 7f26f9600700 1 Processor -- start 2024-05-10T04:22:15.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.018+0000 7f26f9600700 1 -- start start 2024-05-10T04:22:15.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.019+0000 7f26f9600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26f406c160 0x7f26f40c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:15.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.019+0000 7f26f9600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26f40cf4d0 0x7f26f40c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:15.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.019+0000 7f26f9600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26f4162150 0x7f26f4160de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:15.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.019+0000 7f26f9600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f40c6d90 con 0x7f26f4162150 2024-05-10T04:22:15.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.019+0000 7f26f9600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f414b1e0 con 0x7f26f406c160 2024-05-10T04:22:15.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.019+0000 7f26f9600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f4148e00 con 0x7f26f40cf4d0 2024-05-10T04:22:15.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.019+0000 7f26f2000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26f40cf4d0 0x7f26f40c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:15.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.019+0000 7f26f2000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26f40cf4d0 0x7f26f40c7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:48684/0 (socket says 172.21.15.106:48684) 2024-05-10T04:22:15.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.019+0000 7f26f2000700 1 -- 172.21.15.106:0/1637265654 learned_addr learned my addr 172.21.15.106:0/1637265654 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T04:22:15.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.019+0000 7f26f2a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26f406c160 0x7f26f40c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:15.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.020+0000 7f26f3400700 1 --2- 172.21.15.106:0/1637265654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26f4162150 0x7f26f4160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:15.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.020+0000 7f26f2000700 1 -- 172.21.15.106:0/1637265654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26f406c160 msgr2=0x7f26f40c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:15.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.020+0000 7f26f2000700 1 --2- 172.21.15.106:0/1637265654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26f406c160 0x7f26f40c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:15.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.020+0000 7f26f2000700 1 -- 172.21.15.106:0/1637265654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26f4162150 msgr2=0x7f26f4160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:15.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.020+0000 7f26f2000700 1 --2- 172.21.15.106:0/1637265654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26f4162150 0x7f26f4160de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:15.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.020+0000 7f26f2000700 1 -- 172.21.15.106:0/1637265654 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e4009550 con 0x7f26f40cf4d0 2024-05-10T04:22:15.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.020+0000 7f26f2000700 1 --2- 172.21.15.106:0/1637265654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26f40cf4d0 0x7f26f40c7600 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f26e000c450 tx=0x7f26e000c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:15.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.020+0000 7f26eaa00700 1 -- 172.21.15.106:0/1637265654 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e00052d0 con 0x7f26f40cf4d0 2024-05-10T04:22:15.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.020+0000 7f26eaa00700 1 -- 172.21.15.106:0/1637265654 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e0005430 con 0x7f26f40cf4d0 2024-05-10T04:22:15.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.020+0000 7f26eaa00700 1 -- 172.21.15.106:0/1637265654 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e00038c0 con 0x7f26f40cf4d0 2024-05-10T04:22:15.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.020+0000 7f26f9600700 1 -- 172.21.15.106:0/1637265654 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f41490e0 con 0x7f26f40cf4d0 2024-05-10T04:22:15.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.021+0000 7f26f9600700 1 -- 172.21.15.106:0/1637265654 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f41496a0 con 0x7f26f40cf4d0 2024-05-10T04:22:15.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.021+0000 7f26eaa00700 1 -- 172.21.15.106:0/1637265654 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f26e0003d20 con 0x7f26f40cf4d0 2024-05-10T04:22:15.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.021+0000 7f26eaa00700 1 -- 172.21.15.106:0/1637265654 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f26e0011d90 con 0x7f26f40cf4d0 2024-05-10T04:22:15.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.022+0000 7f26f9600700 1 -- 172.21.15.106:0/1637265654 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f4074af0 con 0x7f26f40cf4d0 2024-05-10T04:22:15.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.024+0000 7f26eaa00700 1 -- 172.21.15.106:0/1637265654 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f26e0017070 con 0x7f26f40cf4d0 2024-05-10T04:22:15.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.113+0000 7f26f9600700 1 -- 172.21.15.106:0/1637265654 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca", "id": 6} v 0) v1 -- 0x7f26f4161ec0 con 0x7f26f40cf4d0 2024-05-10T04:22:15.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.121+0000 7f26eaa00700 1 -- 172.21.15.106:0/1637265654 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f26e0011590 con 0x7f26f40cf4d0 2024-05-10T04:22:15.123 INFO:teuthology.orchestra.run.smithi106.stdout:6 2024-05-10T04:22:15.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.123+0000 7f26f9600700 1 -- 172.21.15.106:0/1637265654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26f40cf4d0 msgr2=0x7f26f40c7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:15.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.123+0000 7f26f9600700 1 --2- 172.21.15.106:0/1637265654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26f40cf4d0 0x7f26f40c7600 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f26e000c450 tx=0x7f26e000c760 comp rx=0 tx=0).stop 2024-05-10T04:22:15.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.123+0000 7f26f9600700 1 -- 172.21.15.106:0/1637265654 shutdown_connections 2024-05-10T04:22:15.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.123+0000 7f26f9600700 1 --2- 172.21.15.106:0/1637265654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26f4162150 0x7f26f4160de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:15.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.123+0000 7f26f9600700 1 --2- 172.21.15.106:0/1637265654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26f406c160 0x7f26f40c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:15.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.123+0000 7f26f9600700 1 --2- 172.21.15.106:0/1637265654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26f40cf4d0 0x7f26f40c7600 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:15.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.123+0000 7f26f9600700 1 -- 172.21.15.106:0/1637265654 >> 172.21.15.106:0/1637265654 conn(0x7f26f40d3e10 msgr2=0x7f26f40b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:15.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.123+0000 7f26f9600700 1 -- 172.21.15.106:0/1637265654 shutdown_connections 2024-05-10T04:22:15.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.123+0000 7f26f9600700 1 -- 172.21.15.106:0/1637265654 wait complete. 2024-05-10T04:22:15.153 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 0969d5f4-0b52-4fd8-a250-ec326b5e01f7 7 2024-05-10T04:22:15.165 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:15.164+0000 7f9d1303c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T04:22:15.269 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:15.268+0000 7f9d1303c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T04:22:15.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.413+0000 7f9bfd600700 1 Processor -- start 2024-05-10T04:22:15.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.413+0000 7f9bfd600700 1 -- start start 2024-05-10T04:22:15.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.415+0000 7f9bfd600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9bf8158c30 0x7f9bf80b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:15.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.415+0000 7f9bfd600700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf815e970 con 0x7f9bf81626d0 2024-05-10T04:22:15.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.415+0000 7f9bfd600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf8162c60 con 0x7f9bf815f6a0 2024-05-10T04:22:15.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.415+0000 7f9bfd600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf80cf860 con 0x7f9bf8158c30 2024-05-10T04:22:15.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.415+0000 7f9bf6a00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9bf8158c30 0x7f9bf80b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:15.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.415+0000 7f9bf7400700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9bf81626d0 0x7f9bf80b28c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.106:53624/0 (socket says 172.21.15.106:53624) 2024-05-10T04:22:15.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.415+0000 7f9bf6a00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9bf8158c30 0x7f9bf80b58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53422/0 (socket says 172.21.15.106:53422) 2024-05-10T04:22:15.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.415+0000 7f9bf7400700 1 -- 172.21.15.106:0/783249587 learned_addr learned my addr 172.21.15.106:0/783249587 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-05-10T04:22:15.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.415+0000 7f9bf6000700 1 --1- 172.21.15.106:0/783249587 >> v1:172.21.15.106:6789/0 conn(0x7f9bf815f6a0 0x7f9bf8161fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:56058/0 (socket says 172.21.15.106:56058) 2024-05-10T04:22:15.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.416+0000 7f9bf6a00700 1 -- 172.21.15.106:0/783249587 >> v1:172.21.15.106:6789/0 conn(0x7f9bf815f6a0 legacy=0x7f9bf8161fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:15.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.416+0000 7f9bf6a00700 1 -- 172.21.15.106:0/783249587 >> v1:172.21.15.80:6789/0 conn(0x7f9bf81626d0 legacy=0x7f9bf80b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:15.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.416+0000 7f9bf6a00700 1 -- 172.21.15.106:0/783249587 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf815ebc0 con 0x7f9bf8158c30 2024-05-10T04:22:15.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.416+0000 7f9bf5600700 1 -- 172.21.15.106:0/783249587 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153551459 0 0) 0x7f9bf815e970 con 0x7f9bf81626d0 2024-05-10T04:22:15.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.416+0000 7f9bf6a00700 1 --2- 172.21.15.106:0/783249587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bf8158c30 0x7f9bf80b58d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9be8009840 tx=0x7f9be8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=337d85691d8e0377 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:15.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.416+0000 7f9bf5600700 1 -- 172.21.15.106:0/783249587 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be8011830 con 0x7f9bf8158c30 2024-05-10T04:22:15.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.416+0000 7f9bf5600700 1 -- 172.21.15.106:0/783249587 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be8011990 con 0x7f9bf8158c30 2024-05-10T04:22:15.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.416+0000 7f9bf5600700 1 -- 172.21.15.106:0/783249587 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be8011d20 con 0x7f9bf8158c30 2024-05-10T04:22:15.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.417+0000 7f9bfd600700 1 -- 172.21.15.106:0/783249587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bf8158c30 msgr2=0x7f9bf80b58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:15.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.417+0000 7f9bfd600700 1 --2- 172.21.15.106:0/783249587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bf8158c30 0x7f9bf80b58d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9be8009840 tx=0x7f9be8009b50 comp rx=0 tx=0).stop 2024-05-10T04:22:15.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.417+0000 7f9bfd600700 1 -- 172.21.15.106:0/783249587 shutdown_connections 2024-05-10T04:22:15.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.417+0000 7f9bfd600700 1 --2- 172.21.15.106:0/783249587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bf8158c30 0x7f9bf80b58d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:15.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.417+0000 7f9bfd600700 1 -- 172.21.15.106:0/783249587 >> 172.21.15.106:0/783249587 conn(0x7f9bf80d0ab0 msgr2=0x7f9bf80d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:15.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.417+0000 7f9bfd600700 1 -- 172.21.15.106:0/783249587 shutdown_connections 2024-05-10T04:22:15.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.417+0000 7f9bfd600700 1 -- 172.21.15.106:0/783249587 wait complete. 2024-05-10T04:22:15.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.419+0000 7f9bfd600700 1 Processor -- start 2024-05-10T04:22:15.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.419+0000 7f9bfd600700 1 -- start start 2024-05-10T04:22:15.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.421+0000 7f9bfd600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9bf8158c30 0x7f9bf8143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:15.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.421+0000 7f9bfd600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9bf815f6a0 0x7f9bf815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:15.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.421+0000 7f9bfd600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bf81626d0 0x7f9bf80d3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:15.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.421+0000 7f9bfd600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf8143950 con 0x7f9bf815f6a0 2024-05-10T04:22:15.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.421+0000 7f9bfd600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf81444e0 con 0x7f9bf81626d0 2024-05-10T04:22:15.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.421+0000 7f9bfd600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf8141e50 con 0x7f9bf8158c30 2024-05-10T04:22:15.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.421+0000 7f9bf6a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9bf8158c30 0x7f9bf8143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:15.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.421+0000 7f9bf7400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bf81626d0 0x7f9bf80d3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:15.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.421+0000 7f9bf6a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9bf8158c30 0x7f9bf8143ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:48690/0 (socket says 172.21.15.106:48690) 2024-05-10T04:22:15.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.421+0000 7f9bf6a00700 1 -- 172.21.15.106:0/454130879 learned_addr learned my addr 172.21.15.106:0/454130879 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T04:22:15.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.421+0000 7f9bf6000700 1 --2- 172.21.15.106:0/454130879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9bf815f6a0 0x7f9bf815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:15.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.422+0000 7f9bf7400700 1 -- 172.21.15.106:0/454130879 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9bf8158c30 msgr2=0x7f9bf8143ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:15.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.422+0000 7f9bf7400700 1 --2- 172.21.15.106:0/454130879 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9bf8158c30 0x7f9bf8143ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:15.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.422+0000 7f9bf7400700 1 -- 172.21.15.106:0/454130879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9bf815f6a0 msgr2=0x7f9bf815ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:15.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.422+0000 7f9bf7400700 1 --2- 172.21.15.106:0/454130879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9bf815f6a0 0x7f9bf815ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:15.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.422+0000 7f9bf7400700 1 -- 172.21.15.106:0/454130879 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be80094a0 con 0x7f9bf81626d0 2024-05-10T04:22:15.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.422+0000 7f9bf6a00700 1 --2- 172.21.15.106:0/454130879 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9bf8158c30 0x7f9bf8143ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:15.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.422+0000 7f9bf7400700 1 --2- 172.21.15.106:0/454130879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bf81626d0 0x7f9bf80d3e30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000cac0 tx=0x7f9bf000cdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:15.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.422+0000 7f9beea00700 1 -- 172.21.15.106:0/454130879 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf000a9e0 con 0x7f9bf81626d0 2024-05-10T04:22:15.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.422+0000 7f9beea00700 1 -- 172.21.15.106:0/454130879 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf000ab60 con 0x7f9bf81626d0 2024-05-10T04:22:15.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.422+0000 7f9bfd600700 1 -- 172.21.15.106:0/454130879 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf8144730 con 0x7f9bf81626d0 2024-05-10T04:22:15.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.422+0000 7f9beea00700 1 -- 172.21.15.106:0/454130879 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf00070d0 con 0x7f9bf81626d0 2024-05-10T04:22:15.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.422+0000 7f9bfd600700 1 -- 172.21.15.106:0/454130879 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf8144cf0 con 0x7f9bf81626d0 2024-05-10T04:22:15.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.423+0000 7f9beea00700 1 -- 172.21.15.106:0/454130879 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f9bf0007530 con 0x7f9bf81626d0 2024-05-10T04:22:15.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.423+0000 7f9beea00700 1 -- 172.21.15.106:0/454130879 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f9bf001d440 con 0x7f9bf81626d0 2024-05-10T04:22:15.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.424+0000 7f9bfd600700 1 -- 172.21.15.106:0/454130879 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf8074af0 con 0x7f9bf81626d0 2024-05-10T04:22:15.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.426+0000 7f9beea00700 1 -- 172.21.15.106:0/454130879 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f9bf0018070 con 0x7f9bf81626d0 2024-05-10T04:22:15.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.515+0000 7f9bfd600700 1 -- 172.21.15.106:0/454130879 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0969d5f4-0b52-4fd8-a250-ec326b5e01f7", "id": 7} v 0) v1 -- 0x7f9bf80d21e0 con 0x7f9bf81626d0 2024-05-10T04:22:15.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.523+0000 7f9beea00700 1 -- 172.21.15.106:0/454130879 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0969d5f4-0b52-4fd8-a250-ec326b5e01f7", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9bf00077e0 con 0x7f9bf81626d0 2024-05-10T04:22:15.525 INFO:teuthology.orchestra.run.smithi106.stdout:7 2024-05-10T04:22:15.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.524+0000 7f9bfd600700 1 -- 172.21.15.106:0/454130879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bf81626d0 msgr2=0x7f9bf80d3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:15.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.524+0000 7f9bfd600700 1 --2- 172.21.15.106:0/454130879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bf81626d0 0x7f9bf80d3e30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000cac0 tx=0x7f9bf000cdd0 comp rx=0 tx=0).stop 2024-05-10T04:22:15.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.524+0000 7f9bfd600700 1 -- 172.21.15.106:0/454130879 shutdown_connections 2024-05-10T04:22:15.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.524+0000 7f9bfd600700 1 --2- 172.21.15.106:0/454130879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bf81626d0 0x7f9bf80d3e30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:15.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.524+0000 7f9bfd600700 1 --2- 172.21.15.106:0/454130879 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9bf8158c30 0x7f9bf8143ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:15.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.525+0000 7f9bfd600700 1 --2- 172.21.15.106:0/454130879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9bf815f6a0 0x7f9bf815ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:15.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.525+0000 7f9bfd600700 1 -- 172.21.15.106:0/454130879 >> 172.21.15.106:0/454130879 conn(0x7f9bf80d0ab0 msgr2=0x7f9bf80d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:15.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.525+0000 7f9bfd600700 1 -- 172.21.15.106:0/454130879 shutdown_connections 2024-05-10T04:22:15.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T04:22:15.525+0000 7f9bfd600700 1 -- 172.21.15.106:0/454130879 wait complete. 2024-05-10T04:22:15.549 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-10T04:22:15.550 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-10T04:22:15.554 INFO:tasks.ceph.osd.0:Started 2024-05-10T04:22:15.554 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-10T04:22:15.554 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-10T04:22:15.561 INFO:tasks.ceph.osd.1:Started 2024-05-10T04:22:15.561 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-10T04:22:15.561 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-10T04:22:15.566 INFO:tasks.ceph.osd.2:Started 2024-05-10T04:22:15.566 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-10T04:22:15.566 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-10T04:22:15.571 INFO:tasks.ceph.osd.3:Started 2024-05-10T04:22:15.572 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-10T04:22:15.572 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-10T04:22:15.575 INFO:tasks.ceph.osd.4:Started 2024-05-10T04:22:15.576 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-10T04:22:15.576 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-10T04:22:15.579 INFO:tasks.ceph.osd.5:Started 2024-05-10T04:22:15.580 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-10T04:22:15.580 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-10T04:22:15.583 INFO:tasks.ceph.osd.6:Started 2024-05-10T04:22:15.584 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-10T04:22:15.584 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-10T04:22:15.589 INFO:tasks.ceph.osd.7:Started 2024-05-10T04:22:15.589 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:22:15.603 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:15.602+0000 7f38d48cd200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T04:22:15.756 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:15.755+0000 7f38d48cd200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T04:22:15.940 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:15.938+0000 7f38d48cd200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T04:22:15.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.980+0000 7f15e8000700 1 Processor -- start 2024-05-10T04:22:15.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.980+0000 7f15e8000700 1 -- start start 2024-05-10T04:22:15.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.982+0000 7f15e8000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15e015f320 0x7f15e0169140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:15.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.982+0000 7f15e8000700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e00d3180 con 0x7f15e00b60e0 2024-05-10T04:22:15.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.982+0000 7f15e8000700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e015f730 con 0x7f15e00b32b0 2024-05-10T04:22:15.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.982+0000 7f15e8000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00b36c0 con 0x7f15e015f320 2024-05-10T04:22:15.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.982+0000 7f15e4c00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f15e00b60e0 0x7f15e015ec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47256/0 (socket says 172.21.15.80:47256) 2024-05-10T04:22:15.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.982+0000 7f15e4c00700 1 -- 172.21.15.80:0/2302041130 learned_addr learned my addr 172.21.15.80:0/2302041130 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:15.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.983+0000 7f15e6000700 1 --2- 172.21.15.80:0/2302041130 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15e015f320 0x7f15e0169140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:15.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.983+0000 7f15dfe00700 1 -- 172.21.15.80:0/2302041130 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643088128 0 0) 0x7f15e00d3180 con 0x7f15e00b60e0 2024-05-10T04:22:15.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.983+0000 7f15dfe00700 1 -- 172.21.15.80:0/2302041130 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c80035b0 con 0x7f15e00b60e0 2024-05-10T04:22:15.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.983+0000 7f15e6000700 1 -- 172.21.15.80:0/2302041130 >> v1:172.21.15.106:6789/0 conn(0x7f15e00b32b0 legacy=0x7f15e00b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:15.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.983+0000 7f15dfe00700 1 -- 172.21.15.80:0/2302041130 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410716736 0 0) 0x7f15e015f730 con 0x7f15e00b32b0 2024-05-10T04:22:15.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.983+0000 7f15e6000700 1 -- 172.21.15.80:0/2302041130 >> v1:172.21.15.80:6789/0 conn(0x7f15e00b60e0 legacy=0x7f15e015ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:15.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.983+0000 7f15e6000700 1 -- 172.21.15.80:0/2302041130 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e00d2890 con 0x7f15e015f320 2024-05-10T04:22:15.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.983+0000 7f15e6000700 1 --2- 172.21.15.80:0/2302041130 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15e015f320 0x7f15e0169140 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009dc0 tx=0x7f15d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=693b07189fb34ac4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:15.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.984+0000 7f15dfe00700 1 -- 172.21.15.80:0/2302041130 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d800e070 con 0x7f15e015f320 2024-05-10T04:22:15.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.984+0000 7f15dfe00700 1 -- 172.21.15.80:0/2302041130 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d800bb20 con 0x7f15e015f320 2024-05-10T04:22:15.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.984+0000 7f15dfe00700 1 -- 172.21.15.80:0/2302041130 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d800bed0 con 0x7f15e015f320 2024-05-10T04:22:15.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.984+0000 7f15e8000700 1 -- 172.21.15.80:0/2302041130 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15e015f320 msgr2=0x7f15e0169140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:15.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.984+0000 7f15e8000700 1 --2- 172.21.15.80:0/2302041130 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15e015f320 0x7f15e0169140 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009dc0 tx=0x7f15d800b330 comp rx=0 tx=0).stop 2024-05-10T04:22:15.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.985+0000 7f15e8000700 1 -- 172.21.15.80:0/2302041130 shutdown_connections 2024-05-10T04:22:15.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.985+0000 7f15e8000700 1 --2- 172.21.15.80:0/2302041130 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15e015f320 0x7f15e0169140 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:15.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.985+0000 7f15e8000700 1 -- 172.21.15.80:0/2302041130 >> 172.21.15.80:0/2302041130 conn(0x7f15e00d0a40 msgr2=0x7f15e00d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:15.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.985+0000 7f15e8000700 1 -- 172.21.15.80:0/2302041130 shutdown_connections 2024-05-10T04:22:15.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.985+0000 7f15e8000700 1 -- 172.21.15.80:0/2302041130 wait complete. 2024-05-10T04:22:15.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.987+0000 7f15e8000700 1 Processor -- start 2024-05-10T04:22:15.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.987+0000 7f15e8000700 1 -- start start 2024-05-10T04:22:15.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.988+0000 7f15e8000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e00b32b0 0x7f15e01f3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:15.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.988+0000 7f15e8000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15e015f320 0x7f15e00c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:15.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.988+0000 7f15e8000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15e014c3f0 0x7f15e00c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:15.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.988+0000 7f15e8000700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00cbe90 con 0x7f15e00b32b0 2024-05-10T04:22:15.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.988+0000 7f15e8000700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00c7d00 con 0x7f15e015f320 2024-05-10T04:22:15.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.988+0000 7f15e8000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00c7f50 con 0x7f15e014c3f0 2024-05-10T04:22:15.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.989+0000 7f15e5600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e00b32b0 0x7f15e01f3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:15.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.989+0000 7f15e5600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e00b32b0 0x7f15e01f3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32882/0 (socket says 172.21.15.80:32882) 2024-05-10T04:22:15.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.989+0000 7f15e5600700 1 -- 172.21.15.80:0/3242523458 learned_addr learned my addr 172.21.15.80:0/3242523458 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:15.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.989+0000 7f15e4c00700 1 --2- 172.21.15.80:0/3242523458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15e015f320 0x7f15e00c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:15.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.989+0000 7f15e6000700 1 --2- 172.21.15.80:0/3242523458 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15e014c3f0 0x7f15e00c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:15.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.989+0000 7f15e5600700 1 -- 172.21.15.80:0/3242523458 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15e014c3f0 msgr2=0x7f15e00c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:15.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.989+0000 7f15e5600700 1 --2- 172.21.15.80:0/3242523458 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15e014c3f0 0x7f15e00c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:15.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.989+0000 7f15e5600700 1 -- 172.21.15.80:0/3242523458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15e015f320 msgr2=0x7f15e00c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:15.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.989+0000 7f15e5600700 1 --2- 172.21.15.80:0/3242523458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15e015f320 0x7f15e00c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:15.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.989+0000 7f15e5600700 1 -- 172.21.15.80:0/3242523458 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d8009a70 con 0x7f15e00b32b0 2024-05-10T04:22:15.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.989+0000 7f15e5600700 1 --2- 172.21.15.80:0/3242523458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e00b32b0 0x7f15e01f3f20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f15d400c450 tx=0x7f15d400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:15.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.990+0000 7f15dd600700 1 -- 172.21.15.80:0/3242523458 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40054e0 con 0x7f15e00b32b0 2024-05-10T04:22:15.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.990+0000 7f15dd600700 1 -- 172.21.15.80:0/3242523458 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d400ce60 con 0x7f15e00b32b0 2024-05-10T04:22:15.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.990+0000 7f15e8000700 1 -- 172.21.15.80:0/3242523458 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e00c8230 con 0x7f15e00b32b0 2024-05-10T04:22:15.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.990+0000 7f15dd600700 1 -- 172.21.15.80:0/3242523458 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40038a0 con 0x7f15e00b32b0 2024-05-10T04:22:15.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.990+0000 7f15e8000700 1 -- 172.21.15.80:0/3242523458 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e00c87f0 con 0x7f15e00b32b0 2024-05-10T04:22:15.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.990+0000 7f15dd600700 1 -- 172.21.15.80:0/3242523458 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f15d4003d00 con 0x7f15e00b32b0 2024-05-10T04:22:15.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.990+0000 7f15dd600700 1 -- 172.21.15.80:0/3242523458 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f15d4012ad0 con 0x7f15e00b32b0 2024-05-10T04:22:15.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.991+0000 7f15e8000700 1 -- 172.21.15.80:0/3242523458 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e00d1bf0 con 0x7f15e00b32b0 2024-05-10T04:22:15.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:15.994+0000 7f15dd600700 1 -- 172.21.15.80:0/3242523458 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f15d4017070 con 0x7f15e00b32b0 2024-05-10T04:22:16.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:16.067+0000 7f15e8000700 1 -- 172.21.15.80:0/3242523458 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15e00ce170 con 0x7f15e00b32b0 2024-05-10T04:22:16.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:16.067+0000 7f15dd600700 1 -- 172.21.15.80:0/3242523458 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f15d40124b0 con 0x7f15e00b32b0 2024-05-10T04:22:16.069 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:16.069 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:15.517592+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:22:16.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:16.069+0000 7f15e8000700 1 -- 172.21.15.80:0/3242523458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e00b32b0 msgr2=0x7f15e01f3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:16.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:16.069+0000 7f15e8000700 1 --2- 172.21.15.80:0/3242523458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e00b32b0 0x7f15e01f3f20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f15d400c450 tx=0x7f15d400c760 comp rx=0 tx=0).stop 2024-05-10T04:22:16.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:16.069+0000 7f15e8000700 1 -- 172.21.15.80:0/3242523458 shutdown_connections 2024-05-10T04:22:16.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:16.069+0000 7f15e8000700 1 --2- 172.21.15.80:0/3242523458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e00b32b0 0x7f15e01f3f20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:16.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:16.069+0000 7f15e8000700 1 --2- 172.21.15.80:0/3242523458 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15e014c3f0 0x7f15e00c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:16.069+0000 7f15e8000700 1 --2- 172.21.15.80:0/3242523458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15e015f320 0x7f15e00c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:16.069+0000 7f15e8000700 1 -- 172.21.15.80:0/3242523458 >> 172.21.15.80:0/3242523458 conn(0x7f15e00d0a40 msgr2=0x7f15e015ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:16.069+0000 7f15e8000700 1 -- 172.21.15.80:0/3242523458 shutdown_connections 2024-05-10T04:22:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:16.069+0000 7f15e8000700 1 -- 172.21.15.80:0/3242523458 wait complete. 2024-05-10T04:22:16.094 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-10T04:22:16.094 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-10T04:22:16.262 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:16.260+0000 7f9d1303c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T04:22:16.319 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-10T04:22:16.318+0000 7f3d6d7027c0 -1 Falling back to public interface 2024-05-10T04:22:16.334 INFO:tasks.ceph.osd.4.smithi106.stderr:2024-05-10T04:22:16.333+0000 7fa5e5c747c0 -1 Falling back to public interface 2024-05-10T04:22:16.339 INFO:tasks.ceph.osd.7.smithi106.stderr:2024-05-10T04:22:16.338+0000 7f73980427c0 -1 Falling back to public interface 2024-05-10T04:22:16.355 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-10T04:22:16.354+0000 7fd615c367c0 -1 Falling back to public interface 2024-05-10T04:22:16.371 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:16.370+0000 7f9d1303c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T04:22:16.401 INFO:tasks.ceph.osd.6.smithi106.stderr:2024-05-10T04:22:16.400+0000 7f88b56417c0 -1 Falling back to public interface 2024-05-10T04:22:16.409 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-10T04:22:16.407+0000 7fa9d11ef7c0 -1 Falling back to public interface 2024-05-10T04:22:16.409 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-10T04:22:16.407+0000 7f754fc5b7c0 -1 Falling back to public interface 2024-05-10T04:22:16.417 INFO:tasks.ceph.osd.5.smithi106.stderr:2024-05-10T04:22:16.416+0000 7f2745be17c0 -1 Falling back to public interface 2024-05-10T04:22:16.546 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:16.545+0000 7f9d1303c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T04:22:16.654 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:16.652+0000 7f38d48cd200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T04:22:16.875 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:16.874+0000 7f38d48cd200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T04:22:16.900 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T04:22:17.094 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:17.093+0000 7f38d48cd200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T04:22:17.145 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.144+0000 7eff04e00700 1 Processor -- start 2024-05-10T04:22:17.145 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.144+0000 7eff04e00700 1 -- start start 2024-05-10T04:22:17.147 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.146+0000 7eff04e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff0006e8b0 0x7eff0006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:17.148 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.146+0000 7eff04e00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7eff000b46e0 0x7eff000b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:17.148 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.146+0000 7eff04e00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0006f200 con 0x7eff0015a8e0 2024-05-10T04:22:17.148 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.146+0000 7eff04e00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0015acf0 con 0x7eff0006e8b0 2024-05-10T04:22:17.148 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.146+0000 7eff04e00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff000b2ec0 con 0x7eff000b46e0 2024-05-10T04:22:17.148 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.146+0000 7efefde00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7eff0015a8e0 0x7eff000cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47258/0 (socket says 172.21.15.80:47258) 2024-05-10T04:22:17.148 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.146+0000 7efefd400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff0006e8b0 0x7eff0006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:17.148 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.147+0000 7efefde00700 1 -- 172.21.15.80:0/1475479506 learned_addr learned my addr 172.21.15.80:0/1475479506 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:17.148 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.147+0000 7efefe800700 1 --2- 172.21.15.80:0/1475479506 >> v2:172.21.15.106:3300/0 conn(0x7eff000b46e0 0x7eff000b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:17.149 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.147+0000 7efefca00700 1 -- 172.21.15.80:0/1475479506 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935081744 0 0) 0x7eff0006f200 con 0x7eff0015a8e0 2024-05-10T04:22:17.149 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.147+0000 7efefca00700 1 -- 172.21.15.80:0/1475479506 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efee40057c0 con 0x7eff0015a8e0 2024-05-10T04:22:17.149 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.147+0000 7efefd400700 1 -- 172.21.15.80:0/1475479506 >> v2:172.21.15.106:3300/0 conn(0x7eff000b46e0 msgr2=0x7eff000b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:17.150 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.147+0000 7efefd400700 1 --2- 172.21.15.80:0/1475479506 >> v2:172.21.15.106:3300/0 conn(0x7eff000b46e0 0x7eff000b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:17.150 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.147+0000 7efefd400700 1 -- 172.21.15.80:0/1475479506 >> v1:172.21.15.80:6789/0 conn(0x7eff0015a8e0 legacy=0x7eff000cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:17.150 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.147+0000 7efefd400700 1 -- 172.21.15.80:0/1475479506 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff000b31a0 con 0x7eff0006e8b0 2024-05-10T04:22:17.150 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.147+0000 7efefe800700 1 --2- 172.21.15.80:0/1475479506 >> v2:172.21.15.106:3300/0 conn(0x7eff000b46e0 0x7eff000b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:17.150 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.147+0000 7efefd400700 1 --2- 172.21.15.80:0/1475479506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff0006e8b0 0x7eff0006ecc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7eff000ccfc0 tx=0x7efeec009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cca28f6c5937c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:17.150 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.148+0000 7efefca00700 1 -- 172.21.15.80:0/1475479506 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec011830 con 0x7eff0006e8b0 2024-05-10T04:22:17.150 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.148+0000 7efefca00700 1 -- 172.21.15.80:0/1475479506 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeec011990 con 0x7eff0006e8b0 2024-05-10T04:22:17.150 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.148+0000 7efefca00700 1 -- 172.21.15.80:0/1475479506 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec011d20 con 0x7eff0006e8b0 2024-05-10T04:22:17.151 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.148+0000 7eff04e00700 1 -- 172.21.15.80:0/1475479506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff0006e8b0 msgr2=0x7eff0006ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:17.151 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.148+0000 7eff04e00700 1 --2- 172.21.15.80:0/1475479506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff0006e8b0 0x7eff0006ecc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7eff000ccfc0 tx=0x7efeec009b20 comp rx=0 tx=0).stop 2024-05-10T04:22:17.151 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.148+0000 7eff04e00700 1 -- 172.21.15.80:0/1475479506 shutdown_connections 2024-05-10T04:22:17.151 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.148+0000 7eff04e00700 1 --2- 172.21.15.80:0/1475479506 >> v2:172.21.15.106:3300/0 conn(0x7eff000b46e0 0x7eff000b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:17.151 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.149+0000 7eff04e00700 1 --2- 172.21.15.80:0/1475479506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff0006e8b0 0x7eff0006ecc0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:17.151 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.149+0000 7eff04e00700 1 -- 172.21.15.80:0/1475479506 >> 172.21.15.80:0/1475479506 conn(0x7eff000717d0 msgr2=0x7eff00071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:17.151 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.149+0000 7eff04e00700 1 -- 172.21.15.80:0/1475479506 shutdown_connections 2024-05-10T04:22:17.151 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.149+0000 7eff04e00700 1 -- 172.21.15.80:0/1475479506 wait complete. 2024-05-10T04:22:17.152 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.151+0000 7eff04e00700 1 Processor -- start 2024-05-10T04:22:17.152 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.151+0000 7eff04e00700 1 -- start start 2024-05-10T04:22:17.154 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.152+0000 7eff04e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff0006e8b0 0x7eff00143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:17.154 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.152+0000 7eff04e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff000b46e0 0x7eff0015d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:17.155 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.152+0000 7eff04e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff0015a8e0 0x7eff00151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:17.155 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.152+0000 7eff04e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff00154c70 con 0x7eff0015a8e0 2024-05-10T04:22:17.155 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.152+0000 7eff04e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff00143bb0 con 0x7eff000b46e0 2024-05-10T04:22:17.155 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.152+0000 7eff04e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0015b9e0 con 0x7eff0006e8b0 2024-05-10T04:22:17.155 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.153+0000 7efefe800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff0015a8e0 0x7eff00151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:17.155 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.153+0000 7efefe800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff0015a8e0 0x7eff00151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32900/0 (socket says 172.21.15.80:32900) 2024-05-10T04:22:17.155 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.153+0000 7efefe800700 1 -- 172.21.15.80:0/2650126274 learned_addr learned my addr 172.21.15.80:0/2650126274 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:17.155 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.153+0000 7efefd400700 1 --2- 172.21.15.80:0/2650126274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff000b46e0 0x7eff0015d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:17.155 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.153+0000 7efefde00700 1 --2- 172.21.15.80:0/2650126274 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff0006e8b0 0x7eff00143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:17.155 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.153+0000 7efefe800700 1 -- 172.21.15.80:0/2650126274 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff0006e8b0 msgr2=0x7eff00143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:17.156 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.153+0000 7efefe800700 1 --2- 172.21.15.80:0/2650126274 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff0006e8b0 0x7eff00143670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:17.156 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.153+0000 7efefe800700 1 -- 172.21.15.80:0/2650126274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff000b46e0 msgr2=0x7eff0015d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:17.156 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.153+0000 7efefe800700 1 --2- 172.21.15.80:0/2650126274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff000b46e0 0x7eff0015d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:17.156 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.153+0000 7efefe800700 1 -- 172.21.15.80:0/2650126274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef8009a70 con 0x7eff0015a8e0 2024-05-10T04:22:17.156 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.153+0000 7efefe800700 1 --2- 172.21.15.80:0/2650126274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff0015a8e0 0x7eff00151850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efef800efc0 tx=0x7efef800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:17.157 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.154+0000 7efef6000700 1 -- 172.21.15.80:0/2650126274 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef800cc90 con 0x7eff0015a8e0 2024-05-10T04:22:17.157 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.154+0000 7efef6000700 1 -- 172.21.15.80:0/2650126274 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef800f040 con 0x7eff0015a8e0 2024-05-10T04:22:17.157 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.154+0000 7efef6000700 1 -- 172.21.15.80:0/2650126274 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef80146c0 con 0x7eff0015a8e0 2024-05-10T04:22:17.157 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.154+0000 7eff04e00700 1 -- 172.21.15.80:0/2650126274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeec0094a0 con 0x7eff0015a8e0 2024-05-10T04:22:17.157 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.154+0000 7eff04e00700 1 -- 172.21.15.80:0/2650126274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0015bfa0 con 0x7eff0015a8e0 2024-05-10T04:22:17.157 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.154+0000 7efef6000700 1 -- 172.21.15.80:0/2650126274 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7efef8014b20 con 0x7eff0015a8e0 2024-05-10T04:22:17.157 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.154+0000 7efef6000700 1 -- 172.21.15.80:0/2650126274 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7efef8014dd0 con 0x7eff0015a8e0 2024-05-10T04:22:17.157 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.155+0000 7eff04e00700 1 -- 172.21.15.80:0/2650126274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff00067ff0 con 0x7eff0015a8e0 2024-05-10T04:22:17.159 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.158+0000 7efef6000700 1 -- 172.21.15.80:0/2650126274 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7efef803bdc0 con 0x7eff0015a8e0 2024-05-10T04:22:17.235 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.233+0000 7eff04e00700 1 -- 172.21.15.80:0/2650126274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff000afa90 con 0x7eff0015a8e0 2024-05-10T04:22:17.235 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.234+0000 7efef6000700 1 -- 172.21.15.80:0/2650126274 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7efef802a070 con 0x7eff0015a8e0 2024-05-10T04:22:17.235 INFO:teuthology.misc.health.smithi080.stdout: 2024-05-10T04:22:17.235 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":10,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:15.517592+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:22:17.237 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.235+0000 7eff04e00700 1 -- 172.21.15.80:0/2650126274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff0015a8e0 msgr2=0x7eff00151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:17.237 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.235+0000 7eff04e00700 1 --2- 172.21.15.80:0/2650126274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff0015a8e0 0x7eff00151850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efef800efc0 tx=0x7efef800c3a0 comp rx=0 tx=0).stop 2024-05-10T04:22:17.237 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.235+0000 7eff04e00700 1 -- 172.21.15.80:0/2650126274 shutdown_connections 2024-05-10T04:22:17.237 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.235+0000 7eff04e00700 1 --2- 172.21.15.80:0/2650126274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff0015a8e0 0x7eff00151850 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:17.237 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.235+0000 7eff04e00700 1 --2- 172.21.15.80:0/2650126274 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff0006e8b0 0x7eff00143670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:17.237 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.235+0000 7eff04e00700 1 --2- 172.21.15.80:0/2650126274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff000b46e0 0x7eff0015d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:17.237 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.235+0000 7eff04e00700 1 -- 172.21.15.80:0/2650126274 >> 172.21.15.80:0/2650126274 conn(0x7eff000717d0 msgr2=0x7eff0015ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:17.237 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.235+0000 7eff04e00700 1 -- 172.21.15.80:0/2650126274 shutdown_connections 2024-05-10T04:22:17.237 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:17.235+0000 7eff04e00700 1 -- 172.21.15.80:0/2650126274 wait complete. 2024-05-10T04:22:17.261 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-10T04:22:17.273 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:17.272+0000 7f9d1303c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T04:22:17.486 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:17.485+0000 7f9d1303c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T04:22:17.707 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:17.705+0000 7f9d1303c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T04:22:18.096 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:18.094+0000 7f38d48cd200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T04:22:18.404 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:18.403+0000 7f38d48cd200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T04:22:18.501 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:18.500+0000 7f38d48cd200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T04:22:18.717 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:18.716+0000 7f38d48cd200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T04:22:18.724 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:18.723+0000 7f9d1303c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T04:22:19.065 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:19.064+0000 7f9d1303c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T04:22:19.169 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:19.168+0000 7f9d1303c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T04:22:19.482 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-10T04:22:19.481+0000 7f9d1303c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T04:22:19.738 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:19.736+0000 7f3886400700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-10T04:22:19.739 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-10T04:22:19.738+0000 7f3886400700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-10T04:22:19.919 INFO:tasks.ceph.osd.7.smithi106.stderr:2024-05-10T04:22:19.917+0000 7f73980427c0 -1 osd.7 0 log_to_monitors true 2024-05-10T04:22:19.956 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-10T04:22:19.955+0000 7f3d6d7027c0 -1 osd.0 0 log_to_monitors true 2024-05-10T04:22:19.962 INFO:tasks.ceph.osd.4.smithi106.stderr:2024-05-10T04:22:19.961+0000 7fa5e5c747c0 -1 osd.4 0 log_to_monitors true 2024-05-10T04:22:20.025 INFO:tasks.ceph.osd.5.smithi106.stderr:2024-05-10T04:22:20.023+0000 7f2745be17c0 -1 osd.5 0 log_to_monitors true 2024-05-10T04:22:20.026 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-10T04:22:20.025+0000 7fa9d11ef7c0 -1 osd.1 0 log_to_monitors true 2024-05-10T04:22:20.027 INFO:tasks.ceph.osd.6.smithi106.stderr:2024-05-10T04:22:20.026+0000 7f88b56417c0 -1 osd.6 0 log_to_monitors true 2024-05-10T04:22:20.059 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-10T04:22:20.058+0000 7f754fc5b7c0 -1 osd.2 0 log_to_monitors true 2024-05-10T04:22:20.218 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-10T04:22:20.217+0000 7fd615c367c0 -1 osd.3 0 log_to_monitors true 2024-05-10T04:22:22.555 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:22:22.559 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:22:24.067 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T04:22:24.217 INFO:tasks.ceph.osd.7.smithi106.stderr:2024-05-10T04:22:24.215+0000 7f7385400700 -1 osd.7 0 waiting for initial osdmap 2024-05-10T04:22:24.218 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-10T04:22:24.217+0000 7fa9be400700 -1 osd.1 0 waiting for initial osdmap 2024-05-10T04:22:24.222 INFO:tasks.ceph.osd.6.smithi106.stderr:2024-05-10T04:22:24.221+0000 7f88a2a00700 -1 osd.6 0 waiting for initial osdmap 2024-05-10T04:22:24.225 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-10T04:22:24.224+0000 7fa9b4600700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:22:24.226 INFO:tasks.ceph.osd.7.smithi106.stderr:2024-05-10T04:22:24.225+0000 7f737b600700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:22:24.231 INFO:tasks.ceph.osd.6.smithi106.stderr:2024-05-10T04:22:24.230+0000 7f8898c00700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:22:24.244 INFO:tasks.ceph.osd.5.smithi106.stderr:2024-05-10T04:22:24.243+0000 7f2734c00700 -1 osd.5 0 waiting for initial osdmap 2024-05-10T04:22:24.254 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-10T04:22:24.253+0000 7f753d000700 -1 osd.2 0 waiting for initial osdmap 2024-05-10T04:22:24.259 INFO:tasks.ceph.osd.5.smithi106.stderr:2024-05-10T04:22:24.258+0000 7f2729000700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:22:24.269 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-10T04:22:24.268+0000 7f7533200700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:22:24.272 INFO:tasks.ceph.osd.4.smithi106.stderr:2024-05-10T04:22:24.270+0000 7fa5d3000700 -1 osd.4 0 waiting for initial osdmap 2024-05-10T04:22:24.273 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-10T04:22:24.273+0000 7fd603000700 -1 osd.3 0 waiting for initial osdmap 2024-05-10T04:22:24.278 INFO:tasks.ceph.osd.4.smithi106.stderr:2024-05-10T04:22:24.277+0000 7fa5c9200700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:22:24.282 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-10T04:22:24.281+0000 7fd5f9200700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:22:24.289 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-10T04:22:24.288+0000 7f3d5aa00700 -1 osd.0 0 waiting for initial osdmap 2024-05-10T04:22:24.308 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-10T04:22:24.307+0000 7f3d50c00700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:22:24.399 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.397+0000 7f82d8400700 1 Processor -- start 2024-05-10T04:22:24.399 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.398+0000 7f82d8400700 1 -- start start 2024-05-10T04:22:24.402 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.400+0000 7f82d8400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82d00b2c40 0x7f82d00b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:24.403 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.400+0000 7f82d8400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f82d00b45c0 0x7f82d00b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:24.403 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.400+0000 7f82d8400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d00b3590 con 0x7f82d01446a0 2024-05-10T04:22:24.403 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.400+0000 7f82d8400700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d00b41a0 con 0x7f82d00b45c0 2024-05-10T04:22:24.403 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.400+0000 7f82d8400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d0162670 con 0x7f82d00b2c40 2024-05-10T04:22:24.403 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.400+0000 7f82d5a00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f82d01446a0 0x7f82d0161f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58074/0 (socket says 172.21.15.80:58074) 2024-05-10T04:22:24.403 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.400+0000 7f82d5a00700 1 -- 172.21.15.80:0/1276397767 learned_addr learned my addr 172.21.15.80:0/1276397767 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:24.403 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.400+0000 7f82d5000700 1 --2- 172.21.15.80:0/1276397767 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82d00b2c40 0x7f82d00b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:24.403 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.400+0000 7f82d6400700 1 --2- 172.21.15.80:0/1276397767 >> v2:172.21.15.106:3300/0 conn(0x7f82d00b45c0 0x7f82d00b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:24.403 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.401+0000 7f82cfe00700 1 -- 172.21.15.80:0/1276397767 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699284535 0 0) 0x7f82d00b3590 con 0x7f82d01446a0 2024-05-10T04:22:24.403 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.401+0000 7f82cfe00700 1 -- 172.21.15.80:0/1276397767 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82b80035b0 con 0x7f82d01446a0 2024-05-10T04:22:24.403 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.401+0000 7f82d5000700 1 -- 172.21.15.80:0/1276397767 >> v2:172.21.15.106:3300/0 conn(0x7f82d00b45c0 msgr2=0x7f82d00b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:24.404 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.401+0000 7f82d5000700 1 --2- 172.21.15.80:0/1276397767 >> v2:172.21.15.106:3300/0 conn(0x7f82d00b45c0 0x7f82d00b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:24.404 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.401+0000 7f82d5000700 1 -- 172.21.15.80:0/1276397767 >> v1:172.21.15.80:6789/0 conn(0x7f82d01446a0 legacy=0x7f82d0161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:24.404 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.401+0000 7f82d5000700 1 -- 172.21.15.80:0/1276397767 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d0162940 con 0x7f82d00b2c40 2024-05-10T04:22:24.404 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.401+0000 7f82d6400700 1 --2- 172.21.15.80:0/1276397767 >> v2:172.21.15.106:3300/0 conn(0x7f82d00b45c0 0x7f82d00b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:24.404 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.401+0000 7f82d5000700 1 --2- 172.21.15.80:0/1276397767 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82d00b2c40 0x7f82d00b3050 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009840 tx=0x7f82bc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29045ff0185c38bf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:24.404 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.401+0000 7f82cfe00700 1 -- 172.21.15.80:0/1276397767 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc011830 con 0x7f82d00b2c40 2024-05-10T04:22:24.404 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.401+0000 7f82cfe00700 1 -- 172.21.15.80:0/1276397767 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc011990 con 0x7f82d00b2c40 2024-05-10T04:22:24.404 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.401+0000 7f82cfe00700 1 -- 172.21.15.80:0/1276397767 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc011d20 con 0x7f82d00b2c40 2024-05-10T04:22:24.405 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.402+0000 7f82d8400700 1 -- 172.21.15.80:0/1276397767 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82d00b2c40 msgr2=0x7f82d00b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:24.405 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.402+0000 7f82d8400700 1 --2- 172.21.15.80:0/1276397767 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82d00b2c40 0x7f82d00b3050 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009840 tx=0x7f82bc009b50 comp rx=0 tx=0).stop 2024-05-10T04:22:24.405 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.402+0000 7f82d8400700 1 -- 172.21.15.80:0/1276397767 shutdown_connections 2024-05-10T04:22:24.405 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.402+0000 7f82d8400700 1 --2- 172.21.15.80:0/1276397767 >> v2:172.21.15.106:3300/0 conn(0x7f82d00b45c0 0x7f82d00b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:24.405 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.402+0000 7f82d8400700 1 --2- 172.21.15.80:0/1276397767 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82d00b2c40 0x7f82d00b3050 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:24.405 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.402+0000 7f82d8400700 1 -- 172.21.15.80:0/1276397767 >> 172.21.15.80:0/1276397767 conn(0x7f82d006bf20 msgr2=0x7f82d006c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:24.405 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.402+0000 7f82d8400700 1 -- 172.21.15.80:0/1276397767 shutdown_connections 2024-05-10T04:22:24.406 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.402+0000 7f82d8400700 1 -- 172.21.15.80:0/1276397767 wait complete. 2024-05-10T04:22:24.406 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.404+0000 7f82d8400700 1 Processor -- start 2024-05-10T04:22:24.406 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.405+0000 7f82d8400700 1 -- start start 2024-05-10T04:22:24.409 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.406+0000 7f82d8400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82d00b2c40 0x7f82d015cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:24.409 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.406+0000 7f82d8400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82d00b45c0 0x7f82d0160420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:24.409 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.406+0000 7f82d8400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82d01446a0 0x7f82d00cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:24.409 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.406+0000 7f82d8400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00cb6f0 con 0x7f82d00b45c0 2024-05-10T04:22:24.409 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.406+0000 7f82d8400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d0160b20 con 0x7f82d01446a0 2024-05-10T04:22:24.409 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.406+0000 7f82d8400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d013cef0 con 0x7f82d00b2c40 2024-05-10T04:22:24.409 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.406+0000 7f82d5000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82d00b45c0 0x7f82d0160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:24.409 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.406+0000 7f82d5000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82d00b45c0 0x7f82d0160420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44900/0 (socket says 172.21.15.80:44900) 2024-05-10T04:22:24.409 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.406+0000 7f82d5000700 1 -- 172.21.15.80:0/3361563404 learned_addr learned my addr 172.21.15.80:0/3361563404 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:24.410 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.406+0000 7f82d6400700 1 --2- 172.21.15.80:0/3361563404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82d01446a0 0x7f82d00cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:24.410 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.406+0000 7f82d5a00700 1 --2- 172.21.15.80:0/3361563404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82d00b2c40 0x7f82d015cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:24.410 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.407+0000 7f82d5000700 1 -- 172.21.15.80:0/3361563404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82d00b2c40 msgr2=0x7f82d015cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:24.410 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.407+0000 7f82d5000700 1 --2- 172.21.15.80:0/3361563404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82d00b2c40 0x7f82d015cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:24.410 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.407+0000 7f82d5000700 1 -- 172.21.15.80:0/3361563404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82d01446a0 msgr2=0x7f82d00cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:24.410 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.407+0000 7f82d5000700 1 --2- 172.21.15.80:0/3361563404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82d01446a0 0x7f82d00cac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:24.410 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.407+0000 7f82d5000700 1 -- 172.21.15.80:0/3361563404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c8009a70 con 0x7f82d00b45c0 2024-05-10T04:22:24.410 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.407+0000 7f82d6400700 1 --2- 172.21.15.80:0/3361563404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82d01446a0 0x7f82d00cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:24.410 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.407+0000 7f82d5000700 1 --2- 172.21.15.80:0/3361563404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82d00b45c0 0x7f82d0160420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0090b0 tx=0x7f82bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:24.410 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.407+0000 7f82cd600700 1 -- 172.21.15.80:0/3361563404 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc004550 con 0x7f82d00b45c0 2024-05-10T04:22:24.410 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.407+0000 7f82cd600700 1 -- 172.21.15.80:0/3361563404 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc01e070 con 0x7f82d00b45c0 2024-05-10T04:22:24.410 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.407+0000 7f82d8400700 1 -- 172.21.15.80:0/3361563404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82bc0094a0 con 0x7f82d00b45c0 2024-05-10T04:22:24.411 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.407+0000 7f82cd600700 1 -- 172.21.15.80:0/3361563404 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc0038e0 con 0x7f82d00b45c0 2024-05-10T04:22:24.411 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.408+0000 7f82d8400700 1 -- 172.21.15.80:0/3361563404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d0160960 con 0x7f82d00b45c0 2024-05-10T04:22:24.411 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.409+0000 7f82d8400700 1 -- 172.21.15.80:0/3361563404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d006ccd0 con 0x7f82d00b45c0 2024-05-10T04:22:24.412 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.409+0000 7f82cd600700 1 -- 172.21.15.80:0/3361563404 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f82bc003a40 con 0x7f82d00b45c0 2024-05-10T04:22:24.412 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.410+0000 7f82cd600700 1 --2- 172.21.15.80:0/3361563404 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f82b006ac30 0x7f82b006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:24.412 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.410+0000 7f82cd600700 1 -- 172.21.15.80:0/3361563404 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f82bc0890c0 con 0x7f82d00b45c0 2024-05-10T04:22:24.412 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.411+0000 7f82d5a00700 1 --2- 172.21.15.80:0/3361563404 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f82b006ac30 0x7f82b006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:24.412 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.411+0000 7f82d5a00700 1 --2- 172.21.15.80:0/3361563404 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f82b006ac30 0x7f82b006d140 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f82c4007fd0 tx=0x7f82c4007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:24.417 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.416+0000 7f82cd600700 1 -- 172.21.15.80:0/3361563404 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f82bc055110 con 0x7f82d00b45c0 2024-05-10T04:22:24.623 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.622+0000 7f82d8400700 1 -- 172.21.15.80:0/3361563404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82d0160960 con 0x7f82d00b45c0 2024-05-10T04:22:24.624 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.623+0000 7f82cd600700 1 -- 172.21.15.80:0/3361563404 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f82bc020090 con 0x7f82d00b45c0 2024-05-10T04:22:24.624 INFO:teuthology.misc.health.smithi080.stdout: 2024-05-10T04:22:24.624 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":12,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:21.789174+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:22:24.627 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.625+0000 7f82d8400700 1 -- 172.21.15.80:0/3361563404 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f82b006ac30 msgr2=0x7f82b006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:24.627 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.625+0000 7f82d8400700 1 --2- 172.21.15.80:0/3361563404 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f82b006ac30 0x7f82b006d140 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f82c4007fd0 tx=0x7f82c4007dc0 comp rx=0 tx=0).stop 2024-05-10T04:22:24.627 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.625+0000 7f82d8400700 1 -- 172.21.15.80:0/3361563404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82d00b45c0 msgr2=0x7f82d0160420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:24.627 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.625+0000 7f82d8400700 1 --2- 172.21.15.80:0/3361563404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82d00b45c0 0x7f82d0160420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0090b0 tx=0x7f82bc004750 comp rx=0 tx=0).stop 2024-05-10T04:22:24.627 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.625+0000 7f82d8400700 1 -- 172.21.15.80:0/3361563404 shutdown_connections 2024-05-10T04:22:24.627 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.625+0000 7f82d8400700 1 --2- 172.21.15.80:0/3361563404 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f82b006ac30 0x7f82b006d140 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:24.627 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.625+0000 7f82d8400700 1 --2- 172.21.15.80:0/3361563404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82d01446a0 0x7f82d00cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:24.627 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.625+0000 7f82d8400700 1 --2- 172.21.15.80:0/3361563404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82d00b2c40 0x7f82d015cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:24.627 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.625+0000 7f82d8400700 1 --2- 172.21.15.80:0/3361563404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82d00b45c0 0x7f82d0160420 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:24.627 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.625+0000 7f82d8400700 1 -- 172.21.15.80:0/3361563404 >> 172.21.15.80:0/3361563404 conn(0x7f82d006bf20 msgr2=0x7f82d0142ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:24.627 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.625+0000 7f82d8400700 1 -- 172.21.15.80:0/3361563404 shutdown_connections 2024-05-10T04:22:24.628 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:24.625+0000 7f82d8400700 1 -- 172.21.15.80:0/3361563404 wait complete. 2024-05-10T04:22:24.648 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-10T04:22:31.455 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T04:22:31.703 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.702+0000 7f91e3400700 1 Processor -- start 2024-05-10T04:22:31.704 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.702+0000 7f91e3400700 1 -- start start 2024-05-10T04:22:31.706 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.704+0000 7f91e3400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91dc0ce930 0x7f91dc15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:31.707 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.704+0000 7f91e3400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91dc0b6530 0x7f91dc06c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:31.707 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.704+0000 7f91e3400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91dc162970 con 0x7f91dc0b3340 2024-05-10T04:22:31.707 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.704+0000 7f91e3400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc0b3750 con 0x7f91dc0ce930 2024-05-10T04:22:31.707 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.704+0000 7f91e3400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc162e00 con 0x7f91dc0b6530 2024-05-10T04:22:31.707 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.704+0000 7f91dbe00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f91dc0b3340 0x7f91dc0b5e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58076/0 (socket says 172.21.15.80:58076) 2024-05-10T04:22:31.707 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.704+0000 7f91e0a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91dc0ce930 0x7f91dc15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:31.707 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.704+0000 7f91dbe00700 1 -- 172.21.15.80:0/3164886081 learned_addr learned my addr 172.21.15.80:0/3164886081 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:31.707 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.705+0000 7f91e1400700 1 --2- 172.21.15.80:0/3164886081 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91dc0b6530 0x7f91dc06c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:31.707 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.705+0000 7f91e0a00700 1 -- 172.21.15.80:0/3164886081 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91dc0b6530 msgr2=0x7f91dc06c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:31.707 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.705+0000 7f91e0a00700 1 --2- 172.21.15.80:0/3164886081 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91dc0b6530 0x7f91dc06c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:31.707 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.705+0000 7f91e0a00700 1 -- 172.21.15.80:0/3164886081 >> v1:172.21.15.80:6789/0 conn(0x7f91dc0b3340 legacy=0x7f91dc0b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:31.707 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.705+0000 7f91e0a00700 1 -- 172.21.15.80:0/3164886081 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc0b30f0 con 0x7f91dc0ce930 2024-05-10T04:22:31.707 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.705+0000 7f91e0a00700 1 --2- 172.21.15.80:0/3164886081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc0ce930 0x7f91dc15e3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009840 tx=0x7f91d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15dc9acb34fb3967 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:31.708 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.705+0000 7f91db400700 1 -- 172.21.15.80:0/3164886081 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0011830 con 0x7f91dc0ce930 2024-05-10T04:22:31.708 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.705+0000 7f91db400700 1 -- 172.21.15.80:0/3164886081 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d0011990 con 0x7f91dc0ce930 2024-05-10T04:22:31.708 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.705+0000 7f91db400700 1 -- 172.21.15.80:0/3164886081 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0011d20 con 0x7f91dc0ce930 2024-05-10T04:22:31.708 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.706+0000 7f91e3400700 1 -- 172.21.15.80:0/3164886081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc0ce930 msgr2=0x7f91dc15e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:31.709 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.706+0000 7f91e3400700 1 --2- 172.21.15.80:0/3164886081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc0ce930 0x7f91dc15e3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009840 tx=0x7f91d0009b50 comp rx=0 tx=0).stop 2024-05-10T04:22:31.709 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.706+0000 7f91e3400700 1 -- 172.21.15.80:0/3164886081 shutdown_connections 2024-05-10T04:22:31.709 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.706+0000 7f91e3400700 1 --2- 172.21.15.80:0/3164886081 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91dc0b6530 0x7f91dc06c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:31.709 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.706+0000 7f91e3400700 1 --2- 172.21.15.80:0/3164886081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc0ce930 0x7f91dc15e3f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:31.709 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.706+0000 7f91e3400700 1 -- 172.21.15.80:0/3164886081 >> 172.21.15.80:0/3164886081 conn(0x7f91dc0d4260 msgr2=0x7f91dc0d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:31.709 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.706+0000 7f91e3400700 1 -- 172.21.15.80:0/3164886081 shutdown_connections 2024-05-10T04:22:31.709 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.706+0000 7f91e3400700 1 -- 172.21.15.80:0/3164886081 wait complete. 2024-05-10T04:22:31.709 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.708+0000 7f91e3400700 1 Processor -- start 2024-05-10T04:22:31.710 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.709+0000 7f91e3400700 1 -- start start 2024-05-10T04:22:31.712 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.710+0000 7f91e3400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc0b3340 0x7f91dc0ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:31.713 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.710+0000 7f91e3400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91dc0ce930 0x7f91dc14d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:31.713 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.710+0000 7f91e3400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91dc15bae0 0x7f91dc15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:31.713 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.710+0000 7f91e3400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc0cdff0 con 0x7f91dc0b3340 2024-05-10T04:22:31.713 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.710+0000 7f91e3400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc15fb10 con 0x7f91dc15bae0 2024-05-10T04:22:31.713 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.710+0000 7f91e3400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc0cd220 con 0x7f91dc0ce930 2024-05-10T04:22:31.713 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.710+0000 7f91e0a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc0b3340 0x7f91dc0ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:31.713 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.710+0000 7f91e0a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc0b3340 0x7f91dc0ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44910/0 (socket says 172.21.15.80:44910) 2024-05-10T04:22:31.713 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.710+0000 7f91e0a00700 1 -- 172.21.15.80:0/2981840761 learned_addr learned my addr 172.21.15.80:0/2981840761 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:31.713 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.710+0000 7f91dbe00700 1 --2- 172.21.15.80:0/2981840761 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91dc0ce930 0x7f91dc14d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:31.713 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.710+0000 7f91e1400700 1 --2- 172.21.15.80:0/2981840761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91dc15bae0 0x7f91dc15bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:31.713 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.711+0000 7f91e0a00700 1 -- 172.21.15.80:0/2981840761 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91dc0ce930 msgr2=0x7f91dc14d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:31.713 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.711+0000 7f91e0a00700 1 --2- 172.21.15.80:0/2981840761 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91dc0ce930 0x7f91dc14d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:31.713 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.711+0000 7f91e0a00700 1 -- 172.21.15.80:0/2981840761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91dc15bae0 msgr2=0x7f91dc15bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:31.713 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.711+0000 7f91e0a00700 1 --2- 172.21.15.80:0/2981840761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91dc15bae0 0x7f91dc15bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:31.713 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.711+0000 7f91e0a00700 1 -- 172.21.15.80:0/2981840761 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d00094a0 con 0x7f91dc0b3340 2024-05-10T04:22:31.714 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.711+0000 7f91dbe00700 1 --2- 172.21.15.80:0/2981840761 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91dc0ce930 0x7f91dc14d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:31.714 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.711+0000 7f91e0a00700 1 --2- 172.21.15.80:0/2981840761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc0b3340 0x7f91dc0ca2a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f91d00090b0 tx=0x7f91d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:31.714 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.711+0000 7f91d8c00700 1 -- 172.21.15.80:0/2981840761 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d00036a0 con 0x7f91dc0b3340 2024-05-10T04:22:31.714 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.711+0000 7f91d8c00700 1 -- 172.21.15.80:0/2981840761 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d001e070 con 0x7f91dc0b3340 2024-05-10T04:22:31.714 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.711+0000 7f91d8c00700 1 -- 172.21.15.80:0/2981840761 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0003a60 con 0x7f91dc0b3340 2024-05-10T04:22:31.714 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.711+0000 7f91e3400700 1 -- 172.21.15.80:0/2981840761 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91dc14d7b0 con 0x7f91dc0b3340 2024-05-10T04:22:31.714 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.711+0000 7f91e3400700 1 -- 172.21.15.80:0/2981840761 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91dc0ccf70 con 0x7f91dc0b3340 2024-05-10T04:22:31.715 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.712+0000 7f91e3400700 1 -- 172.21.15.80:0/2981840761 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91dc15e620 con 0x7f91dc0b3340 2024-05-10T04:22:31.715 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.714+0000 7f91d8c00700 1 -- 172.21.15.80:0/2981840761 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f91d0003bc0 con 0x7f91dc0b3340 2024-05-10T04:22:31.715 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.714+0000 7f91d8c00700 1 --2- 172.21.15.80:0/2981840761 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f91bc06acc0 0x7f91bc06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:31.715 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.714+0000 7f91d8c00700 1 -- 172.21.15.80:0/2981840761 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f91d008a0d0 con 0x7f91dc0b3340 2024-05-10T04:22:31.716 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.715+0000 7f91dbe00700 1 --2- 172.21.15.80:0/2981840761 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f91bc06acc0 0x7f91bc06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:31.716 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.715+0000 7f91dbe00700 1 --2- 172.21.15.80:0/2981840761 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f91bc06acc0 0x7f91bc06d1d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f91c8007fd0 tx=0x7f91c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:31.721 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.720+0000 7f91d8c00700 1 -- 172.21.15.80:0/2981840761 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f91d00555f0 con 0x7f91dc0b3340 2024-05-10T04:22:31.932 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.931+0000 7f91e3400700 1 -- 172.21.15.80:0/2981840761 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91dc067ff0 con 0x7f91dc0b3340 2024-05-10T04:22:31.933 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.932+0000 7f91d8c00700 1 -- 172.21.15.80:0/2981840761 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f91d00090e0 con 0x7f91dc0b3340 2024-05-10T04:22:31.933 INFO:teuthology.misc.health.smithi080.stdout: 2024-05-10T04:22:31.933 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":16,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:28.818765+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:22:31.936 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.934+0000 7f91e3400700 1 -- 172.21.15.80:0/2981840761 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f91bc06acc0 msgr2=0x7f91bc06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:31.936 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.934+0000 7f91e3400700 1 --2- 172.21.15.80:0/2981840761 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f91bc06acc0 0x7f91bc06d1d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f91c8007fd0 tx=0x7f91c8009040 comp rx=0 tx=0).stop 2024-05-10T04:22:31.936 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.934+0000 7f91e3400700 1 -- 172.21.15.80:0/2981840761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc0b3340 msgr2=0x7f91dc0ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:31.936 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.934+0000 7f91e3400700 1 --2- 172.21.15.80:0/2981840761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc0b3340 0x7f91dc0ca2a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f91d00090b0 tx=0x7f91d0004750 comp rx=0 tx=0).stop 2024-05-10T04:22:31.936 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.934+0000 7f91e3400700 1 -- 172.21.15.80:0/2981840761 shutdown_connections 2024-05-10T04:22:31.936 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.934+0000 7f91e3400700 1 --2- 172.21.15.80:0/2981840761 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f91bc06acc0 0x7f91bc06d1d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:31.936 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.934+0000 7f91e3400700 1 --2- 172.21.15.80:0/2981840761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc0b3340 0x7f91dc0ca2a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:31.936 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.934+0000 7f91e3400700 1 --2- 172.21.15.80:0/2981840761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91dc15bae0 0x7f91dc15bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:31.936 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.934+0000 7f91e3400700 1 --2- 172.21.15.80:0/2981840761 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91dc0ce930 0x7f91dc14d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:31.936 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.934+0000 7f91e3400700 1 -- 172.21.15.80:0/2981840761 >> 172.21.15.80:0/2981840761 conn(0x7f91dc0d4260 msgr2=0x7f91dc0d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:31.937 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.934+0000 7f91e3400700 1 -- 172.21.15.80:0/2981840761 shutdown_connections 2024-05-10T04:22:31.937 INFO:teuthology.misc.health.smithi080.stderr:2024-05-10T04:22:31.934+0000 7f91e3400700 1 -- 172.21.15.80:0/2981840761 wait complete. 2024-05-10T04:22:31.959 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-10T04:22:31.960 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-10T04:22:31.960 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T04:22:31.960 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T04:22:31.964 INFO:tasks.ceph.mds.a:Started 2024-05-10T04:22:31.964 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T04:22:31.964 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T04:22:31.968 INFO:tasks.ceph.mds.c:Started 2024-05-10T04:22:31.968 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T04:22:31.968 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T04:22:31.972 INFO:tasks.ceph.mds.b:Started 2024-05-10T04:22:31.972 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T04:22:31.973 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T04:22:31.976 INFO:tasks.ceph.mds.d:Started 2024-05-10T04:22:31.977 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-10T04:22:31.977 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:22:32.180 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2024-05-10T04:22:32.182 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-05-10T04:22:32.196 INFO:tasks.ceph.mds.d.smithi106.stdout:starting mds.d at 2024-05-10T04:22:32.198 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2024-05-10T04:22:32.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.252+0000 7fd153200700 1 Processor -- start 2024-05-10T04:22:32.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.252+0000 7fd153200700 1 -- start start 2024-05-10T04:22:32.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.254+0000 7fd153200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1540b7120 0x7fd1540b7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.254+0000 7fd153200700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1540d2850 con 0x7fd1540b9420 2024-05-10T04:22:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.254+0000 7fd153200700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1540b7a70 con 0x7fd1540cf360 2024-05-10T04:22:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.254+0000 7fd153200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540d25b0 con 0x7fd1540b7120 2024-05-10T04:22:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.254+0000 7fd14be00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd1540b9420 0x7fd1540d2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58096/0 (socket says 172.21.15.80:58096) 2024-05-10T04:22:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.254+0000 7fd14be00700 1 -- 172.21.15.80:0/3250312052 learned_addr learned my addr 172.21.15.80:0/3250312052 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.254+0000 7fd152800700 1 --2- 172.21.15.80:0/3250312052 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1540b7120 0x7fd1540b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:32.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.255+0000 7fd152800700 1 -- 172.21.15.80:0/3250312052 >> v1:172.21.15.106:6789/0 conn(0x7fd1540cf360 legacy=0x7fd154161d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:32.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.255+0000 7fd151400700 1 -- 172.21.15.80:0/3250312052 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392841874 0 0) 0x7fd1540d2850 con 0x7fd1540b9420 2024-05-10T04:22:32.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.255+0000 7fd152800700 1 -- 172.21.15.80:0/3250312052 >> v1:172.21.15.80:6789/0 conn(0x7fd1540b9420 legacy=0x7fd1540d2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:32.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.255+0000 7fd152800700 1 -- 172.21.15.80:0/3250312052 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1540cf770 con 0x7fd1540b7120 2024-05-10T04:22:32.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.255+0000 7fd152800700 1 --2- 172.21.15.80:0/3250312052 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1540b7120 0x7fd1540b7530 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd14c009dc0 tx=0x7fd14c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e271de47b9c5b32 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:32.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.255+0000 7fd151400700 1 -- 172.21.15.80:0/3250312052 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c00e070 con 0x7fd1540b7120 2024-05-10T04:22:32.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.255+0000 7fd151400700 1 -- 172.21.15.80:0/3250312052 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c00bbd0 con 0x7fd1540b7120 2024-05-10T04:22:32.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.255+0000 7fd151400700 1 -- 172.21.15.80:0/3250312052 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c012430 con 0x7fd1540b7120 2024-05-10T04:22:32.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.256+0000 7fd153200700 1 -- 172.21.15.80:0/3250312052 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1540b7120 msgr2=0x7fd1540b7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:32.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.256+0000 7fd153200700 1 --2- 172.21.15.80:0/3250312052 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1540b7120 0x7fd1540b7530 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd14c009dc0 tx=0x7fd14c00b330 comp rx=0 tx=0).stop 2024-05-10T04:22:32.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.256+0000 7fd153200700 1 -- 172.21.15.80:0/3250312052 shutdown_connections 2024-05-10T04:22:32.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.256+0000 7fd153200700 1 --2- 172.21.15.80:0/3250312052 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1540b7120 0x7fd1540b7530 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:32.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.256+0000 7fd153200700 1 -- 172.21.15.80:0/3250312052 >> 172.21.15.80:0/3250312052 conn(0x7fd15406c4e0 msgr2=0x7fd15406c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:32.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.256+0000 7fd153200700 1 -- 172.21.15.80:0/3250312052 shutdown_connections 2024-05-10T04:22:32.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.256+0000 7fd153200700 1 -- 172.21.15.80:0/3250312052 wait complete. 2024-05-10T04:22:32.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.258+0000 7fd153200700 1 Processor -- start 2024-05-10T04:22:32.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.259+0000 7fd153200700 1 -- start start 2024-05-10T04:22:32.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.260+0000 7fd153200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1540b7120 0x7fd15414f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:32.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.260+0000 7fd153200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1540b9420 0x7fd1541f7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:32.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.260+0000 7fd153200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1540cf360 0x7fd154151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:32.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.260+0000 7fd153200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15414f770 con 0x7fd1540b9420 2024-05-10T04:22:32.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.260+0000 7fd153200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540cb790 con 0x7fd1540cf360 2024-05-10T04:22:32.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.260+0000 7fd153200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1541f8310 con 0x7fd1540b7120 2024-05-10T04:22:32.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.260+0000 7fd14be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1540b9420 0x7fd1541f7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:32.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.260+0000 7fd151e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1540b7120 0x7fd15414f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:32.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.260+0000 7fd14be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1540b9420 0x7fd1541f7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44966/0 (socket says 172.21.15.80:44966) 2024-05-10T04:22:32.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.260+0000 7fd14be00700 1 -- 172.21.15.80:0/1519097898 learned_addr learned my addr 172.21.15.80:0/1519097898 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:32.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.260+0000 7fd151e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1540b7120 0x7fd15414f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:47854/0 (socket says 172.21.15.80:47854) 2024-05-10T04:22:32.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.260+0000 7fd152800700 1 --2- 172.21.15.80:0/1519097898 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1540cf360 0x7fd154151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:32.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.261+0000 7fd14be00700 1 -- 172.21.15.80:0/1519097898 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1540b7120 msgr2=0x7fd15414f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:32.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.261+0000 7fd14be00700 1 --2- 172.21.15.80:0/1519097898 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1540b7120 0x7fd15414f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:32.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.261+0000 7fd14be00700 1 -- 172.21.15.80:0/1519097898 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1540cf360 msgr2=0x7fd154151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:32.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.261+0000 7fd14be00700 1 --2- 172.21.15.80:0/1519097898 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1540cf360 0x7fd154151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:32.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.261+0000 7fd14be00700 1 -- 172.21.15.80:0/1519097898 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14c009a70 con 0x7fd1540b9420 2024-05-10T04:22:32.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.261+0000 7fd151e00700 1 --2- 172.21.15.80:0/1519097898 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1540b7120 0x7fd15414f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:32.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.261+0000 7fd14be00700 1 --2- 172.21.15.80:0/1519097898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1540b9420 0x7fd1541f7aa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00c550 tx=0x7fd13c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:32.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.261+0000 7fd14a000700 1 -- 172.21.15.80:0/1519097898 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c004c80 con 0x7fd1540b9420 2024-05-10T04:22:32.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.261+0000 7fd14a000700 1 -- 172.21.15.80:0/1519097898 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13c004de0 con 0x7fd1540b9420 2024-05-10T04:22:32.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.261+0000 7fd153200700 1 -- 172.21.15.80:0/1519097898 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd15414e7e0 con 0x7fd1540b9420 2024-05-10T04:22:32.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.261+0000 7fd14a000700 1 -- 172.21.15.80:0/1519097898 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c007310 con 0x7fd1540b9420 2024-05-10T04:22:32.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.261+0000 7fd153200700 1 -- 172.21.15.80:0/1519097898 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15414eda0 con 0x7fd1540b9420 2024-05-10T04:22:32.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.262+0000 7fd153200700 1 -- 172.21.15.80:0/1519097898 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd15414ef30 con 0x7fd1540b9420 2024-05-10T04:22:32.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.263+0000 7fd14a000700 1 -- 172.21.15.80:0/1519097898 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd13c007470 con 0x7fd1540b9420 2024-05-10T04:22:32.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.264+0000 7fd14a000700 1 --2- 172.21.15.80:0/1519097898 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd13006acc0 0x7fd13006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:32.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.264+0000 7fd14a000700 1 -- 172.21.15.80:0/1519097898 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd13c088be0 con 0x7fd1540b9420 2024-05-10T04:22:32.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.265+0000 7fd151e00700 1 --2- 172.21.15.80:0/1519097898 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd13006acc0 0x7fd13006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:32.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.265+0000 7fd151e00700 1 --2- 172.21.15.80:0/1519097898 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd13006acc0 0x7fd13006d1d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd144007fd0 tx=0x7fd144009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:32.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.269+0000 7fd14a000700 1 -- 172.21.15.80:0/1519097898 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd13c054070 con 0x7fd1540b9420 2024-05-10T04:22:32.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.475+0000 7fd153200700 1 -- 172.21.15.80:0/1519097898 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd154074af0 con 0x7fd1540b9420 2024-05-10T04:22:32.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.476+0000 7fd14a000700 1 -- 172.21.15.80:0/1519097898 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7fd13c057690 con 0x7fd1540b9420 2024-05-10T04:22:32.478 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:32.478 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":16,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:28.818765+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:22:32.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.478+0000 7fd153200700 1 -- 172.21.15.80:0/1519097898 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd13006acc0 msgr2=0x7fd13006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:32.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.478+0000 7fd153200700 1 --2- 172.21.15.80:0/1519097898 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd13006acc0 0x7fd13006d1d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd144007fd0 tx=0x7fd144009040 comp rx=0 tx=0).stop 2024-05-10T04:22:32.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.478+0000 7fd153200700 1 -- 172.21.15.80:0/1519097898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1540b9420 msgr2=0x7fd1541f7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:32.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.478+0000 7fd153200700 1 --2- 172.21.15.80:0/1519097898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1540b9420 0x7fd1541f7aa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00c550 tx=0x7fd13c00c860 comp rx=0 tx=0).stop 2024-05-10T04:22:32.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.479+0000 7fd153200700 1 -- 172.21.15.80:0/1519097898 shutdown_connections 2024-05-10T04:22:32.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.479+0000 7fd153200700 1 --2- 172.21.15.80:0/1519097898 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd13006acc0 0x7fd13006d1d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:32.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.479+0000 7fd153200700 1 --2- 172.21.15.80:0/1519097898 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1540cf360 0x7fd154151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:32.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.479+0000 7fd153200700 1 --2- 172.21.15.80:0/1519097898 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1540b7120 0x7fd15414f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:32.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.479+0000 7fd153200700 1 --2- 172.21.15.80:0/1519097898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1540b9420 0x7fd1541f7aa0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:32.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.479+0000 7fd153200700 1 -- 172.21.15.80:0/1519097898 >> 172.21.15.80:0/1519097898 conn(0x7fd15406c4e0 msgr2=0x7fd1540ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:32.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.479+0000 7fd153200700 1 -- 172.21.15.80:0/1519097898 shutdown_connections 2024-05-10T04:22:32.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.479+0000 7fd153200700 1 -- 172.21.15.80:0/1519097898 wait complete. 2024-05-10T04:22:32.506 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:22:26.793377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:22:32.610 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:22:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.875+0000 7fed81a00700 1 Processor -- start 2024-05-10T04:22:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.875+0000 7fed81a00700 1 -- start start 2024-05-10T04:22:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.877+0000 7fed81a00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fed7c162150 0x7fed7c15e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.877+0000 7fed81a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed7c0cf4d0 0x7fed7c0b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.877+0000 7fed81a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed7c0b7910 0x7fed7c06c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.877+0000 7fed81a00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed7c0d2c00 con 0x7fed7c0cf4d0 2024-05-10T04:22:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.877+0000 7fed81a00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed7c162630 con 0x7fed7c162150 2024-05-10T04:22:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.877+0000 7fed81a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c162910 con 0x7fed7c0b7910 2024-05-10T04:22:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.877+0000 7fed7a000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed7c0cf4d0 0x7fed7c0b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.877+0000 7fed7aa00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fed7c162150 0x7fed7c15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.877+0000 7fed7b400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed7c0b7910 0x7fed7c06c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.878+0000 7fed7aa00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fed7c162150 0x7fed7c15e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37612/0 (socket says 172.21.15.80:37612) 2024-05-10T04:22:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.878+0000 7fed7a000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed7c0cf4d0 0x7fed7c0b73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33704/0 (socket says 172.21.15.80:33704) 2024-05-10T04:22:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.878+0000 7fed7aa00700 1 -- 172.21.15.80:0/484192563 learned_addr learned my addr 172.21.15.80:0/484192563 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.878+0000 7fed7b400700 1 --2- 172.21.15.80:0/484192563 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed7c0b7910 0x7fed7c06c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:56448/0 (socket says 172.21.15.80:56448) 2024-05-10T04:22:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.878+0000 7fed7aa00700 1 -- 172.21.15.80:0/484192563 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed7c0b7910 msgr2=0x7fed7c06c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.878+0000 7fed7aa00700 1 --2- 172.21.15.80:0/484192563 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed7c0b7910 0x7fed7c06c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.878+0000 7fed7aa00700 1 -- 172.21.15.80:0/484192563 >> v2:172.21.15.80:3300/0 conn(0x7fed7c0cf4d0 msgr2=0x7fed7c0b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.878+0000 7fed7aa00700 1 --2- 172.21.15.80:0/484192563 >> v2:172.21.15.80:3300/0 conn(0x7fed7c0cf4d0 0x7fed7c0b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.878+0000 7fed7aa00700 1 -- 172.21.15.80:0/484192563 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7c162bf0 con 0x7fed7c162150 2024-05-10T04:22:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.878+0000 7fed7b400700 1 --2- 172.21.15.80:0/484192563 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed7c0b7910 0x7fed7c06c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.878+0000 7fed7aa00700 1 --2- 172.21.15.80:0/484192563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed7c162150 0x7fed7c15e610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0098f0 tx=0x7fed6c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5859034d166cbc7a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:32.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.882+0000 7fed79600700 1 -- 172.21.15.80:0/484192563 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c011830 con 0x7fed7c162150 2024-05-10T04:22:32.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.882+0000 7fed79600700 1 -- 172.21.15.80:0/484192563 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6c011990 con 0x7fed7c162150 2024-05-10T04:22:32.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.882+0000 7fed79600700 1 -- 172.21.15.80:0/484192563 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c011d20 con 0x7fed7c162150 2024-05-10T04:22:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.883+0000 7fed81a00700 1 -- 172.21.15.80:0/484192563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed7c162150 msgr2=0x7fed7c15e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.883+0000 7fed81a00700 1 --2- 172.21.15.80:0/484192563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed7c162150 0x7fed7c15e610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0098f0 tx=0x7fed6c009c00 comp rx=0 tx=0).stop 2024-05-10T04:22:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.883+0000 7fed81a00700 1 -- 172.21.15.80:0/484192563 shutdown_connections 2024-05-10T04:22:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.883+0000 7fed81a00700 1 --2- 172.21.15.80:0/484192563 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed7c0b7910 0x7fed7c06c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.883+0000 7fed81a00700 1 --2- 172.21.15.80:0/484192563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed7c162150 0x7fed7c15e610 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.883+0000 7fed81a00700 1 --2- 172.21.15.80:0/484192563 >> v2:172.21.15.80:3300/0 conn(0x7fed7c0cf4d0 0x7fed7c0b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.883+0000 7fed81a00700 1 -- 172.21.15.80:0/484192563 >> 172.21.15.80:0/484192563 conn(0x7fed7c0d3e10 msgr2=0x7fed7c0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.883+0000 7fed81a00700 1 -- 172.21.15.80:0/484192563 shutdown_connections 2024-05-10T04:22:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.883+0000 7fed81a00700 1 -- 172.21.15.80:0/484192563 wait complete. 2024-05-10T04:22:32.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.886+0000 7fed81a00700 1 Processor -- start 2024-05-10T04:22:32.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.886+0000 7fed81a00700 1 -- start start 2024-05-10T04:22:32.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.888+0000 7fed81a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed7c0b7910 0x7fed7c14f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:32.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.888+0000 7fed81a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed7c0cf4d0 0x7fed7c1f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:32.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.888+0000 7fed81a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c162150 0x7fed7c15d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:32.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.888+0000 7fed81a00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c15f2d0 con 0x7fed7c162150 2024-05-10T04:22:32.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.888+0000 7fed81a00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c160a30 con 0x7fed7c0cf4d0 2024-05-10T04:22:32.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.888+0000 7fed81a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c1f5730 con 0x7fed7c0b7910 2024-05-10T04:22:32.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.888+0000 7fed7b400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c162150 0x7fed7c15d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:32.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.888+0000 7fed7b400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c162150 0x7fed7c15d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33720/0 (socket says 172.21.15.80:33720) 2024-05-10T04:22:32.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.888+0000 7fed7b400700 1 -- 172.21.15.80:0/1652716355 learned_addr learned my addr 172.21.15.80:0/1652716355 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:32.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.888+0000 7fed7aa00700 1 --2- 172.21.15.80:0/1652716355 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed7c0b7910 0x7fed7c14f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:32.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.888+0000 7fed7a000700 1 --2- 172.21.15.80:0/1652716355 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed7c0cf4d0 0x7fed7c1f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:32.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.889+0000 7fed7b400700 1 -- 172.21.15.80:0/1652716355 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed7c0b7910 msgr2=0x7fed7c14f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:32.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.889+0000 7fed7b400700 1 --2- 172.21.15.80:0/1652716355 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed7c0b7910 0x7fed7c14f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:32.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.889+0000 7fed7b400700 1 -- 172.21.15.80:0/1652716355 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed7c0cf4d0 msgr2=0x7fed7c1f4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:32.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.889+0000 7fed7b400700 1 --2- 172.21.15.80:0/1652716355 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed7c0cf4d0 0x7fed7c1f4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:32.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.889+0000 7fed7b400700 1 -- 172.21.15.80:0/1652716355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed74009a70 con 0x7fed7c162150 2024-05-10T04:22:32.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.889+0000 7fed7b400700 1 --2- 172.21.15.80:0/1652716355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c162150 0x7fed7c15d4a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fed7400eef0 tx=0x7fed7400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:32.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.889+0000 7fed72a00700 1 -- 172.21.15.80:0/1652716355 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed74010040 con 0x7fed7c162150 2024-05-10T04:22:32.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.889+0000 7fed72a00700 1 -- 172.21.15.80:0/1652716355 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7400bc80 con 0x7fed7c162150 2024-05-10T04:22:32.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.889+0000 7fed81a00700 1 -- 172.21.15.80:0/1652716355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6c009550 con 0x7fed7c162150 2024-05-10T04:22:32.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.889+0000 7fed72a00700 1 -- 172.21.15.80:0/1652716355 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed74014400 con 0x7fed7c162150 2024-05-10T04:22:32.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.890+0000 7fed81a00700 1 -- 172.21.15.80:0/1652716355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7c14f930 con 0x7fed7c162150 2024-05-10T04:22:32.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.890+0000 7fed81a00700 1 -- 172.21.15.80:0/1652716355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7c15f410 con 0x7fed7c162150 2024-05-10T04:22:32.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.892+0000 7fed72a00700 1 -- 172.21.15.80:0/1652716355 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fed74014560 con 0x7fed7c162150 2024-05-10T04:22:32.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.892+0000 7fed72a00700 1 --2- 172.21.15.80:0/1652716355 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fed5c06ac90 0x7fed5c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:32.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.892+0000 7fed72a00700 1 -- 172.21.15.80:0/1652716355 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fed74089840 con 0x7fed7c162150 2024-05-10T04:22:32.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.893+0000 7fed7aa00700 1 --2- 172.21.15.80:0/1652716355 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fed5c06ac90 0x7fed5c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:32.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.893+0000 7fed7aa00700 1 --2- 172.21.15.80:0/1652716355 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fed5c06ac90 0x7fed5c06d1a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0098f0 tx=0x7fed6c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:32.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:32.897+0000 7fed72a00700 1 -- 172.21.15.80:0/1652716355 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fed7c15f410 con 0x7fed7c162150 2024-05-10T04:22:33.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.101+0000 7fed81a00700 1 -- 172.21.15.80:0/1652716355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed7c15f410 con 0x7fed7c162150 2024-05-10T04:22:33.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.101+0000 7fed72a00700 1 -- 172.21.15.80:0/1652716355 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed7c15f410 con 0x7fed7c162150 2024-05-10T04:22:33.103 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-10T04:22:33.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.103+0000 7fed81a00700 1 -- 172.21.15.80:0/1652716355 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fed5c06ac90 msgr2=0x7fed5c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:33.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.103+0000 7fed81a00700 1 --2- 172.21.15.80:0/1652716355 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fed5c06ac90 0x7fed5c06d1a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0098f0 tx=0x7fed6c008030 comp rx=0 tx=0).stop 2024-05-10T04:22:33.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.103+0000 7fed81a00700 1 -- 172.21.15.80:0/1652716355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c162150 msgr2=0x7fed7c15d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:33.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.103+0000 7fed81a00700 1 --2- 172.21.15.80:0/1652716355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c162150 0x7fed7c15d4a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fed7400eef0 tx=0x7fed7400b390 comp rx=0 tx=0).stop 2024-05-10T04:22:33.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.104+0000 7fed81a00700 1 -- 172.21.15.80:0/1652716355 shutdown_connections 2024-05-10T04:22:33.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.104+0000 7fed81a00700 1 --2- 172.21.15.80:0/1652716355 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fed5c06ac90 0x7fed5c06d1a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.104+0000 7fed81a00700 1 --2- 172.21.15.80:0/1652716355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c162150 0x7fed7c15d4a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.104+0000 7fed81a00700 1 --2- 172.21.15.80:0/1652716355 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed7c0b7910 0x7fed7c14f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.104+0000 7fed81a00700 1 --2- 172.21.15.80:0/1652716355 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed7c0cf4d0 0x7fed7c1f4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.104+0000 7fed81a00700 1 -- 172.21.15.80:0/1652716355 >> 172.21.15.80:0/1652716355 conn(0x7fed7c0d3e10 msgr2=0x7fed7c158d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:33.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.104+0000 7fed81a00700 1 -- 172.21.15.80:0/1652716355 shutdown_connections 2024-05-10T04:22:33.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.104+0000 7fed81a00700 1 -- 172.21.15.80:0/1652716355 wait complete. 2024-05-10T04:22:33.132 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:22:33.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.394+0000 7f06e4600700 1 Processor -- start 2024-05-10T04:22:33.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.394+0000 7f06e4600700 1 -- start start 2024-05-10T04:22:33.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.395+0000 7f06e4600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06dc0b2f50 0x7f06dc161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:33.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.395+0000 7f06e4600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f06dc0d0d40 0x7f06dc0d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:33.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.395+0000 7f06e4600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06dc0d28c0 con 0x7f06dc0d3030 2024-05-10T04:22:33.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.395+0000 7f06e4600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06dc0b3360 con 0x7f06dc0d0d40 2024-05-10T04:22:33.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.395+0000 7f06e4600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc1624e0 con 0x7f06dc0b2f50 2024-05-10T04:22:33.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.396+0000 7f06e2600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f06dc0d0d40 0x7f06dc0d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:33.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.396+0000 7f06e1c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06dc0b2f50 0x7f06dc161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:33.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.396+0000 7f06e2600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f06dc0d0d40 0x7f06dc0d3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37624/0 (socket says 172.21.15.80:37624) 2024-05-10T04:22:33.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.396+0000 7f06e2600700 1 -- 172.21.15.80:0/2282770664 learned_addr learned my addr 172.21.15.80:0/2282770664 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:33.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.396+0000 7f06e1c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06dc0b2f50 0x7f06dc161fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:56454/0 (socket says 172.21.15.80:56454) 2024-05-10T04:22:33.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.396+0000 7f06e2600700 1 -- 172.21.15.80:0/2282770664 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06dc0b2f50 msgr2=0x7f06dc161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:33.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.396+0000 7f06e2600700 1 --2- 172.21.15.80:0/2282770664 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06dc0b2f50 0x7f06dc161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.396+0000 7f06e2600700 1 -- 172.21.15.80:0/2282770664 >> v1:172.21.15.106:6789/0 conn(0x7f06dc0d3030 legacy=0x7f06dc0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:33.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.396+0000 7f06e2600700 1 -- 172.21.15.80:0/2282770664 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc0d2ba0 con 0x7f06dc0d0d40 2024-05-10T04:22:33.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.397+0000 7f06e1c00700 1 --2- 172.21.15.80:0/2282770664 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06dc0b2f50 0x7f06dc161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:33.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.397+0000 7f06e2600700 1 --2- 172.21.15.80:0/2282770664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc0d0d40 0x7f06dc0d3440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009e50 tx=0x7f06d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5808decffc963906 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:33.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.397+0000 7f06dbe00700 1 -- 172.21.15.80:0/2282770664 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d400e070 con 0x7f06dc0d0d40 2024-05-10T04:22:33.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.397+0000 7f06dbe00700 1 -- 172.21.15.80:0/2282770664 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d400b910 con 0x7f06dc0d0d40 2024-05-10T04:22:33.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.397+0000 7f06dbe00700 1 -- 172.21.15.80:0/2282770664 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d400bcc0 con 0x7f06dc0d0d40 2024-05-10T04:22:33.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.398+0000 7f06e4600700 1 -- 172.21.15.80:0/2282770664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc0d0d40 msgr2=0x7f06dc0d3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:33.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.398+0000 7f06e4600700 1 --2- 172.21.15.80:0/2282770664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc0d0d40 0x7f06dc0d3440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009e50 tx=0x7f06d400b330 comp rx=0 tx=0).stop 2024-05-10T04:22:33.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.398+0000 7f06e4600700 1 -- 172.21.15.80:0/2282770664 shutdown_connections 2024-05-10T04:22:33.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.398+0000 7f06e4600700 1 --2- 172.21.15.80:0/2282770664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc0d0d40 0x7f06dc0d3440 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.398+0000 7f06e4600700 1 --2- 172.21.15.80:0/2282770664 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06dc0b2f50 0x7f06dc161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.398+0000 7f06e4600700 1 -- 172.21.15.80:0/2282770664 >> 172.21.15.80:0/2282770664 conn(0x7f06dc06c3f0 msgr2=0x7f06dc06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:33.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.398+0000 7f06e4600700 1 -- 172.21.15.80:0/2282770664 shutdown_connections 2024-05-10T04:22:33.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.398+0000 7f06e4600700 1 -- 172.21.15.80:0/2282770664 wait complete. 2024-05-10T04:22:33.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.400+0000 7f06e4600700 1 Processor -- start 2024-05-10T04:22:33.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.400+0000 7f06e4600700 1 -- start start 2024-05-10T04:22:33.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.402+0000 7f06e4600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc0b2f50 0x7f06dc0cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:33.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.402+0000 7f06e4600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06dc0d0d40 0x7f06dc0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:33.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.402+0000 7f06e4600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06dc0d3030 0x7f06dc1f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:33.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.402+0000 7f06e4600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc14de00 con 0x7f06dc0d0d40 2024-05-10T04:22:33.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.402+0000 7f06e4600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc14e260 con 0x7f06dc0b2f50 2024-05-10T04:22:33.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.402+0000 7f06e4600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc1f6020 con 0x7f06dc0d3030 2024-05-10T04:22:33.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.402+0000 7f06e1200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06dc0d0d40 0x7f06dc0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:33.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.402+0000 7f06e1c00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc0b2f50 0x7f06dc0cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:33.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.402+0000 7f06e1200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06dc0d0d40 0x7f06dc0cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33730/0 (socket says 172.21.15.80:33730) 2024-05-10T04:22:33.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.402+0000 7f06e1200700 1 -- 172.21.15.80:0/1578422191 learned_addr learned my addr 172.21.15.80:0/1578422191 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:33.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.402+0000 7f06e2600700 1 --2- 172.21.15.80:0/1578422191 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06dc0d3030 0x7f06dc1f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:33.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.403+0000 7f06e1200700 1 -- 172.21.15.80:0/1578422191 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06dc0d3030 msgr2=0x7f06dc1f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:33.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.403+0000 7f06e1200700 1 --2- 172.21.15.80:0/1578422191 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06dc0d3030 0x7f06dc1f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.403+0000 7f06e1200700 1 -- 172.21.15.80:0/1578422191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc0b2f50 msgr2=0x7f06dc0cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:33.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.403+0000 7f06e1200700 1 --2- 172.21.15.80:0/1578422191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc0b2f50 0x7f06dc0cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.403+0000 7f06e1200700 1 -- 172.21.15.80:0/1578422191 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d00094a0 con 0x7f06dc0d0d40 2024-05-10T04:22:33.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.403+0000 7f06e1200700 1 --2- 172.21.15.80:0/1578422191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06dc0d0d40 0x7f06dc0cd1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f06c800c450 tx=0x7f06c800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:33.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.403+0000 7f06d9600700 1 -- 172.21.15.80:0/1578422191 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c80052d0 con 0x7f06dc0d0d40 2024-05-10T04:22:33.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.403+0000 7f06d9600700 1 -- 172.21.15.80:0/1578422191 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c8005430 con 0x7f06dc0d0d40 2024-05-10T04:22:33.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.403+0000 7f06e4600700 1 -- 172.21.15.80:0/1578422191 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d4009b30 con 0x7f06dc0d0d40 2024-05-10T04:22:33.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.403+0000 7f06d9600700 1 -- 172.21.15.80:0/1578422191 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c80038c0 con 0x7f06dc0d0d40 2024-05-10T04:22:33.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.403+0000 7f06e4600700 1 -- 172.21.15.80:0/1578422191 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc1f6e80 con 0x7f06dc0d0d40 2024-05-10T04:22:33.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.405+0000 7f06e4600700 1 -- 172.21.15.80:0/1578422191 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06dc0cbc80 con 0x7f06dc0d0d40 2024-05-10T04:22:33.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.406+0000 7f06d9600700 1 -- 172.21.15.80:0/1578422191 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f06c8003a20 con 0x7f06dc0d0d40 2024-05-10T04:22:33.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.406+0000 7f06d9600700 1 --2- 172.21.15.80:0/1578422191 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f06bc06ac90 0x7f06bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:33.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.407+0000 7f06d9600700 1 -- 172.21.15.80:0/1578422191 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f06c8088370 con 0x7f06dc0d0d40 2024-05-10T04:22:33.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.407+0000 7f06e1c00700 1 --2- 172.21.15.80:0/1578422191 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f06bc06ac90 0x7f06bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:33.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.408+0000 7f06e1c00700 1 --2- 172.21.15.80:0/1578422191 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f06bc06ac90 0x7f06bc06d1a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f06dc08d080 tx=0x7f06d0009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:33.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.411+0000 7f06d9600700 1 -- 172.21.15.80:0/1578422191 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f06dc0cbc80 con 0x7f06dc0d0d40 2024-05-10T04:22:33.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.659+0000 7f06e4600700 1 -- 172.21.15.80:0/1578422191 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06dc1f7030 con 0x7f06dc0d0d40 2024-05-10T04:22:33.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.660+0000 7f06d9600700 1 -- 172.21.15.80:0/1578422191 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f06c8017de0 con 0x7f06dc0d0d40 2024-05-10T04:22:33.661 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:33.661 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4189316245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4189316245},{"type":"v1","addr":"172.21.15.106:6836","nonce":4189316245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/4150483341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":4150483341},{"type":"v1","addr":"172.21.15.80:6833","nonce":4150483341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1287697381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1287697381},{"type":"v1","addr":"172.21.15.80:6835","nonce":1287697381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/961352916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":961352916},{"type":"v1","addr":"172.21.15.106:6837","nonce":961352916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-05-10T04:22:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.662+0000 7f06e4600700 1 -- 172.21.15.80:0/1578422191 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f06bc06ac90 msgr2=0x7f06bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.662+0000 7f06e4600700 1 --2- 172.21.15.80:0/1578422191 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f06bc06ac90 0x7f06bc06d1a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f06dc08d080 tx=0x7f06d0009210 comp rx=0 tx=0).stop 2024-05-10T04:22:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.662+0000 7f06e4600700 1 -- 172.21.15.80:0/1578422191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06dc0d0d40 msgr2=0x7f06dc0cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.662+0000 7f06e4600700 1 --2- 172.21.15.80:0/1578422191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06dc0d0d40 0x7f06dc0cd1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f06c800c450 tx=0x7f06c800c760 comp rx=0 tx=0).stop 2024-05-10T04:22:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.662+0000 7f06e4600700 1 -- 172.21.15.80:0/1578422191 shutdown_connections 2024-05-10T04:22:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.662+0000 7f06e4600700 1 --2- 172.21.15.80:0/1578422191 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f06bc06ac90 0x7f06bc06d1a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.662+0000 7f06e4600700 1 --2- 172.21.15.80:0/1578422191 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06dc0d3030 0x7f06dc1f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.662+0000 7f06e4600700 1 --2- 172.21.15.80:0/1578422191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc0b2f50 0x7f06dc0cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.662+0000 7f06e4600700 1 --2- 172.21.15.80:0/1578422191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06dc0d0d40 0x7f06dc0cd1a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.662+0000 7f06e4600700 1 -- 172.21.15.80:0/1578422191 >> 172.21.15.80:0/1578422191 conn(0x7f06dc06c3f0 msgr2=0x7f06dc0b4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.662+0000 7f06e4600700 1 -- 172.21.15.80:0/1578422191 shutdown_connections 2024-05-10T04:22:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.662+0000 7f06e4600700 1 -- 172.21.15.80:0/1578422191 wait complete. 2024-05-10T04:22:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 3 2024-05-10T04:22:33.688 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:22:33.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.947+0000 7fb886400700 1 Processor -- start 2024-05-10T04:22:33.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.947+0000 7fb886400700 1 -- start start 2024-05-10T04:22:33.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.949+0000 7fb886400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8800ce800 0x7fb8800b9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:33.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.949+0000 7fb886400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb880161d00 0x7fb8800d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:33.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.949+0000 7fb886400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8800d2810 con 0x7fb880162110 2024-05-10T04:22:33.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.949+0000 7fb886400700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8800b6c10 con 0x7fb880161d00 2024-05-10T04:22:33.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.949+0000 7fb886400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb880162600 con 0x7fb8800ce800 2024-05-10T04:22:33.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.950+0000 7fb885a00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb880162110 0x7fb8800d0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39562/0 (socket says 172.21.15.80:39562) 2024-05-10T04:22:33.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.950+0000 7fb885a00700 1 -- 172.21.15.80:0/3461826067 learned_addr learned my addr 172.21.15.80:0/3461826067 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:33.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.950+0000 7fb87fe00700 1 --2- 172.21.15.80:0/3461826067 >> v2:172.21.15.106:3300/0 conn(0x7fb880161d00 0x7fb8800d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:33.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.950+0000 7fb885000700 1 --2- 172.21.15.80:0/3461826067 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8800ce800 0x7fb8800b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:33.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.950+0000 7fb87f400700 1 -- 172.21.15.80:0/3461826067 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336775012 0 0) 0x7fb8800d2810 con 0x7fb880162110 2024-05-10T04:22:33.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.950+0000 7fb87f400700 1 -- 172.21.15.80:0/3461826067 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8680035b0 con 0x7fb880162110 2024-05-10T04:22:33.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.950+0000 7fb885000700 1 -- 172.21.15.80:0/3461826067 >> v2:172.21.15.106:3300/0 conn(0x7fb880161d00 msgr2=0x7fb8800d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:33.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.950+0000 7fb885000700 1 --2- 172.21.15.80:0/3461826067 >> v2:172.21.15.106:3300/0 conn(0x7fb880161d00 0x7fb8800d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.950+0000 7fb885000700 1 -- 172.21.15.80:0/3461826067 >> v1:172.21.15.80:6789/0 conn(0x7fb880162110 legacy=0x7fb8800d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:33.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.950+0000 7fb885000700 1 -- 172.21.15.80:0/3461826067 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8801628e0 con 0x7fb8800ce800 2024-05-10T04:22:33.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.950+0000 7fb885000700 1 --2- 172.21.15.80:0/3461826067 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8800ce800 0x7fb8800b9340 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb874009840 tx=0x7fb874009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=551bb50f47aaa2e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:33.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.951+0000 7fb87f400700 1 -- 172.21.15.80:0/3461826067 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874011830 con 0x7fb8800ce800 2024-05-10T04:22:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.951+0000 7fb87f400700 1 -- 172.21.15.80:0/3461826067 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb874011990 con 0x7fb8800ce800 2024-05-10T04:22:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.951+0000 7fb87f400700 1 -- 172.21.15.80:0/3461826067 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874011d20 con 0x7fb8800ce800 2024-05-10T04:22:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.951+0000 7fb886400700 1 -- 172.21.15.80:0/3461826067 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8800ce800 msgr2=0x7fb8800b9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.951+0000 7fb886400700 1 --2- 172.21.15.80:0/3461826067 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8800ce800 0x7fb8800b9340 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb874009840 tx=0x7fb874009b50 comp rx=0 tx=0).stop 2024-05-10T04:22:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.952+0000 7fb886400700 1 -- 172.21.15.80:0/3461826067 shutdown_connections 2024-05-10T04:22:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.952+0000 7fb886400700 1 --2- 172.21.15.80:0/3461826067 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8800ce800 0x7fb8800b9340 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.952+0000 7fb886400700 1 --2- 172.21.15.80:0/3461826067 >> v2:172.21.15.106:3300/0 conn(0x7fb880161d00 0x7fb8800d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.952+0000 7fb886400700 1 -- 172.21.15.80:0/3461826067 >> 172.21.15.80:0/3461826067 conn(0x7fb88006c730 msgr2=0x7fb88006cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.952+0000 7fb886400700 1 -- 172.21.15.80:0/3461826067 shutdown_connections 2024-05-10T04:22:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.952+0000 7fb886400700 1 -- 172.21.15.80:0/3461826067 wait complete. 2024-05-10T04:22:33.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.954+0000 7fb886400700 1 Processor -- start 2024-05-10T04:22:33.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.955+0000 7fb886400700 1 -- start start 2024-05-10T04:22:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.956+0000 7fb886400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8800ce800 0x7fb88014f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.956+0000 7fb886400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb880161d00 0x7fb8800cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.956+0000 7fb886400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb880162110 0x7fb8800cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.956+0000 7fb886400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8801f40b0 con 0x7fb880162110 2024-05-10T04:22:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.956+0000 7fb886400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8800cc510 con 0x7fb880161d00 2024-05-10T04:22:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.956+0000 7fb886400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8800cc250 con 0x7fb8800ce800 2024-05-10T04:22:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.957+0000 7fb885a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb880162110 0x7fb8800cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.957+0000 7fb885a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb880162110 0x7fb8800cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33742/0 (socket says 172.21.15.80:33742) 2024-05-10T04:22:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.957+0000 7fb885a00700 1 -- 172.21.15.80:0/868914516 learned_addr learned my addr 172.21.15.80:0/868914516 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.957+0000 7fb87fe00700 1 --2- 172.21.15.80:0/868914516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb880161d00 0x7fb8800cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.957+0000 7fb885000700 1 --2- 172.21.15.80:0/868914516 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8800ce800 0x7fb88014f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.957+0000 7fb885a00700 1 -- 172.21.15.80:0/868914516 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8800ce800 msgr2=0x7fb88014f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.957+0000 7fb885a00700 1 --2- 172.21.15.80:0/868914516 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8800ce800 0x7fb88014f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.957+0000 7fb885a00700 1 -- 172.21.15.80:0/868914516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb880161d00 msgr2=0x7fb8800cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.957+0000 7fb885a00700 1 --2- 172.21.15.80:0/868914516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb880161d00 0x7fb8800cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.957+0000 7fb885a00700 1 -- 172.21.15.80:0/868914516 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8740094a0 con 0x7fb880162110 2024-05-10T04:22:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.957+0000 7fb87fe00700 1 --2- 172.21.15.80:0/868914516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb880161d00 0x7fb8800cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.957+0000 7fb885000700 1 --2- 172.21.15.80:0/868914516 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8800ce800 0x7fb88014f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.957+0000 7fb885a00700 1 --2- 172.21.15.80:0/868914516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb880162110 0x7fb8800cca00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb87800caa0 tx=0x7fb87800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.958+0000 7fb87cc00700 1 -- 172.21.15.80:0/868914516 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87800aa40 con 0x7fb880162110 2024-05-10T04:22:33.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.958+0000 7fb87cc00700 1 -- 172.21.15.80:0/868914516 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87800aba0 con 0x7fb880162110 2024-05-10T04:22:33.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.958+0000 7fb886400700 1 -- 172.21.15.80:0/868914516 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb880159a50 con 0x7fb880162110 2024-05-10T04:22:33.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.958+0000 7fb87cc00700 1 -- 172.21.15.80:0/868914516 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb878012400 con 0x7fb880162110 2024-05-10T04:22:33.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.958+0000 7fb886400700 1 -- 172.21.15.80:0/868914516 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb88015a010 con 0x7fb880162110 2024-05-10T04:22:33.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.959+0000 7fb886400700 1 -- 172.21.15.80:0/868914516 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8800b33e0 con 0x7fb880162110 2024-05-10T04:22:33.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.960+0000 7fb87cc00700 1 -- 172.21.15.80:0/868914516 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb87801b3b0 con 0x7fb880162110 2024-05-10T04:22:33.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.961+0000 7fb87cc00700 1 --2- 172.21.15.80:0/868914516 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb86006acc0 0x7fb86006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:33.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.961+0000 7fb87cc00700 1 -- 172.21.15.80:0/868914516 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb878088c30 con 0x7fb880162110 2024-05-10T04:22:33.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.961+0000 7fb885000700 1 --2- 172.21.15.80:0/868914516 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb86006acc0 0x7fb86006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:33.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.962+0000 7fb885000700 1 --2- 172.21.15.80:0/868914516 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb86006acc0 0x7fb86006d1d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb874000c00 tx=0x7fb874008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:33.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:33.965+0000 7fb87cc00700 1 -- 172.21.15.80:0/868914516 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb8780540e0 con 0x7fb880162110 2024-05-10T04:22:34.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.172+0000 7fb886400700 1 -- 172.21.15.80:0/868914516 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb880074af0 con 0x7fb880162110 2024-05-10T04:22:34.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.173+0000 7fb87cc00700 1 -- 172.21.15.80:0/868914516 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7fb878017020 con 0x7fb880162110 2024-05-10T04:22:34.174 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:34.174 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":16,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:28.818765+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:22:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.175+0000 7fb886400700 1 -- 172.21.15.80:0/868914516 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb86006acc0 msgr2=0x7fb86006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.175+0000 7fb886400700 1 --2- 172.21.15.80:0/868914516 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb86006acc0 0x7fb86006d1d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb874000c00 tx=0x7fb874008030 comp rx=0 tx=0).stop 2024-05-10T04:22:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.175+0000 7fb886400700 1 -- 172.21.15.80:0/868914516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb880162110 msgr2=0x7fb8800cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.175+0000 7fb886400700 1 --2- 172.21.15.80:0/868914516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb880162110 0x7fb8800cca00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb87800caa0 tx=0x7fb87800ce60 comp rx=0 tx=0).stop 2024-05-10T04:22:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.175+0000 7fb886400700 1 -- 172.21.15.80:0/868914516 shutdown_connections 2024-05-10T04:22:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.175+0000 7fb886400700 1 --2- 172.21.15.80:0/868914516 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb86006acc0 0x7fb86006d1d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.175+0000 7fb886400700 1 --2- 172.21.15.80:0/868914516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb880162110 0x7fb8800cca00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.175+0000 7fb886400700 1 --2- 172.21.15.80:0/868914516 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8800ce800 0x7fb88014f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.175+0000 7fb886400700 1 --2- 172.21.15.80:0/868914516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb880161d00 0x7fb8800cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.175+0000 7fb886400700 1 -- 172.21.15.80:0/868914516 >> 172.21.15.80:0/868914516 conn(0x7fb88006c730 msgr2=0x7fb880161000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.176+0000 7fb886400700 1 -- 172.21.15.80:0/868914516 shutdown_connections 2024-05-10T04:22:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.176+0000 7fb886400700 1 -- 172.21.15.80:0/868914516 wait complete. 2024-05-10T04:22:34.201 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:22:26.793377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:22:34.202 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:22:34.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.463+0000 7f2f72600700 1 Processor -- start 2024-05-10T04:22:34.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.464+0000 7f2f72600700 1 -- start start 2024-05-10T04:22:34.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.465+0000 7f2f72600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2f6c162150 0x7f2f6c15e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:34.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.465+0000 7f2f72600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c0cf4d0 0x7f2f6c0b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.465+0000 7f2f72600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2f6c0b7910 0x7f2f6c06c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.465+0000 7f2f72600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6c0d2c00 con 0x7f2f6c0b7910 2024-05-10T04:22:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.465+0000 7f2f72600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6c162630 con 0x7f2f6c162150 2024-05-10T04:22:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.465+0000 7f2f72600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c162910 con 0x7f2f6c0cf4d0 2024-05-10T04:22:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.466+0000 7f2f6be00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2f6c0b7910 0x7f2f6c06c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.466+0000 7f2f63e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c0cf4d0 0x7f2f6c0b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.466+0000 7f2f6be00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2f6c0b7910 0x7f2f6c06c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33750/0 (socket says 172.21.15.80:33750) 2024-05-10T04:22:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.466+0000 7f2f6be00700 1 -- 172.21.15.80:0/3613023141 learned_addr learned my addr 172.21.15.80:0/3613023141 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.466+0000 7f2f6b400700 1 --2- 172.21.15.80:0/3613023141 >> v2:172.21.15.106:3300/0 conn(0x7f2f6c162150 0x7f2f6c15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.466+0000 7f2f6be00700 1 -- 172.21.15.80:0/3613023141 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c0cf4d0 msgr2=0x7f2f6c0b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.466+0000 7f2f6be00700 1 --2- 172.21.15.80:0/3613023141 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c0cf4d0 0x7f2f6c0b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.466+0000 7f2f6be00700 1 -- 172.21.15.80:0/3613023141 >> v2:172.21.15.106:3300/0 conn(0x7f2f6c162150 msgr2=0x7f2f6c15e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.466+0000 7f2f6be00700 1 --2- 172.21.15.80:0/3613023141 >> v2:172.21.15.106:3300/0 conn(0x7f2f6c162150 0x7f2f6c15e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.466+0000 7f2f6be00700 1 -- 172.21.15.80:0/3613023141 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c162bf0 con 0x7f2f6c0b7910 2024-05-10T04:22:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.466+0000 7f2f6be00700 1 --2- 172.21.15.80:0/3613023141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c0b7910 0x7f2f6c06c160 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c073340 tx=0x7f2f6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4849c18ea385e86 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.466+0000 7f2f6aa00700 1 -- 172.21.15.80:0/3613023141 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6400e070 con 0x7f2f6c0b7910 2024-05-10T04:22:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.467+0000 7f2f6aa00700 1 -- 172.21.15.80:0/3613023141 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6400b910 con 0x7f2f6c0b7910 2024-05-10T04:22:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.467+0000 7f2f6aa00700 1 -- 172.21.15.80:0/3613023141 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6400bcc0 con 0x7f2f6c0b7910 2024-05-10T04:22:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.467+0000 7f2f72600700 1 -- 172.21.15.80:0/3613023141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c0b7910 msgr2=0x7f2f6c06c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.467+0000 7f2f72600700 1 --2- 172.21.15.80:0/3613023141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c0b7910 0x7f2f6c06c160 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c073340 tx=0x7f2f6400b330 comp rx=0 tx=0).stop 2024-05-10T04:22:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.467+0000 7f2f72600700 1 -- 172.21.15.80:0/3613023141 shutdown_connections 2024-05-10T04:22:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.467+0000 7f2f72600700 1 --2- 172.21.15.80:0/3613023141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c0b7910 0x7f2f6c06c160 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.467+0000 7f2f72600700 1 --2- 172.21.15.80:0/3613023141 >> v2:172.21.15.106:3300/0 conn(0x7f2f6c162150 0x7f2f6c15e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.467+0000 7f2f72600700 1 --2- 172.21.15.80:0/3613023141 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c0cf4d0 0x7f2f6c0b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.467+0000 7f2f72600700 1 -- 172.21.15.80:0/3613023141 >> 172.21.15.80:0/3613023141 conn(0x7f2f6c0d3e10 msgr2=0x7f2f6c0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:34.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.467+0000 7f2f72600700 1 -- 172.21.15.80:0/3613023141 shutdown_connections 2024-05-10T04:22:34.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.467+0000 7f2f72600700 1 -- 172.21.15.80:0/3613023141 wait complete. 2024-05-10T04:22:34.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.470+0000 7f2f72600700 1 Processor -- start 2024-05-10T04:22:34.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.470+0000 7f2f72600700 1 -- start start 2024-05-10T04:22:34.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.472+0000 7f2f72600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c0b7910 0x7f2f6c15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:34.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.472+0000 7f2f72600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f6c0cf4d0 0x7f2f6c1476c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:34.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.472+0000 7f2f72600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c162150 0x7f2f6c149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:34.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.472+0000 7f2f72600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c15f220 con 0x7f2f6c0b7910 2024-05-10T04:22:34.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.472+0000 7f2f72600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c148c00 con 0x7f2f6c0cf4d0 2024-05-10T04:22:34.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.472+0000 7f2f72600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c147ff0 con 0x7f2f6c162150 2024-05-10T04:22:34.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.472+0000 7f2f6b400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c0b7910 0x7f2f6c15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:34.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.472+0000 7f2f6b400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c0b7910 0x7f2f6c15ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33754/0 (socket says 172.21.15.80:33754) 2024-05-10T04:22:34.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.472+0000 7f2f6b400700 1 -- 172.21.15.80:0/615468816 learned_addr learned my addr 172.21.15.80:0/615468816 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:34.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.473+0000 7f2f6be00700 1 --2- 172.21.15.80:0/615468816 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c162150 0x7f2f6c149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:34.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.473+0000 7f2f63e00700 1 --2- 172.21.15.80:0/615468816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f6c0cf4d0 0x7f2f6c1476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:34.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.473+0000 7f2f6b400700 1 -- 172.21.15.80:0/615468816 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c162150 msgr2=0x7f2f6c149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:34.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.473+0000 7f2f6b400700 1 --2- 172.21.15.80:0/615468816 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c162150 0x7f2f6c149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.473+0000 7f2f6b400700 1 -- 172.21.15.80:0/615468816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f6c0cf4d0 msgr2=0x7f2f6c1476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:34.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.473+0000 7f2f6b400700 1 --2- 172.21.15.80:0/615468816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f6c0cf4d0 0x7f2f6c1476c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.473+0000 7f2f6b400700 1 -- 172.21.15.80:0/615468816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f64009b30 con 0x7f2f6c0b7910 2024-05-10T04:22:34.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.473+0000 7f2f63e00700 1 --2- 172.21.15.80:0/615468816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f6c0cf4d0 0x7f2f6c1476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:22:34.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.473+0000 7f2f6b400700 1 --2- 172.21.15.80:0/615468816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c0b7910 0x7f2f6c15ebe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00e840 tx=0x7f2f5c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:34.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.473+0000 7f2f63400700 1 -- 172.21.15.80:0/615468816 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c009590 con 0x7f2f6c0b7910 2024-05-10T04:22:34.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.473+0000 7f2f63400700 1 -- 172.21.15.80:0/615468816 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c013680 con 0x7f2f6c0b7910 2024-05-10T04:22:34.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.473+0000 7f2f72600700 1 -- 172.21.15.80:0/615468816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c1482d0 con 0x7f2f6c0b7910 2024-05-10T04:22:34.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.473+0000 7f2f63400700 1 -- 172.21.15.80:0/615468816 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c013a10 con 0x7f2f6c0b7910 2024-05-10T04:22:34.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.474+0000 7f2f72600700 1 -- 172.21.15.80:0/615468816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c148890 con 0x7f2f6c0b7910 2024-05-10T04:22:34.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.474+0000 7f2f72600700 1 -- 172.21.15.80:0/615468816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c148db0 con 0x7f2f6c0b7910 2024-05-10T04:22:34.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.475+0000 7f2f63400700 1 -- 172.21.15.80:0/615468816 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2f5c013b70 con 0x7f2f6c0b7910 2024-05-10T04:22:34.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.476+0000 7f2f63400700 1 --2- 172.21.15.80:0/615468816 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2f4806ac90 0x7f2f4806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:34.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.476+0000 7f2f63400700 1 -- 172.21.15.80:0/615468816 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2f5c0893d0 con 0x7f2f6c0b7910 2024-05-10T04:22:34.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.477+0000 7f2f63e00700 1 --2- 172.21.15.80:0/615468816 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2f4806ac90 0x7f2f4806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:34.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.477+0000 7f2f63e00700 1 --2- 172.21.15.80:0/615468816 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2f4806ac90 0x7f2f4806d1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c149ed0 tx=0x7f2f54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:34.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.481+0000 7f2f63400700 1 -- 172.21.15.80:0/615468816 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2f6c148db0 con 0x7f2f6c0b7910 2024-05-10T04:22:34.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.683+0000 7f2f72600700 1 -- 172.21.15.80:0/615468816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f6c148d70 con 0x7f2f6c0b7910 2024-05-10T04:22:34.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.683+0000 7f2f63400700 1 -- 172.21.15.80:0/615468816 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f5c017020 con 0x7f2f6c0b7910 2024-05-10T04:22:34.685 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-10T04:22:34.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.686+0000 7f2f72600700 1 -- 172.21.15.80:0/615468816 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2f4806ac90 msgr2=0x7f2f4806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:34.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.686+0000 7f2f72600700 1 --2- 172.21.15.80:0/615468816 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2f4806ac90 0x7f2f4806d1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c149ed0 tx=0x7f2f54008040 comp rx=0 tx=0).stop 2024-05-10T04:22:34.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.686+0000 7f2f72600700 1 -- 172.21.15.80:0/615468816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c0b7910 msgr2=0x7f2f6c15ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:34.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.686+0000 7f2f72600700 1 --2- 172.21.15.80:0/615468816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c0b7910 0x7f2f6c15ebe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00e840 tx=0x7f2f5c00ec00 comp rx=0 tx=0).stop 2024-05-10T04:22:34.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.686+0000 7f2f72600700 1 -- 172.21.15.80:0/615468816 shutdown_connections 2024-05-10T04:22:34.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.686+0000 7f2f72600700 1 --2- 172.21.15.80:0/615468816 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2f4806ac90 0x7f2f4806d1a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.686+0000 7f2f72600700 1 --2- 172.21.15.80:0/615468816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c0b7910 0x7f2f6c15ebe0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.686+0000 7f2f72600700 1 --2- 172.21.15.80:0/615468816 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c162150 0x7f2f6c149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.686+0000 7f2f72600700 1 --2- 172.21.15.80:0/615468816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f6c0cf4d0 0x7f2f6c1476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.686+0000 7f2f72600700 1 -- 172.21.15.80:0/615468816 >> 172.21.15.80:0/615468816 conn(0x7f2f6c0d3e10 msgr2=0x7f2f6c06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:34.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.686+0000 7f2f72600700 1 -- 172.21.15.80:0/615468816 shutdown_connections 2024-05-10T04:22:34.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.686+0000 7f2f72600700 1 -- 172.21.15.80:0/615468816 wait complete. 2024-05-10T04:22:34.712 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T04:22:34.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.970+0000 7f471aa00700 1 Processor -- start 2024-05-10T04:22:34.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.971+0000 7f471aa00700 1 -- start start 2024-05-10T04:22:34.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.972+0000 7f471aa00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f47140d3460 0x7f47140b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:34.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.972+0000 7f471aa00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47141620e0 0x7f47141624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:34.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.972+0000 7f471aa00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47140d2730 con 0x7f47140b58b0 2024-05-10T04:22:34.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.972+0000 7f471aa00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47140b3720 con 0x7f47140d3460 2024-05-10T04:22:34.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.972+0000 7f471aa00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47140d2fd0 con 0x7f47141620e0 2024-05-10T04:22:34.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.973+0000 7f4718a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47141620e0 0x7f47141624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:34.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.973+0000 7f4713400700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f47140b58b0 0x7f47140b5cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:55106/0 (socket says 172.21.15.80:55106) 2024-05-10T04:22:34.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.973+0000 7f4713e00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f47140d3460 0x7f47140b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:34.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.973+0000 7f4713400700 1 -- 172.21.15.80:0/1529433292 learned_addr learned my addr 172.21.15.80:0/1529433292 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:34.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.973+0000 7f4712a00700 1 -- 172.21.15.80:0/1529433292 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503165056 0 0) 0x7f47140d2730 con 0x7f47140b58b0 2024-05-10T04:22:34.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.973+0000 7f4712a00700 1 -- 172.21.15.80:0/1529433292 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46f80035b0 con 0x7f47140b58b0 2024-05-10T04:22:34.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.973+0000 7f4713e00700 1 -- 172.21.15.80:0/1529433292 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47141620e0 msgr2=0x7f47141624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:34.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.973+0000 7f4713e00700 1 --2- 172.21.15.80:0/1529433292 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47141620e0 0x7f47141624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.973+0000 7f4713e00700 1 -- 172.21.15.80:0/1529433292 >> v1:172.21.15.106:6789/0 conn(0x7f47140b58b0 legacy=0x7f47140b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:34.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.973+0000 7f4713e00700 1 -- 172.21.15.80:0/1529433292 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4714162e10 con 0x7f47140d3460 2024-05-10T04:22:34.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.973+0000 7f4718a00700 1 --2- 172.21.15.80:0/1529433292 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47141620e0 0x7f47141624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:34.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.974+0000 7f4713e00700 1 --2- 172.21.15.80:0/1529433292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47140d3460 0x7f47140b31e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4704009840 tx=0x7f4704009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac68fba78f2232f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:34.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.974+0000 7f4712a00700 1 -- 172.21.15.80:0/1529433292 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704011830 con 0x7f47140d3460 2024-05-10T04:22:34.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.974+0000 7f4712a00700 1 -- 172.21.15.80:0/1529433292 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4704011990 con 0x7f47140d3460 2024-05-10T04:22:34.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.974+0000 7f4712a00700 1 -- 172.21.15.80:0/1529433292 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704011d20 con 0x7f47140d3460 2024-05-10T04:22:34.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.975+0000 7f471aa00700 1 -- 172.21.15.80:0/1529433292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47140d3460 msgr2=0x7f47140b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:34.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.975+0000 7f471aa00700 1 --2- 172.21.15.80:0/1529433292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47140d3460 0x7f47140b31e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4704009840 tx=0x7f4704009b50 comp rx=0 tx=0).stop 2024-05-10T04:22:34.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.975+0000 7f471aa00700 1 -- 172.21.15.80:0/1529433292 shutdown_connections 2024-05-10T04:22:34.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.975+0000 7f471aa00700 1 --2- 172.21.15.80:0/1529433292 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47141620e0 0x7f47141624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.975+0000 7f471aa00700 1 --2- 172.21.15.80:0/1529433292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47140d3460 0x7f47140b31e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.975+0000 7f471aa00700 1 -- 172.21.15.80:0/1529433292 >> 172.21.15.80:0/1529433292 conn(0x7f47140d0a90 msgr2=0x7f47140d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:34.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.975+0000 7f471aa00700 1 -- 172.21.15.80:0/1529433292 shutdown_connections 2024-05-10T04:22:34.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.975+0000 7f471aa00700 1 -- 172.21.15.80:0/1529433292 wait complete. 2024-05-10T04:22:34.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.977+0000 7f471aa00700 1 Processor -- start 2024-05-10T04:22:34.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.977+0000 7f471aa00700 1 -- start start 2024-05-10T04:22:34.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.978+0000 7f471aa00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47140b58b0 0x7f47141f71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:34.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.979+0000 7f471aa00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47140d3460 0x7f471415b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:34.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.979+0000 7f471aa00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47141620e0 0x7f47140c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:34.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.979+0000 7f471aa00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47141f56c0 con 0x7f47140b58b0 2024-05-10T04:22:34.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.979+0000 7f471aa00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471415bbd0 con 0x7f47140d3460 2024-05-10T04:22:34.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.979+0000 7f471aa00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4714158be0 con 0x7f47141620e0 2024-05-10T04:22:34.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.979+0000 7f4713e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47140b58b0 0x7f47141f71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:34.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.979+0000 7f4713e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47140b58b0 0x7f47141f71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33764/0 (socket says 172.21.15.80:33764) 2024-05-10T04:22:34.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.979+0000 7f4713e00700 1 -- 172.21.15.80:0/4007762178 learned_addr learned my addr 172.21.15.80:0/4007762178 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:34.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.979+0000 7f4718a00700 1 --2- 172.21.15.80:0/4007762178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47141620e0 0x7f47140c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:34.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.979+0000 7f4713400700 1 --2- 172.21.15.80:0/4007762178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47140d3460 0x7f471415b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:34.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.979+0000 7f4713e00700 1 -- 172.21.15.80:0/4007762178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47141620e0 msgr2=0x7f47140c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:34.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.979+0000 7f4713e00700 1 --2- 172.21.15.80:0/4007762178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47141620e0 0x7f47140c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.979+0000 7f4713e00700 1 -- 172.21.15.80:0/4007762178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47140d3460 msgr2=0x7f471415b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:34.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.979+0000 7f4713e00700 1 --2- 172.21.15.80:0/4007762178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47140d3460 0x7f471415b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:34.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.979+0000 7f4713e00700 1 -- 172.21.15.80:0/4007762178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c009a70 con 0x7f47140b58b0 2024-05-10T04:22:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.980+0000 7f4713e00700 1 --2- 172.21.15.80:0/4007762178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47140b58b0 0x7f47141f71c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4704009fd0 tx=0x7f4704004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.980+0000 7f470be00700 1 -- 172.21.15.80:0/4007762178 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704004550 con 0x7f47140b58b0 2024-05-10T04:22:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.980+0000 7f470be00700 1 -- 172.21.15.80:0/4007762178 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470401e070 con 0x7f47140b58b0 2024-05-10T04:22:34.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.980+0000 7f471aa00700 1 -- 172.21.15.80:0/4007762178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47040094a0 con 0x7f47140b58b0 2024-05-10T04:22:34.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.980+0000 7f470be00700 1 -- 172.21.15.80:0/4007762178 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47040038e0 con 0x7f47140b58b0 2024-05-10T04:22:34.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.980+0000 7f471aa00700 1 -- 172.21.15.80:0/4007762178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4714158e80 con 0x7f47140b58b0 2024-05-10T04:22:34.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.981+0000 7f471aa00700 1 -- 172.21.15.80:0/4007762178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47141597b0 con 0x7f47140b58b0 2024-05-10T04:22:34.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.982+0000 7f470be00700 1 -- 172.21.15.80:0/4007762178 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4704003a40 con 0x7f47140b58b0 2024-05-10T04:22:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.983+0000 7f470be00700 1 --2- 172.21.15.80:0/4007762178 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f46f406ac90 0x7f46f406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.983+0000 7f470be00700 1 -- 172.21.15.80:0/4007762178 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4704089e90 con 0x7f47140b58b0 2024-05-10T04:22:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.983+0000 7f4713400700 1 --2- 172.21.15.80:0/4007762178 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f46f406ac90 0x7f46f406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.984+0000 7f4713400700 1 --2- 172.21.15.80:0/4007762178 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f46f406ac90 0x7f46f406d1a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f471415aa00 tx=0x7f4700007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:34.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:34.987+0000 7f470be00700 1 -- 172.21.15.80:0/4007762178 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4704055320 con 0x7f47140b58b0 2024-05-10T04:22:35.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.195+0000 7f471aa00700 1 -- 172.21.15.80:0/4007762178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f47140732b0 con 0x7f47140b58b0 2024-05-10T04:22:35.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.195+0000 7f470be00700 1 -- 172.21.15.80:0/4007762178 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4704020090 con 0x7f47140b58b0 2024-05-10T04:22:35.196 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:35.197 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2024-05-10T04:22:35.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:22:35.197 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2024-05-10T04:22:35.197 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": ".mgr" 2024-05-10T04:22:35.197 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:22:35.197 INFO:teuthology.orchestra.run.smithi080.stdout:] 2024-05-10T04:22:35.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.197+0000 7f471aa00700 1 -- 172.21.15.80:0/4007762178 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f46f406ac90 msgr2=0x7f46f406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:35.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.198+0000 7f471aa00700 1 --2- 172.21.15.80:0/4007762178 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f46f406ac90 0x7f46f406d1a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f471415aa00 tx=0x7f4700007dc0 comp rx=0 tx=0).stop 2024-05-10T04:22:35.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.198+0000 7f471aa00700 1 -- 172.21.15.80:0/4007762178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47140b58b0 msgr2=0x7f47141f71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:35.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.198+0000 7f471aa00700 1 --2- 172.21.15.80:0/4007762178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47140b58b0 0x7f47141f71c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4704009fd0 tx=0x7f4704004750 comp rx=0 tx=0).stop 2024-05-10T04:22:35.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.198+0000 7f471aa00700 1 -- 172.21.15.80:0/4007762178 shutdown_connections 2024-05-10T04:22:35.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.198+0000 7f471aa00700 1 --2- 172.21.15.80:0/4007762178 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f46f406ac90 0x7f46f406d1a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:35.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.198+0000 7f471aa00700 1 --2- 172.21.15.80:0/4007762178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47140b58b0 0x7f47141f71c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:35.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.198+0000 7f471aa00700 1 --2- 172.21.15.80:0/4007762178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47141620e0 0x7f47140c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:35.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.198+0000 7f471aa00700 1 --2- 172.21.15.80:0/4007762178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47140d3460 0x7f471415b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:35.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.198+0000 7f471aa00700 1 -- 172.21.15.80:0/4007762178 >> 172.21.15.80:0/4007762178 conn(0x7f47140d0a90 msgr2=0x7f47140b8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:35.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.198+0000 7f471aa00700 1 -- 172.21.15.80:0/4007762178 shutdown_connections 2024-05-10T04:22:35.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.198+0000 7f471aa00700 1 -- 172.21.15.80:0/4007762178 wait complete. 2024-05-10T04:22:35.225 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T04:22:35.225 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T04:22:35.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.485+0000 7fa88e400700 1 Processor -- start 2024-05-10T04:22:35.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.486+0000 7fa88e400700 1 -- start start 2024-05-10T04:22:35.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.487+0000 7fa88e400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa88815e5e0 0x7fa888161f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:35.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.487+0000 7fa88e400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8881626b0 con 0x7fa8880b5c10 2024-05-10T04:22:35.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.487+0000 7fa88e400700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa888162990 con 0x7fa8880cea50 2024-05-10T04:22:35.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.487+0000 7fa88e400700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8880cada0 con 0x7fa88815e5e0 2024-05-10T04:22:35.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.487+0000 7fa887e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa8880b5c10 0x7fa8880b6020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39566/0 (socket says 172.21.15.80:39566) 2024-05-10T04:22:35.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.487+0000 7fa887e00700 1 -- 172.21.15.80:0/65119399 learned_addr learned my addr 172.21.15.80:0/65119399 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:35.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.488+0000 7fa887400700 1 --2- 172.21.15.80:0/65119399 >> v2:172.21.15.106:3300/0 conn(0x7fa88815e5e0 0x7fa888161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:35.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.488+0000 7fa886a00700 1 -- 172.21.15.80:0/65119399 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749862758 0 0) 0x7fa8881626b0 con 0x7fa8880b5c10 2024-05-10T04:22:35.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.488+0000 7fa886a00700 1 -- 172.21.15.80:0/65119399 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa86c0035b0 con 0x7fa8880b5c10 2024-05-10T04:22:35.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.488+0000 7fa886a00700 1 -- 172.21.15.80:0/65119399 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297279913 0 0) 0x7fa888162990 con 0x7fa8880cea50 2024-05-10T04:22:35.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.488+0000 7fa886a00700 1 -- 172.21.15.80:0/65119399 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8881626b0 con 0x7fa8880cea50 2024-05-10T04:22:35.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.488+0000 7fa887400700 1 -- 172.21.15.80:0/65119399 >> v1:172.21.15.106:6789/0 conn(0x7fa8880cea50 legacy=0x7fa8880b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:35.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.488+0000 7fa887400700 1 -- 172.21.15.80:0/65119399 >> v1:172.21.15.80:6789/0 conn(0x7fa8880b5c10 legacy=0x7fa8880b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:35.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.488+0000 7fa886a00700 1 -- 172.21.15.80:0/65119399 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3242079103 0 0) 0x7fa86c0035b0 con 0x7fa8880b5c10 2024-05-10T04:22:35.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.488+0000 7fa887400700 1 -- 172.21.15.80:0/65119399 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa888162c70 con 0x7fa88815e5e0 2024-05-10T04:22:35.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.489+0000 7fa887400700 1 --2- 172.21.15.80:0/65119399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa88815e5e0 0x7fa888161f60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa878009840 tx=0x7fa878009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32caa1bf5f587741 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:35.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.489+0000 7fa886a00700 1 -- 172.21.15.80:0/65119399 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8800019f0 con 0x7fa88815e5e0 2024-05-10T04:22:35.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.489+0000 7fa886a00700 1 -- 172.21.15.80:0/65119399 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa878004030 con 0x7fa88815e5e0 2024-05-10T04:22:35.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.489+0000 7fa886a00700 1 -- 172.21.15.80:0/65119399 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780043c0 con 0x7fa88815e5e0 2024-05-10T04:22:35.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.490+0000 7fa88e400700 1 -- 172.21.15.80:0/65119399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa88815e5e0 msgr2=0x7fa888161f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:35.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.490+0000 7fa88e400700 1 --2- 172.21.15.80:0/65119399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa88815e5e0 0x7fa888161f60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa878009840 tx=0x7fa878009b50 comp rx=0 tx=0).stop 2024-05-10T04:22:35.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.490+0000 7fa88e400700 1 -- 172.21.15.80:0/65119399 shutdown_connections 2024-05-10T04:22:35.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.490+0000 7fa88e400700 1 --2- 172.21.15.80:0/65119399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa88815e5e0 0x7fa888161f60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:35.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.490+0000 7fa88e400700 1 -- 172.21.15.80:0/65119399 >> 172.21.15.80:0/65119399 conn(0x7fa8880d0cd0 msgr2=0x7fa8880d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:35.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.490+0000 7fa88e400700 1 -- 172.21.15.80:0/65119399 shutdown_connections 2024-05-10T04:22:35.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.490+0000 7fa88e400700 1 -- 172.21.15.80:0/65119399 wait complete. 2024-05-10T04:22:35.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.492+0000 7fa88e400700 1 Processor -- start 2024-05-10T04:22:35.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.492+0000 7fa88e400700 1 -- start start 2024-05-10T04:22:35.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa88e400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8880b5c10 0x7fa88815d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:35.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa88e400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8880cea50 0x7fa888151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:35.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa88e400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa88815e5e0 0x7fa8880caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:35.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa88e400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa888157d20 con 0x7fa8880cea50 2024-05-10T04:22:35.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa88e400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88815de80 con 0x7fa88815e5e0 2024-05-10T04:22:35.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa88e400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa888156270 con 0x7fa8880b5c10 2024-05-10T04:22:35.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa87fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8880cea50 0x7fa888151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:35.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa87fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8880cea50 0x7fa888151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33766/0 (socket says 172.21.15.80:33766) 2024-05-10T04:22:35.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa87fe00700 1 -- 172.21.15.80:0/1946669668 learned_addr learned my addr 172.21.15.80:0/1946669668 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:35.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa887e00700 1 --2- 172.21.15.80:0/1946669668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa88815e5e0 0x7fa8880caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:35.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa887400700 1 --2- 172.21.15.80:0/1946669668 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8880b5c10 0x7fa88815d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:35.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa87fe00700 1 -- 172.21.15.80:0/1946669668 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8880b5c10 msgr2=0x7fa88815d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:35.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa87fe00700 1 --2- 172.21.15.80:0/1946669668 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8880b5c10 0x7fa88815d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:35.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa87fe00700 1 -- 172.21.15.80:0/1946669668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa88815e5e0 msgr2=0x7fa8880caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:35.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa87fe00700 1 --2- 172.21.15.80:0/1946669668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa88815e5e0 0x7fa8880caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:35.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa87fe00700 1 -- 172.21.15.80:0/1946669668 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8780094a0 con 0x7fa8880cea50 2024-05-10T04:22:35.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa887e00700 1 --2- 172.21.15.80:0/1946669668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa88815e5e0 0x7fa8880caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:22:35.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.494+0000 7fa887400700 1 --2- 172.21.15.80:0/1946669668 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8880b5c10 0x7fa88815d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:22:35.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.495+0000 7fa87fe00700 1 --2- 172.21.15.80:0/1946669668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8880cea50 0x7fa888151ef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa87000c500 tx=0x7fa87000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:35.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.495+0000 7fa87f400700 1 -- 172.21.15.80:0/1946669668 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8700052d0 con 0x7fa8880cea50 2024-05-10T04:22:35.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.495+0000 7fa87f400700 1 -- 172.21.15.80:0/1946669668 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa870005430 con 0x7fa8880cea50 2024-05-10T04:22:35.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.495+0000 7fa88e400700 1 -- 172.21.15.80:0/1946669668 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88815c7d0 con 0x7fa8880cea50 2024-05-10T04:22:35.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.495+0000 7fa87f400700 1 -- 172.21.15.80:0/1946669668 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870003880 con 0x7fa8880cea50 2024-05-10T04:22:35.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.495+0000 7fa88e400700 1 -- 172.21.15.80:0/1946669668 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88815cd90 con 0x7fa8880cea50 2024-05-10T04:22:35.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.496+0000 7fa88e400700 1 -- 172.21.15.80:0/1946669668 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa888074af0 con 0x7fa8880cea50 2024-05-10T04:22:35.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.497+0000 7fa87f400700 1 -- 172.21.15.80:0/1946669668 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa8700039e0 con 0x7fa8880cea50 2024-05-10T04:22:35.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.498+0000 7fa87f400700 1 --2- 172.21.15.80:0/1946669668 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa86406acc0 0x7fa86406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:35.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.498+0000 7fa87f400700 1 -- 172.21.15.80:0/1946669668 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa870088440 con 0x7fa8880cea50 2024-05-10T04:22:35.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.498+0000 7fa887400700 1 --2- 172.21.15.80:0/1946669668 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa86406acc0 0x7fa86406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:35.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.499+0000 7fa887400700 1 --2- 172.21.15.80:0/1946669668 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa86406acc0 0x7fa86406d1d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa878009840 tx=0x7fa878008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:35.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.502+0000 7fa87f400700 1 -- 172.21.15.80:0/1946669668 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa870053980 con 0x7fa8880cea50 2024-05-10T04:22:35.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.709+0000 7fa88e400700 1 -- 172.21.15.80:0/1946669668 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa8880d3570 con 0x7fa8880cea50 2024-05-10T04:22:35.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.898+0000 7fa87f400700 1 -- 172.21.15.80:0/1946669668 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa870056fa0 con 0x7fa8880cea50 2024-05-10T04:22:35.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.902+0000 7fa88e400700 1 -- 172.21.15.80:0/1946669668 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa86406acc0 msgr2=0x7fa86406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:35.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.902+0000 7fa88e400700 1 --2- 172.21.15.80:0/1946669668 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa86406acc0 0x7fa86406d1d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa878009840 tx=0x7fa878008030 comp rx=0 tx=0).stop 2024-05-10T04:22:35.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.902+0000 7fa88e400700 1 -- 172.21.15.80:0/1946669668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8880cea50 msgr2=0x7fa888151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:35.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.902+0000 7fa88e400700 1 --2- 172.21.15.80:0/1946669668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8880cea50 0x7fa888151ef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa87000c500 tx=0x7fa87000c8c0 comp rx=0 tx=0).stop 2024-05-10T04:22:35.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.902+0000 7fa88e400700 1 -- 172.21.15.80:0/1946669668 shutdown_connections 2024-05-10T04:22:35.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.902+0000 7fa88e400700 1 --2- 172.21.15.80:0/1946669668 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa86406acc0 0x7fa86406d1d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.902+0000 7fa88e400700 1 --2- 172.21.15.80:0/1946669668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa88815e5e0 0x7fa8880caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.902+0000 7fa88e400700 1 --2- 172.21.15.80:0/1946669668 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8880b5c10 0x7fa88815d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.902+0000 7fa88e400700 1 --2- 172.21.15.80:0/1946669668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8880cea50 0x7fa888151ef0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.902+0000 7fa88e400700 1 -- 172.21.15.80:0/1946669668 >> 172.21.15.80:0/1946669668 conn(0x7fa8880d0cd0 msgr2=0x7fa8880b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.903+0000 7fa88e400700 1 -- 172.21.15.80:0/1946669668 shutdown_connections 2024-05-10T04:22:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:35.903+0000 7fa88e400700 1 -- 172.21.15.80:0/1946669668 wait complete. 2024-05-10T04:22:35.907 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2024-05-10T04:22:35.933 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T04:22:36.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.199+0000 7f6a74e00700 1 Processor -- start 2024-05-10T04:22:36.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.200+0000 7f6a74e00700 1 -- start start 2024-05-10T04:22:36.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.201+0000 7f6a74e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a700d10b0 0x7f6a700d3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:36.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.201+0000 7f6a74e00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6a7015e880 0x7f6a7015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:36.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.201+0000 7f6a74e00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a700d2840 con 0x7f6a7015bfd0 2024-05-10T04:22:36.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.201+0000 7f6a74e00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7015f620 con 0x7f6a700d10b0 2024-05-10T04:22:36.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.201+0000 7f6a74e00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a700d2b00 con 0x7f6a7015e880 2024-05-10T04:22:36.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.201+0000 7f6a6ea00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a700d10b0 0x7f6a700d3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:36.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.201+0000 7f6a6ea00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a700d10b0 0x7f6a700d3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33776/0 (socket says 172.21.15.80:33776) 2024-05-10T04:22:36.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.201+0000 7f6a6ea00700 1 -- 172.21.15.80:0/3653771977 learned_addr learned my addr 172.21.15.80:0/3653771977 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:36.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.202+0000 7f6a6fe00700 1 --2- 172.21.15.80:0/3653771977 >> v2:172.21.15.106:3300/0 conn(0x7f6a7015e880 0x7f6a7015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:36.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.202+0000 7f6a6ea00700 1 -- 172.21.15.80:0/3653771977 >> v2:172.21.15.106:3300/0 conn(0x7f6a7015e880 msgr2=0x7f6a7015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:36.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.202+0000 7f6a6ea00700 1 --2- 172.21.15.80:0/3653771977 >> v2:172.21.15.106:3300/0 conn(0x7f6a7015e880 0x7f6a7015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:36.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.202+0000 7f6a6ea00700 1 -- 172.21.15.80:0/3653771977 >> v1:172.21.15.106:6789/0 conn(0x7f6a7015bfd0 legacy=0x7f6a700d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:36.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.202+0000 7f6a6ea00700 1 -- 172.21.15.80:0/3653771977 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a700d2de0 con 0x7f6a700d10b0 2024-05-10T04:22:36.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.202+0000 7f6a6ea00700 1 --2- 172.21.15.80:0/3653771977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a700d10b0 0x7f6a700d3300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6a700d0480 tx=0x7f6a5c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d717f1a96d9eea9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:36.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.202+0000 7f6a6e000700 1 -- 172.21.15.80:0/3653771977 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c00b870 con 0x7f6a700d10b0 2024-05-10T04:22:36.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.202+0000 7f6a6e000700 1 -- 172.21.15.80:0/3653771977 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c00b9d0 con 0x7f6a700d10b0 2024-05-10T04:22:36.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.202+0000 7f6a6e000700 1 -- 172.21.15.80:0/3653771977 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c00bd60 con 0x7f6a700d10b0 2024-05-10T04:22:36.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.203+0000 7f6a74e00700 1 -- 172.21.15.80:0/3653771977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a700d10b0 msgr2=0x7f6a700d3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:36.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.203+0000 7f6a74e00700 1 --2- 172.21.15.80:0/3653771977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a700d10b0 0x7f6a700d3300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6a700d0480 tx=0x7f6a5c009bd0 comp rx=0 tx=0).stop 2024-05-10T04:22:36.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.203+0000 7f6a74e00700 1 -- 172.21.15.80:0/3653771977 shutdown_connections 2024-05-10T04:22:36.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.203+0000 7f6a74e00700 1 --2- 172.21.15.80:0/3653771977 >> v2:172.21.15.106:3300/0 conn(0x7f6a7015e880 0x7f6a7015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:36.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.203+0000 7f6a74e00700 1 --2- 172.21.15.80:0/3653771977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a700d10b0 0x7f6a700d3300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:36.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.203+0000 7f6a74e00700 1 -- 172.21.15.80:0/3653771977 >> 172.21.15.80:0/3653771977 conn(0x7f6a7006c4e0 msgr2=0x7f6a7006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:36.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.203+0000 7f6a74e00700 1 -- 172.21.15.80:0/3653771977 shutdown_connections 2024-05-10T04:22:36.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.203+0000 7f6a74e00700 1 -- 172.21.15.80:0/3653771977 wait complete. 2024-05-10T04:22:36.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.206+0000 7f6a74e00700 1 Processor -- start 2024-05-10T04:22:36.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.206+0000 7f6a74e00700 1 -- start start 2024-05-10T04:22:36.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.207+0000 7f6a74e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a7015bfd0 0x7f6a701f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:36.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.207+0000 7f6a74e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a7015e880 0x7f6a701e7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:36.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.207+0000 7f6a74e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a701e7e90 0x7f6a701e82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:36.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.207+0000 7f6a74e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a701f4330 con 0x7f6a7015e880 2024-05-10T04:22:36.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.207+0000 7f6a74e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a701e87e0 con 0x7f6a7015bfd0 2024-05-10T04:22:36.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.207+0000 7f6a74e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a701f5da0 con 0x7f6a701e7e90 2024-05-10T04:22:36.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.207+0000 7f6a6ea00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a7015e880 0x7f6a701e7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:36.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.207+0000 7f6a6ea00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a7015e880 0x7f6a701e7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33778/0 (socket says 172.21.15.80:33778) 2024-05-10T04:22:36.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.207+0000 7f6a6ea00700 1 -- 172.21.15.80:0/1377508905 learned_addr learned my addr 172.21.15.80:0/1377508905 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:36.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.208+0000 7f6a6f400700 1 --2- 172.21.15.80:0/1377508905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a7015bfd0 0x7f6a701f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:36.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.208+0000 7f6a6ea00700 1 -- 172.21.15.80:0/1377508905 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a701e7e90 msgr2=0x7f6a701e82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:36.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.208+0000 7f6a6ea00700 1 --2- 172.21.15.80:0/1377508905 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a701e7e90 0x7f6a701e82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:36.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.208+0000 7f6a6ea00700 1 -- 172.21.15.80:0/1377508905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a7015bfd0 msgr2=0x7f6a701f3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:36.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.208+0000 7f6a6ea00700 1 --2- 172.21.15.80:0/1377508905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a7015bfd0 0x7f6a701f3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:36.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.208+0000 7f6a6ea00700 1 -- 172.21.15.80:0/1377508905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c009550 con 0x7f6a7015e880 2024-05-10T04:22:36.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.208+0000 7f6a6ea00700 1 --2- 172.21.15.80:0/1377508905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a7015e880 0x7f6a701e7950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c014040 tx=0x7f6a5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:36.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.208+0000 7f6a67400700 1 -- 172.21.15.80:0/1377508905 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c004520 con 0x7f6a7015e880 2024-05-10T04:22:36.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.208+0000 7f6a67400700 1 -- 172.21.15.80:0/1377508905 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c01e070 con 0x7f6a7015e880 2024-05-10T04:22:36.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.208+0000 7f6a67400700 1 -- 172.21.15.80:0/1377508905 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c0038a0 con 0x7f6a7015e880 2024-05-10T04:22:36.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.208+0000 7f6a74e00700 1 -- 172.21.15.80:0/1377508905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a700ab8e0 con 0x7f6a7015e880 2024-05-10T04:22:36.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.208+0000 7f6a74e00700 1 -- 172.21.15.80:0/1377508905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a701f45d0 con 0x7f6a7015e880 2024-05-10T04:22:36.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.209+0000 7f6a74e00700 1 -- 172.21.15.80:0/1377508905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a701f4760 con 0x7f6a7015e880 2024-05-10T04:22:36.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.211+0000 7f6a67400700 1 -- 172.21.15.80:0/1377508905 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6a5c003a00 con 0x7f6a7015e880 2024-05-10T04:22:36.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.211+0000 7f6a67400700 1 --2- 172.21.15.80:0/1377508905 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a5006acc0 0x7f6a5006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:36.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.211+0000 7f6a67400700 1 -- 172.21.15.80:0/1377508905 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6a5c020070 con 0x7f6a7015e880 2024-05-10T04:22:36.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.212+0000 7f6a6f400700 1 --2- 172.21.15.80:0/1377508905 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a5006acc0 0x7f6a5006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:36.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.212+0000 7f6a6f400700 1 --2- 172.21.15.80:0/1377508905 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a5006acc0 0x7f6a5006d1d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a60000f60 tx=0x7f6a60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:36.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.217+0000 7f6a67400700 1 -- 172.21.15.80:0/1377508905 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6a5c055ad0 con 0x7f6a7015e880 2024-05-10T04:22:36.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.423+0000 7f6a74e00700 1 -- 172.21.15.80:0/1377508905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6a70074af0 con 0x7f6a7015e880 2024-05-10T04:22:36.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.907+0000 7f6a67400700 1 -- 172.21.15.80:0/1377508905 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6a5c003cb0 con 0x7f6a7015e880 2024-05-10T04:22:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.912+0000 7f6a74e00700 1 -- 172.21.15.80:0/1377508905 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a5006acc0 msgr2=0x7f6a5006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.912+0000 7f6a74e00700 1 --2- 172.21.15.80:0/1377508905 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a5006acc0 0x7f6a5006d1d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a60000f60 tx=0x7f6a60009040 comp rx=0 tx=0).stop 2024-05-10T04:22:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.912+0000 7f6a74e00700 1 -- 172.21.15.80:0/1377508905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a7015e880 msgr2=0x7f6a701e7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.912+0000 7f6a74e00700 1 --2- 172.21.15.80:0/1377508905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a7015e880 0x7f6a701e7950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c014040 tx=0x7f6a5c004750 comp rx=0 tx=0).stop 2024-05-10T04:22:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.913+0000 7f6a74e00700 1 -- 172.21.15.80:0/1377508905 shutdown_connections 2024-05-10T04:22:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.913+0000 7f6a74e00700 1 --2- 172.21.15.80:0/1377508905 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a5006acc0 0x7f6a5006d1d0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a60000f60 tx=0x7f6a60009040 comp rx=0 tx=0).stop 2024-05-10T04:22:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.913+0000 7f6a74e00700 1 --2- 172.21.15.80:0/1377508905 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a701e7e90 0x7f6a701e82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.913+0000 7f6a74e00700 1 --2- 172.21.15.80:0/1377508905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a7015bfd0 0x7f6a701f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.913+0000 7f6a74e00700 1 --2- 172.21.15.80:0/1377508905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a7015e880 0x7f6a701e7950 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.913+0000 7f6a74e00700 1 -- 172.21.15.80:0/1377508905 >> 172.21.15.80:0/1377508905 conn(0x7f6a7006c4e0 msgr2=0x7f6a7006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:36.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.919+0000 7f6a74e00700 1 -- 172.21.15.80:0/1377508905 shutdown_connections 2024-05-10T04:22:36.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:36.920+0000 7f6a74e00700 1 -- 172.21.15.80:0/1377508905 wait complete. 2024-05-10T04:22:36.929 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2024-05-10T04:22:36.956 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T04:22:37.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.216+0000 7fdce1400700 1 Processor -- start 2024-05-10T04:22:37.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.216+0000 7fdce1400700 1 -- start start 2024-05-10T04:22:37.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.218+0000 7fdce1400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdcdc15e610 0x7fdcdc0b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:37.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.218+0000 7fdce1400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc0d2c00 con 0x7fdcdc0b7910 2024-05-10T04:22:37.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.218+0000 7fdce1400700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc15ea20 con 0x7fdcdc162150 2024-05-10T04:22:37.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.218+0000 7fdce1400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc162630 con 0x7fdcdc15e610 2024-05-10T04:22:37.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.218+0000 7fdcd9e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdcdc15e610 0x7fdcdc0b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:37.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.218+0000 7fdcdb200700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdcdc0b7910 0x7fdcdc06c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39568/0 (socket says 172.21.15.80:39568) 2024-05-10T04:22:37.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.218+0000 7fdcdb200700 1 -- 172.21.15.80:0/98803611 learned_addr learned my addr 172.21.15.80:0/98803611 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:37.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.219+0000 7fdcd9e00700 1 -- 172.21.15.80:0/98803611 >> v1:172.21.15.106:6789/0 conn(0x7fdcdc162150 legacy=0x7fdcdc0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:37.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.219+0000 7fdcd9e00700 1 -- 172.21.15.80:0/98803611 >> v1:172.21.15.80:6789/0 conn(0x7fdcdc0b7910 legacy=0x7fdcdc06c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:37.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.219+0000 7fdcd9e00700 1 -- 172.21.15.80:0/98803611 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc162910 con 0x7fdcdc15e610 2024-05-10T04:22:37.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.219+0000 7fdcd9400700 1 -- 172.21.15.80:0/98803611 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942941309 0 0) 0x7fdcdc0d2c00 con 0x7fdcdc0b7910 2024-05-10T04:22:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.219+0000 7fdcd9e00700 1 --2- 172.21.15.80:0/98803611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcdc15e610 0x7fdcdc0b73d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8009840 tx=0x7fdcc8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d841ee6c4013df2e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.219+0000 7fdcd9400700 1 -- 172.21.15.80:0/98803611 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8011830 con 0x7fdcdc15e610 2024-05-10T04:22:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.219+0000 7fdcd9400700 1 -- 172.21.15.80:0/98803611 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc8011990 con 0x7fdcdc15e610 2024-05-10T04:22:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.219+0000 7fdcd9400700 1 -- 172.21.15.80:0/98803611 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8011d20 con 0x7fdcdc15e610 2024-05-10T04:22:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.220+0000 7fdce1400700 1 -- 172.21.15.80:0/98803611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcdc15e610 msgr2=0x7fdcdc0b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.220+0000 7fdce1400700 1 --2- 172.21.15.80:0/98803611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcdc15e610 0x7fdcdc0b73d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8009840 tx=0x7fdcc8009b50 comp rx=0 tx=0).stop 2024-05-10T04:22:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.220+0000 7fdce1400700 1 -- 172.21.15.80:0/98803611 shutdown_connections 2024-05-10T04:22:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.220+0000 7fdce1400700 1 --2- 172.21.15.80:0/98803611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcdc15e610 0x7fdcdc0b73d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.220+0000 7fdce1400700 1 -- 172.21.15.80:0/98803611 >> 172.21.15.80:0/98803611 conn(0x7fdcdc0d3e10 msgr2=0x7fdcdc0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.220+0000 7fdce1400700 1 -- 172.21.15.80:0/98803611 shutdown_connections 2024-05-10T04:22:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.220+0000 7fdce1400700 1 -- 172.21.15.80:0/98803611 wait complete. 2024-05-10T04:22:37.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.222+0000 7fdce1400700 1 Processor -- start 2024-05-10T04:22:37.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.223+0000 7fdce1400700 1 -- start start 2024-05-10T04:22:37.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.224+0000 7fdce1400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcdc0b7910 0x7fdcdc14f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:37.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.224+0000 7fdce1400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcdc15e610 0x7fdcdc1e7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:37.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.224+0000 7fdce1400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcdc162150 0x7fdcdc1e8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:37.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.224+0000 7fdce1400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc1e9140 con 0x7fdcdc162150 2024-05-10T04:22:37.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.224+0000 7fdce1400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc160f10 con 0x7fdcdc0b7910 2024-05-10T04:22:37.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.224+0000 7fdce1400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc14f550 con 0x7fdcdc15e610 2024-05-10T04:22:37.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.224+0000 7fdcdb200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcdc162150 0x7fdcdc1e8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:37.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.224+0000 7fdcdb200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcdc162150 0x7fdcdc1e8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33798/0 (socket says 172.21.15.80:33798) 2024-05-10T04:22:37.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.224+0000 7fdcdb200700 1 -- 172.21.15.80:0/3049588471 learned_addr learned my addr 172.21.15.80:0/3049588471 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:37.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.225+0000 7fdcd9e00700 1 --2- 172.21.15.80:0/3049588471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcdc15e610 0x7fdcdc1e7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:37.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.225+0000 7fdcda800700 1 --2- 172.21.15.80:0/3049588471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcdc0b7910 0x7fdcdc14f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:37.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.225+0000 7fdcdb200700 1 -- 172.21.15.80:0/3049588471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcdc15e610 msgr2=0x7fdcdc1e7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:37.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.225+0000 7fdcdb200700 1 --2- 172.21.15.80:0/3049588471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcdc15e610 0x7fdcdc1e7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:37.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.225+0000 7fdcdb200700 1 -- 172.21.15.80:0/3049588471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcdc0b7910 msgr2=0x7fdcdc14f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:37.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.225+0000 7fdcdb200700 1 --2- 172.21.15.80:0/3049588471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcdc0b7910 0x7fdcdc14f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:37.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.225+0000 7fdcdb200700 1 -- 172.21.15.80:0/3049588471 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc80094a0 con 0x7fdcdc162150 2024-05-10T04:22:37.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.225+0000 7fdcdb200700 1 --2- 172.21.15.80:0/3049588471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcdc162150 0x7fdcdc1e8490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400cba0 tx=0x7fdcd400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:37.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.225+0000 7fdcd2a00700 1 -- 172.21.15.80:0/3049588471 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd400ab80 con 0x7fdcdc162150 2024-05-10T04:22:37.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.225+0000 7fdcd2a00700 1 -- 172.21.15.80:0/3049588471 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd400ad00 con 0x7fdcdc162150 2024-05-10T04:22:37.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.225+0000 7fdce1400700 1 -- 172.21.15.80:0/3049588471 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcdc1613a0 con 0x7fdcdc162150 2024-05-10T04:22:37.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.225+0000 7fdcd2a00700 1 -- 172.21.15.80:0/3049588471 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4007310 con 0x7fdcdc162150 2024-05-10T04:22:37.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.225+0000 7fdce1400700 1 -- 172.21.15.80:0/3049588471 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc1605e0 con 0x7fdcdc162150 2024-05-10T04:22:37.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.226+0000 7fdce1400700 1 -- 172.21.15.80:0/3049588471 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc161080 con 0x7fdcdc162150 2024-05-10T04:22:37.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.228+0000 7fdcd2a00700 1 -- 172.21.15.80:0/3049588471 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdcd4007470 con 0x7fdcdc162150 2024-05-10T04:22:37.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.229+0000 7fdcd2a00700 1 --2- 172.21.15.80:0/3049588471 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdcbc06ac90 0x7fdcbc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:37.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.229+0000 7fdcd2a00700 1 -- 172.21.15.80:0/3049588471 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fdcd40891f0 con 0x7fdcdc162150 2024-05-10T04:22:37.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.230+0000 7fdcda800700 1 --2- 172.21.15.80:0/3049588471 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdcbc06ac90 0x7fdcbc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:37.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.230+0000 7fdcda800700 1 --2- 172.21.15.80:0/3049588471 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdcbc06ac90 0x7fdcbc06d1a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdccc000f60 tx=0x7fdccc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:37.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.234+0000 7fdcd2a00700 1 -- 172.21.15.80:0/3049588471 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdcd4054390 con 0x7fdcdc162150 2024-05-10T04:22:37.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.481+0000 7fdce1400700 1 -- 172.21.15.80:0/3049588471 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdcdc074af0 con 0x7fdcdc162150 2024-05-10T04:22:37.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.490+0000 7fdcd2a00700 1 -- 172.21.15.80:0/3049588471 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdcd40579b0 con 0x7fdcdc162150 2024-05-10T04:22:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.495+0000 7fdce1400700 1 -- 172.21.15.80:0/3049588471 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdcbc06ac90 msgr2=0x7fdcbc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.495+0000 7fdce1400700 1 --2- 172.21.15.80:0/3049588471 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdcbc06ac90 0x7fdcbc06d1a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdccc000f60 tx=0x7fdccc009040 comp rx=0 tx=0).stop 2024-05-10T04:22:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.495+0000 7fdce1400700 1 -- 172.21.15.80:0/3049588471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcdc162150 msgr2=0x7fdcdc1e8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.495+0000 7fdce1400700 1 --2- 172.21.15.80:0/3049588471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcdc162150 0x7fdcdc1e8490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400cba0 tx=0x7fdcd400cf60 comp rx=0 tx=0).stop 2024-05-10T04:22:37.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.496+0000 7fdce1400700 1 -- 172.21.15.80:0/3049588471 shutdown_connections 2024-05-10T04:22:37.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.496+0000 7fdce1400700 1 --2- 172.21.15.80:0/3049588471 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdcbc06ac90 0x7fdcbc06d1a0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdccc000f60 tx=0x7fdccc009040 comp rx=0 tx=0).stop 2024-05-10T04:22:37.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.496+0000 7fdce1400700 1 --2- 172.21.15.80:0/3049588471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcdc162150 0x7fdcdc1e8490 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:37.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.496+0000 7fdce1400700 1 --2- 172.21.15.80:0/3049588471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcdc0b7910 0x7fdcdc14f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:37.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.496+0000 7fdce1400700 1 --2- 172.21.15.80:0/3049588471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcdc15e610 0x7fdcdc1e7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:37.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.496+0000 7fdce1400700 1 -- 172.21.15.80:0/3049588471 >> 172.21.15.80:0/3049588471 conn(0x7fdcdc0d3e10 msgr2=0x7fdcdc15a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:37.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.500+0000 7fdce1400700 1 -- 172.21.15.80:0/3049588471 shutdown_connections 2024-05-10T04:22:37.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.500+0000 7fdce1400700 1 -- 172.21.15.80:0/3049588471 wait complete. 2024-05-10T04:22:37.510 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 2 and data pool 3 2024-05-10T04:22:37.546 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:22:37.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.803+0000 7f3c5ca00700 1 Processor -- start 2024-05-10T04:22:37.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.804+0000 7f3c5ca00700 1 -- start start 2024-05-10T04:22:37.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.805+0000 7f3c5ca00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c581627f0 0x7f3c580b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:37.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.805+0000 7f3c5ca00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c580d2730 con 0x7f3c580d3460 2024-05-10T04:22:37.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.805+0000 7f3c5ca00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c580d2fd0 con 0x7f3c580b5fc0 2024-05-10T04:22:37.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.805+0000 7f3c5ca00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c58162c00 con 0x7f3c581627f0 2024-05-10T04:22:37.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.805+0000 7f3c55e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3c580d3460 0x7f3c580b58b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39578/0 (socket says 172.21.15.80:39578) 2024-05-10T04:22:37.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.805+0000 7f3c55e00700 1 -- 172.21.15.80:0/3716641200 learned_addr learned my addr 172.21.15.80:0/3716641200 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:37.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.806+0000 7f3c55400700 1 -- 172.21.15.80:0/3716641200 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538725103 0 0) 0x7f3c580d2730 con 0x7f3c580d3460 2024-05-10T04:22:37.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.806+0000 7f3c56800700 1 --2- 172.21.15.80:0/3716641200 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c581627f0 0x7f3c580b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:37.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.806+0000 7f3c55400700 1 -- 172.21.15.80:0/3716641200 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c3c0035b0 con 0x7f3c580d3460 2024-05-10T04:22:37.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.806+0000 7f3c55400700 1 -- 172.21.15.80:0/3716641200 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3711486213 0 0) 0x7f3c3c0035b0 con 0x7f3c580d3460 2024-05-10T04:22:37.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.806+0000 7f3c55400700 1 -- 172.21.15.80:0/3716641200 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c581627f0 msgr2=0x7f3c580b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:37.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.806+0000 7f3c55400700 1 --2- 172.21.15.80:0/3716641200 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c581627f0 0x7f3c580b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:37.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.806+0000 7f3c55400700 1 -- 172.21.15.80:0/3716641200 >> v1:172.21.15.106:6789/0 conn(0x7f3c580b5fc0 legacy=0x7f3c581620e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:37.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.806+0000 7f3c55400700 1 -- 172.21.15.80:0/3716641200 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c58162e10 con 0x7f3c580d3460 2024-05-10T04:22:37.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.806+0000 7f3c55400700 1 -- 172.21.15.80:0/3716641200 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7f3c48001670 con 0x7f3c580d3460 2024-05-10T04:22:37.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.806+0000 7f3c55400700 1 -- 172.21.15.80:0/3716641200 >> v1:172.21.15.80:6789/0 conn(0x7f3c580d3460 legacy=0x7f3c580b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:37.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.806+0000 7f3c55400700 1 --2- 172.21.15.80:0/3716641200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c3c003a30 0x7f3c3c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:37.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.806+0000 7f3c55400700 1 --2- 172.21.15.80:0/3716641200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3c004850 0x7f3c3c004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:37.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.806+0000 7f3c55400700 1 --2- 172.21.15.80:0/3716641200 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c581627f0 0x7f3c3c005320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:37.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.806+0000 7f3c55400700 1 -- 172.21.15.80:0/3716641200 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c58162c00 con 0x7f3c3c003a30 2024-05-10T04:22:37.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.806+0000 7f3c55400700 1 -- 172.21.15.80:0/3716641200 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c00bbd0 con 0x7f3c3c004850 2024-05-10T04:22:37.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.806+0000 7f3c55400700 1 -- 172.21.15.80:0/3716641200 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c00bd90 con 0x7f3c581627f0 2024-05-10T04:22:37.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.806+0000 7f3c55e00700 1 --2- 172.21.15.80:0/3716641200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c3c003a30 0x7f3c3c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:37.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.807+0000 7f3c4fe00700 1 --2- 172.21.15.80:0/3716641200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3c004850 0x7f3c3c004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:37.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.807+0000 7f3c56800700 1 --2- 172.21.15.80:0/3716641200 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c581627f0 0x7f3c3c005320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:37.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.807+0000 7f3c55e00700 1 -- 172.21.15.80:0/3716641200 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c581627f0 msgr2=0x7f3c3c005320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:37.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.807+0000 7f3c55e00700 1 --2- 172.21.15.80:0/3716641200 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c581627f0 0x7f3c3c005320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:37.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.807+0000 7f3c55e00700 1 -- 172.21.15.80:0/3716641200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3c004850 msgr2=0x7f3c3c004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:37.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.807+0000 7f3c55e00700 1 --2- 172.21.15.80:0/3716641200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3c004850 0x7f3c3c004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:37.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.807+0000 7f3c55e00700 1 -- 172.21.15.80:0/3716641200 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c0035b0 con 0x7f3c3c003a30 2024-05-10T04:22:37.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.807+0000 7f3c4fe00700 1 --2- 172.21.15.80:0/3716641200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3c004850 0x7f3c3c004c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:37.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.807+0000 7f3c55e00700 1 --2- 172.21.15.80:0/3716641200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c3c003a30 0x7f3c3c003ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800c160 tx=0x7f3c3c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8cd9c51427c500 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:37.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.807+0000 7f3c55400700 1 -- 172.21.15.80:0/3716641200 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48007b70 con 0x7f3c3c003a30 2024-05-10T04:22:37.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.807+0000 7f3c55400700 1 -- 172.21.15.80:0/3716641200 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4800cd20 con 0x7f3c3c003a30 2024-05-10T04:22:37.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.807+0000 7f3c55400700 1 -- 172.21.15.80:0/3716641200 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48005ba0 con 0x7f3c3c003a30 2024-05-10T04:22:37.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.808+0000 7f3c5ca00700 1 -- 172.21.15.80:0/3716641200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c3c003a30 msgr2=0x7f3c3c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:37.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.808+0000 7f3c5ca00700 1 --2- 172.21.15.80:0/3716641200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c3c003a30 0x7f3c3c003ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800c160 tx=0x7f3c3c005880 comp rx=0 tx=0).stop 2024-05-10T04:22:37.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.808+0000 7f3c56800700 1 -- 172.21.15.80:0/3716641200 reap_dead start 2024-05-10T04:22:37.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.808+0000 7f3c5ca00700 1 -- 172.21.15.80:0/3716641200 shutdown_connections 2024-05-10T04:22:37.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.808+0000 7f3c5ca00700 1 -- 172.21.15.80:0/3716641200 >> 172.21.15.80:0/3716641200 conn(0x7f3c580d0a90 msgr2=0x7f3c580d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:37.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.808+0000 7f3c5ca00700 1 -- 172.21.15.80:0/3716641200 shutdown_connections 2024-05-10T04:22:37.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.808+0000 7f3c5ca00700 1 -- 172.21.15.80:0/3716641200 wait complete. 2024-05-10T04:22:37.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.810+0000 7f3c5ca00700 1 Processor -- start 2024-05-10T04:22:37.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.811+0000 7f3c5ca00700 1 -- start start 2024-05-10T04:22:37.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.812+0000 7f3c5ca00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3c003a30 0x7f3c580cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:37.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.812+0000 7f3c5ca00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c58152ff0 0x7f3c581598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:37.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.812+0000 7f3c5ca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c5815fbc0 0x7f3c58159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:37.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.812+0000 7f3c5ca00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c581603a0 con 0x7f3c5815fbc0 2024-05-10T04:22:37.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.812+0000 7f3c5ca00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c58156f40 con 0x7f3c3c003a30 2024-05-10T04:22:37.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.812+0000 7f3c5ca00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c581545a0 con 0x7f3c58152ff0 2024-05-10T04:22:37.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.812+0000 7f3c55e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3c003a30 0x7f3c580cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:37.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.812+0000 7f3c56800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c5815fbc0 0x7f3c58159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:37.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.812+0000 7f3c56800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c5815fbc0 0x7f3c58159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33816/0 (socket says 172.21.15.80:33816) 2024-05-10T04:22:37.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.812+0000 7f3c55e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3c003a30 0x7f3c580cdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37782/0 (socket says 172.21.15.80:37782) 2024-05-10T04:22:37.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.812+0000 7f3c56800700 1 -- 172.21.15.80:0/2882075660 learned_addr learned my addr 172.21.15.80:0/2882075660 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:37.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.812+0000 7f3c4fe00700 1 --2- 172.21.15.80:0/2882075660 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c58152ff0 0x7f3c581598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:37.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.813+0000 7f3c56800700 1 -- 172.21.15.80:0/2882075660 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c58152ff0 msgr2=0x7f3c581598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:37.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.813+0000 7f3c56800700 1 --2- 172.21.15.80:0/2882075660 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c58152ff0 0x7f3c581598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:37.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.813+0000 7f3c56800700 1 -- 172.21.15.80:0/2882075660 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3c003a30 msgr2=0x7f3c580cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:37.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.813+0000 7f3c56800700 1 --2- 172.21.15.80:0/2882075660 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3c003a30 0x7f3c580cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:37.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.813+0000 7f3c56800700 1 -- 172.21.15.80:0/2882075660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c58154020 con 0x7f3c5815fbc0 2024-05-10T04:22:37.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.813+0000 7f3c56800700 1 --2- 172.21.15.80:0/2882075660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c5815fbc0 0x7f3c58159e30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3c580ce430 tx=0x7f3c500114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:37.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.813+0000 7f3c4e000700 1 -- 172.21.15.80:0/2882075660 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5000e070 con 0x7f3c5815fbc0 2024-05-10T04:22:37.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.813+0000 7f3c4e000700 1 -- 172.21.15.80:0/2882075660 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c50003cf0 con 0x7f3c5815fbc0 2024-05-10T04:22:37.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.813+0000 7f3c5ca00700 1 -- 172.21.15.80:0/2882075660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c58159410 con 0x7f3c5815fbc0 2024-05-10T04:22:37.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.813+0000 7f3c4e000700 1 -- 172.21.15.80:0/2882075660 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c50003ea0 con 0x7f3c5815fbc0 2024-05-10T04:22:37.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.813+0000 7f3c5ca00700 1 -- 172.21.15.80:0/2882075660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c581542c0 con 0x7f3c5815fbc0 2024-05-10T04:22:37.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.814+0000 7f3c5ca00700 1 -- 172.21.15.80:0/2882075660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c580732b0 con 0x7f3c5815fbc0 2024-05-10T04:22:37.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.815+0000 7f3c4e000700 1 -- 172.21.15.80:0/2882075660 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3c50011960 con 0x7f3c5815fbc0 2024-05-10T04:22:37.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.816+0000 7f3c4e000700 1 --2- 172.21.15.80:0/2882075660 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3c3406ac90 0x7f3c3406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:37.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.816+0000 7f3c4e000700 1 -- 172.21.15.80:0/2882075660 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c50089800 con 0x7f3c5815fbc0 2024-05-10T04:22:37.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.816+0000 7f3c55e00700 1 --2- 172.21.15.80:0/2882075660 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3c3406ac90 0x7f3c3406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:37.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.817+0000 7f3c55e00700 1 --2- 172.21.15.80:0/2882075660 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3c3406ac90 0x7f3c3406d1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3c48000c00 tx=0x7f3c48007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:37.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:37.821+0000 7f3c4e000700 1 -- 172.21.15.80:0/2882075660 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3c500549c0 con 0x7f3c5815fbc0 2024-05-10T04:22:38.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.027+0000 7f3c5ca00700 1 -- 172.21.15.80:0/2882075660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c58074af0 con 0x7f3c5815fbc0 2024-05-10T04:22:38.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.028+0000 7f3c4e000700 1 -- 172.21.15.80:0/2882075660 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16050 (secure 0 0 0) 0x7f3c50014350 con 0x7f3c5815fbc0 2024-05-10T04:22:38.030 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:38.030 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":19,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:37.482555+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:22:38.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.031+0000 7f3c5ca00700 1 -- 172.21.15.80:0/2882075660 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3c3406ac90 msgr2=0x7f3c3406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:38.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.031+0000 7f3c5ca00700 1 --2- 172.21.15.80:0/2882075660 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3c3406ac90 0x7f3c3406d1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3c48000c00 tx=0x7f3c48007000 comp rx=0 tx=0).stop 2024-05-10T04:22:38.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.031+0000 7f3c5ca00700 1 -- 172.21.15.80:0/2882075660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c5815fbc0 msgr2=0x7f3c58159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:38.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.031+0000 7f3c5ca00700 1 --2- 172.21.15.80:0/2882075660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c5815fbc0 0x7f3c58159e30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3c580ce430 tx=0x7f3c500114b0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.031+0000 7f3c5ca00700 1 -- 172.21.15.80:0/2882075660 shutdown_connections 2024-05-10T04:22:38.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.031+0000 7f3c5ca00700 1 --2- 172.21.15.80:0/2882075660 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3c3406ac90 0x7f3c3406d1a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.031+0000 7f3c5ca00700 1 --2- 172.21.15.80:0/2882075660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c5815fbc0 0x7f3c58159e30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.031+0000 7f3c5ca00700 1 --2- 172.21.15.80:0/2882075660 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3c003a30 0x7f3c580cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.031+0000 7f3c5ca00700 1 --2- 172.21.15.80:0/2882075660 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c58152ff0 0x7f3c581598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.031+0000 7f3c5ca00700 1 -- 172.21.15.80:0/2882075660 >> 172.21.15.80:0/2882075660 conn(0x7f3c580d0a90 msgr2=0x7f3c58162060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:38.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.031+0000 7f3c5ca00700 1 -- 172.21.15.80:0/2882075660 shutdown_connections 2024-05-10T04:22:38.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.031+0000 7f3c5ca00700 1 -- 172.21.15.80:0/2882075660 wait complete. 2024-05-10T04:22:38.057 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:22:38.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.314+0000 7f1115600700 1 Processor -- start 2024-05-10T04:22:38.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.314+0000 7f1115600700 1 -- start start 2024-05-10T04:22:38.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.316+0000 7f1115600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11100d3460 0x7f11100b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:38.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.316+0000 7f1115600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f11100b58b0 0x7f11100b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:38.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.316+0000 7f1115600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11100d2730 con 0x7f11101620e0 2024-05-10T04:22:38.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.316+0000 7f1115600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11100b3720 con 0x7f11100b58b0 2024-05-10T04:22:38.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.316+0000 7f1115600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1110162c00 con 0x7f11100d3460 2024-05-10T04:22:38.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.316+0000 7f1107e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f11100b58b0 0x7f11100b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:38.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.316+0000 7f1107e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f11100b58b0 0x7f11100b5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33820/0 (socket says 172.21.15.80:33820) 2024-05-10T04:22:38.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.316+0000 7f1107e00700 1 -- 172.21.15.80:0/2556437801 learned_addr learned my addr 172.21.15.80:0/2556437801 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:38.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.316+0000 7f110ea00700 1 --2- 172.21.15.80:0/2556437801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11100d3460 0x7f11100b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:38.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.317+0000 7f1107e00700 1 -- 172.21.15.80:0/2556437801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11100d3460 msgr2=0x7f11100b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:38.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.317+0000 7f1107e00700 1 --2- 172.21.15.80:0/2556437801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11100d3460 0x7f11100b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.317+0000 7f1107e00700 1 -- 172.21.15.80:0/2556437801 >> v1:172.21.15.106:6789/0 conn(0x7f11101620e0 legacy=0x7f11101624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:38.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.317+0000 7f1107e00700 1 -- 172.21.15.80:0/2556437801 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11100d2fd0 con 0x7f11100b58b0 2024-05-10T04:22:38.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.317+0000 7f1107e00700 1 --2- 172.21.15.80:0/2556437801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11100b58b0 0x7f11100b5cc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f10f80098f0 tx=0x7f10f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8b9ee410ab3d90 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:38.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.317+0000 7f110e000700 1 -- 172.21.15.80:0/2556437801 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8011830 con 0x7f11100b58b0 2024-05-10T04:22:38.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.317+0000 7f110e000700 1 -- 172.21.15.80:0/2556437801 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f8011990 con 0x7f11100b58b0 2024-05-10T04:22:38.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.317+0000 7f110e000700 1 -- 172.21.15.80:0/2556437801 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8011d20 con 0x7f11100b58b0 2024-05-10T04:22:38.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.318+0000 7f1115600700 1 -- 172.21.15.80:0/2556437801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11100b58b0 msgr2=0x7f11100b5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:38.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.318+0000 7f1115600700 1 --2- 172.21.15.80:0/2556437801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11100b58b0 0x7f11100b5cc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f10f80098f0 tx=0x7f10f8009c00 comp rx=0 tx=0).stop 2024-05-10T04:22:38.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.318+0000 7f1115600700 1 -- 172.21.15.80:0/2556437801 shutdown_connections 2024-05-10T04:22:38.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.318+0000 7f1115600700 1 --2- 172.21.15.80:0/2556437801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11100d3460 0x7f11100b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.318+0000 7f1115600700 1 --2- 172.21.15.80:0/2556437801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11100b58b0 0x7f11100b5cc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.318+0000 7f1115600700 1 -- 172.21.15.80:0/2556437801 >> 172.21.15.80:0/2556437801 conn(0x7f11100d0a90 msgr2=0x7f11100d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:38.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.318+0000 7f1115600700 1 -- 172.21.15.80:0/2556437801 shutdown_connections 2024-05-10T04:22:38.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.318+0000 7f1115600700 1 -- 172.21.15.80:0/2556437801 wait complete. 2024-05-10T04:22:38.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.321+0000 7f1115600700 1 Processor -- start 2024-05-10T04:22:38.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.321+0000 7f1115600700 1 -- start start 2024-05-10T04:22:38.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.323+0000 7f1115600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11100b58b0 0x7f11101592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:38.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.323+0000 7f1115600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11100d3460 0x7f11101495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:38.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.323+0000 7f1115600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11101620e0 0x7f111014b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:38.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.323+0000 7f1115600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111014dbd0 con 0x7f11100d3460 2024-05-10T04:22:38.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.323+0000 7f1115600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111014a0d0 con 0x7f11100b58b0 2024-05-10T04:22:38.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.323+0000 7f1115600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111014a320 con 0x7f11101620e0 2024-05-10T04:22:38.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.323+0000 7f110ea00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11100b58b0 0x7f11101592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:38.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.323+0000 7f1107e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11100d3460 0x7f11101495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:38.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.323+0000 7f110ea00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11100b58b0 0x7f11101592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37794/0 (socket says 172.21.15.80:37794) 2024-05-10T04:22:38.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.323+0000 7f110ea00700 1 -- 172.21.15.80:0/2162365678 learned_addr learned my addr 172.21.15.80:0/2162365678 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:38.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.323+0000 7f110f400700 1 --2- 172.21.15.80:0/2162365678 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11101620e0 0x7f111014b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:38.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.323+0000 7f1107e00700 1 -- 172.21.15.80:0/2162365678 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11101620e0 msgr2=0x7f111014b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:38.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.323+0000 7f1107e00700 1 --2- 172.21.15.80:0/2162365678 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11101620e0 0x7f111014b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.323+0000 7f1107e00700 1 -- 172.21.15.80:0/2162365678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11100b58b0 msgr2=0x7f11101592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:38.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.323+0000 7f1107e00700 1 --2- 172.21.15.80:0/2162365678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11100b58b0 0x7f11101592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.323+0000 7f1107e00700 1 -- 172.21.15.80:0/2162365678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f8009550 con 0x7f11100d3460 2024-05-10T04:22:38.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.324+0000 7f1107e00700 1 --2- 172.21.15.80:0/2162365678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11100d3460 0x7f11101495b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f10f8016000 tx=0x7f10f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:38.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.324+0000 7f1106a00700 1 -- 172.21.15.80:0/2162365678 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8004510 con 0x7f11100d3460 2024-05-10T04:22:38.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.324+0000 7f1106a00700 1 -- 172.21.15.80:0/2162365678 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f801e070 con 0x7f11100d3460 2024-05-10T04:22:38.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.324+0000 7f1115600700 1 -- 172.21.15.80:0/2162365678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111014a600 con 0x7f11100d3460 2024-05-10T04:22:38.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.324+0000 7f1106a00700 1 -- 172.21.15.80:0/2162365678 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f80038c0 con 0x7f11100d3460 2024-05-10T04:22:38.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.324+0000 7f1115600700 1 -- 172.21.15.80:0/2162365678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111014abc0 con 0x7f11100d3460 2024-05-10T04:22:38.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.325+0000 7f1115600700 1 -- 172.21.15.80:0/2162365678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11100732b0 con 0x7f11100d3460 2024-05-10T04:22:38.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.326+0000 7f1106a00700 1 -- 172.21.15.80:0/2162365678 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f10f8003a20 con 0x7f11100d3460 2024-05-10T04:22:38.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.327+0000 7f1106a00700 1 --2- 172.21.15.80:0/2162365678 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f10ec06acc0 0x7f10ec06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:38.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.328+0000 7f1106a00700 1 -- 172.21.15.80:0/2162365678 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10f808a0b0 con 0x7f11100d3460 2024-05-10T04:22:38.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.328+0000 7f110ea00700 1 --2- 172.21.15.80:0/2162365678 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f10ec06acc0 0x7f10ec06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:38.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.329+0000 7f110ea00700 1 --2- 172.21.15.80:0/2162365678 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f10ec06acc0 0x7f10ec06d1d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1100009c00 tx=0x7f1100009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:38.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.332+0000 7f1106a00700 1 -- 172.21.15.80:0/2162365678 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f10f80552a0 con 0x7f11100d3460 2024-05-10T04:22:38.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.539+0000 7f1115600700 1 -- 172.21.15.80:0/2162365678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1110074af0 con 0x7f11100d3460 2024-05-10T04:22:38.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.540+0000 7f1106a00700 1 -- 172.21.15.80:0/2162365678 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f10f80588c0 con 0x7f11100d3460 2024-05-10T04:22:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:38.541 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:38.485422+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:22:38.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.542+0000 7f1115600700 1 -- 172.21.15.80:0/2162365678 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f10ec06acc0 msgr2=0x7f10ec06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:38.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.542+0000 7f1115600700 1 --2- 172.21.15.80:0/2162365678 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f10ec06acc0 0x7f10ec06d1d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1100009c00 tx=0x7f1100009210 comp rx=0 tx=0).stop 2024-05-10T04:22:38.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.542+0000 7f1115600700 1 -- 172.21.15.80:0/2162365678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11100d3460 msgr2=0x7f11101495b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:38.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.542+0000 7f1115600700 1 --2- 172.21.15.80:0/2162365678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11100d3460 0x7f11101495b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f10f8016000 tx=0x7f10f8004750 comp rx=0 tx=0).stop 2024-05-10T04:22:38.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.543+0000 7f1115600700 1 -- 172.21.15.80:0/2162365678 shutdown_connections 2024-05-10T04:22:38.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.543+0000 7f1115600700 1 --2- 172.21.15.80:0/2162365678 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f10ec06acc0 0x7f10ec06d1d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.543+0000 7f1115600700 1 --2- 172.21.15.80:0/2162365678 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11101620e0 0x7f111014b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.543+0000 7f1115600700 1 --2- 172.21.15.80:0/2162365678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11100b58b0 0x7f11101592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.543+0000 7f1115600700 1 --2- 172.21.15.80:0/2162365678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11100d3460 0x7f11101495b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.543+0000 7f1115600700 1 -- 172.21.15.80:0/2162365678 >> 172.21.15.80:0/2162365678 conn(0x7f11100d0a90 msgr2=0x7f11100b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:38.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.543+0000 7f1115600700 1 -- 172.21.15.80:0/2162365678 shutdown_connections 2024-05-10T04:22:38.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.543+0000 7f1115600700 1 -- 172.21.15.80:0/2162365678 wait complete. 2024-05-10T04:22:38.573 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T04:22:38.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.837+0000 7ff733600700 1 Processor -- start 2024-05-10T04:22:38.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.837+0000 7ff733600700 1 -- start start 2024-05-10T04:22:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.839+0000 7ff733600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff72c162150 0x7ff72c15e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.839+0000 7ff733600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff72c06c160 0x7ff72c06c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.839+0000 7ff733600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72c0d2c00 con 0x7ff72c0cf4d0 2024-05-10T04:22:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.839+0000 7ff733600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72c06cab0 con 0x7ff72c06c160 2024-05-10T04:22:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.839+0000 7ff733600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c162630 con 0x7ff72c162150 2024-05-10T04:22:38.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.840+0000 7ff730c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff72c162150 0x7ff72c15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:38.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.840+0000 7ff731600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff72c06c160 0x7ff72c06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:38.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.840+0000 7ff730c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff72c162150 0x7ff72c15e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:56590/0 (socket says 172.21.15.80:56590) 2024-05-10T04:22:38.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.840+0000 7ff730c00700 1 -- 172.21.15.80:0/1188685572 learned_addr learned my addr 172.21.15.80:0/1188685572 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:38.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.840+0000 7ff72be00700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff72c0cf4d0 0x7ff72c0b73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:55174/0 (socket says 172.21.15.80:55174) 2024-05-10T04:22:38.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.840+0000 7ff730c00700 1 -- 172.21.15.80:0/1188685572 >> v2:172.21.15.106:3300/0 conn(0x7ff72c06c160 msgr2=0x7ff72c06c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:38.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.840+0000 7ff730c00700 1 --2- 172.21.15.80:0/1188685572 >> v2:172.21.15.106:3300/0 conn(0x7ff72c06c160 0x7ff72c06c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.840+0000 7ff730c00700 1 -- 172.21.15.80:0/1188685572 >> v1:172.21.15.106:6789/0 conn(0x7ff72c0cf4d0 legacy=0x7ff72c0b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:38.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.840+0000 7ff730c00700 1 -- 172.21.15.80:0/1188685572 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c162910 con 0x7ff72c162150 2024-05-10T04:22:38.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.840+0000 7ff731600700 1 --2- 172.21.15.80:0/1188685572 >> v2:172.21.15.106:3300/0 conn(0x7ff72c06c160 0x7ff72c06c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:38.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.841+0000 7ff730c00700 1 --2- 172.21.15.80:0/1188685572 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff72c162150 0x7ff72c15e610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff7200098f0 tx=0x7ff720009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70229dec20d3257c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:38.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.841+0000 7ff72b400700 1 -- 172.21.15.80:0/1188685572 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720004230 con 0x7ff72c162150 2024-05-10T04:22:38.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.841+0000 7ff72b400700 1 -- 172.21.15.80:0/1188685572 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff720004390 con 0x7ff72c162150 2024-05-10T04:22:38.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.841+0000 7ff72b400700 1 -- 172.21.15.80:0/1188685572 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7200036a0 con 0x7ff72c162150 2024-05-10T04:22:38.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.841+0000 7ff733600700 1 -- 172.21.15.80:0/1188685572 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff72c162150 msgr2=0x7ff72c15e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:38.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.841+0000 7ff733600700 1 --2- 172.21.15.80:0/1188685572 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff72c162150 0x7ff72c15e610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff7200098f0 tx=0x7ff720009c00 comp rx=0 tx=0).stop 2024-05-10T04:22:38.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.842+0000 7ff733600700 1 -- 172.21.15.80:0/1188685572 shutdown_connections 2024-05-10T04:22:38.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.842+0000 7ff733600700 1 --2- 172.21.15.80:0/1188685572 >> v2:172.21.15.106:3300/0 conn(0x7ff72c06c160 0x7ff72c06c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.842+0000 7ff733600700 1 --2- 172.21.15.80:0/1188685572 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff72c162150 0x7ff72c15e610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.842+0000 7ff733600700 1 -- 172.21.15.80:0/1188685572 >> 172.21.15.80:0/1188685572 conn(0x7ff72c0d3e10 msgr2=0x7ff72c0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:38.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.842+0000 7ff733600700 1 -- 172.21.15.80:0/1188685572 shutdown_connections 2024-05-10T04:22:38.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.842+0000 7ff733600700 1 -- 172.21.15.80:0/1188685572 wait complete. 2024-05-10T04:22:38.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.844+0000 7ff733600700 1 Processor -- start 2024-05-10T04:22:38.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.845+0000 7ff733600700 1 -- start start 2024-05-10T04:22:38.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.846+0000 7ff733600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff72c06c160 0x7ff72c1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:38.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.846+0000 7ff733600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff72c0cf4d0 0x7ff72c0cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:38.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.846+0000 7ff733600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff72c162150 0x7ff72c160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:38.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.846+0000 7ff733600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c0cd4a0 con 0x7ff72c162150 2024-05-10T04:22:38.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.846+0000 7ff733600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c0cbdb0 con 0x7ff72c0cf4d0 2024-05-10T04:22:38.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.846+0000 7ff733600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c0c8200 con 0x7ff72c06c160 2024-05-10T04:22:38.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.847+0000 7ff731600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff72c162150 0x7ff72c160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:38.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.847+0000 7ff731600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff72c162150 0x7ff72c160490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33848/0 (socket says 172.21.15.80:33848) 2024-05-10T04:22:38.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.847+0000 7ff731600700 1 -- 172.21.15.80:0/2468619955 learned_addr learned my addr 172.21.15.80:0/2468619955 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:38.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.847+0000 7ff730c00700 1 --2- 172.21.15.80:0/2468619955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff72c06c160 0x7ff72c1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:38.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.847+0000 7ff72be00700 1 --2- 172.21.15.80:0/2468619955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff72c0cf4d0 0x7ff72c0cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:38.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.847+0000 7ff731600700 1 -- 172.21.15.80:0/2468619955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff72c06c160 msgr2=0x7ff72c1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.847+0000 7ff731600700 1 --2- 172.21.15.80:0/2468619955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff72c06c160 0x7ff72c1582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.847+0000 7ff731600700 1 -- 172.21.15.80:0/2468619955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff72c0cf4d0 msgr2=0x7ff72c0cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.847+0000 7ff731600700 1 --2- 172.21.15.80:0/2468619955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff72c0cf4d0 0x7ff72c0cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.847+0000 7ff731600700 1 -- 172.21.15.80:0/2468619955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff724009a70 con 0x7ff72c162150 2024-05-10T04:22:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.848+0000 7ff731600700 1 --2- 172.21.15.80:0/2468619955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff72c162150 0x7ff72c160490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff72400efc0 tx=0x7ff72400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.848+0000 7ff728c00700 1 -- 172.21.15.80:0/2468619955 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72400ca90 con 0x7ff72c162150 2024-05-10T04:22:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.848+0000 7ff728c00700 1 -- 172.21.15.80:0/2468619955 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72400f040 con 0x7ff72c162150 2024-05-10T04:22:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.848+0000 7ff733600700 1 -- 172.21.15.80:0/2468619955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff720009550 con 0x7ff72c162150 2024-05-10T04:22:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.848+0000 7ff728c00700 1 -- 172.21.15.80:0/2468619955 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72400ce30 con 0x7ff72c162150 2024-05-10T04:22:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.848+0000 7ff733600700 1 -- 172.21.15.80:0/2468619955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72c0c75f0 con 0x7ff72c162150 2024-05-10T04:22:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.849+0000 7ff733600700 1 -- 172.21.15.80:0/2468619955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff72c0d4750 con 0x7ff72c162150 2024-05-10T04:22:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.850+0000 7ff728c00700 1 -- 172.21.15.80:0/2468619955 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff724014480 con 0x7ff72c162150 2024-05-10T04:22:38.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.851+0000 7ff728c00700 1 --2- 172.21.15.80:0/2468619955 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff70c06acc0 0x7ff70c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:38.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.851+0000 7ff728c00700 1 -- 172.21.15.80:0/2468619955 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff724089af0 con 0x7ff72c162150 2024-05-10T04:22:38.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.851+0000 7ff730c00700 1 --2- 172.21.15.80:0/2468619955 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff70c06acc0 0x7ff70c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:38.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.852+0000 7ff730c00700 1 --2- 172.21.15.80:0/2468619955 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff70c06acc0 0x7ff70c06d1d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff7200098f0 tx=0x7ff720008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:38.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:38.856+0000 7ff728c00700 1 -- 172.21.15.80:0/2468619955 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff724054ba0 con 0x7ff72c162150 2024-05-10T04:22:39.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:39.112+0000 7ff733600700 1 -- 172.21.15.80:0/2468619955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff72c074af0 con 0x7ff72c162150 2024-05-10T04:22:39.200 INFO:tasks.ceph.mds.b.smithi106.stderr:2024-05-10T04:22:39.200+0000 7fd435200700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T04:22:39.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:39.916+0000 7ff728c00700 1 -- 172.21.15.80:0/2468619955 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff7240180b0 con 0x7ff72c162150 2024-05-10T04:22:39.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:39.919+0000 7ff733600700 1 -- 172.21.15.80:0/2468619955 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff70c06acc0 msgr2=0x7ff70c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:39.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:39.919+0000 7ff733600700 1 --2- 172.21.15.80:0/2468619955 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff70c06acc0 0x7ff70c06d1d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff7200098f0 tx=0x7ff720008030 comp rx=0 tx=0).stop 2024-05-10T04:22:39.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:39.919+0000 7ff733600700 1 -- 172.21.15.80:0/2468619955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff72c162150 msgr2=0x7ff72c160490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:39.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:39.919+0000 7ff733600700 1 --2- 172.21.15.80:0/2468619955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff72c162150 0x7ff72c160490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff72400efc0 tx=0x7ff72400c3a0 comp rx=0 tx=0).stop 2024-05-10T04:22:39.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:39.919+0000 7ff733600700 1 -- 172.21.15.80:0/2468619955 shutdown_connections 2024-05-10T04:22:39.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:39.920+0000 7ff733600700 1 --2- 172.21.15.80:0/2468619955 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff70c06acc0 0x7ff70c06d1d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:39.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:39.920+0000 7ff733600700 1 --2- 172.21.15.80:0/2468619955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff72c162150 0x7ff72c160490 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:39.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:39.920+0000 7ff733600700 1 --2- 172.21.15.80:0/2468619955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff72c06c160 0x7ff72c1582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:39.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:39.920+0000 7ff733600700 1 --2- 172.21.15.80:0/2468619955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff72c0cf4d0 0x7ff72c0cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:39.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:39.920+0000 7ff733600700 1 -- 172.21.15.80:0/2468619955 >> 172.21.15.80:0/2468619955 conn(0x7ff72c0d3e10 msgr2=0x7ff72c0b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:39.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:39.920+0000 7ff733600700 1 -- 172.21.15.80:0/2468619955 shutdown_connections 2024-05-10T04:22:39.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:39.920+0000 7ff733600700 1 -- 172.21.15.80:0/2468619955 wait complete. 2024-05-10T04:22:39.951 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T04:22:39.952 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T04:22:40.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.217+0000 7ff9b6000700 1 Processor -- start 2024-05-10T04:22:40.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.217+0000 7ff9b6000700 1 -- start start 2024-05-10T04:22:40.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.219+0000 7ff9b6000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff9b0158c70 0x7ff9b015ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:40.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.219+0000 7ff9b6000700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff9b0162000 0x7ff9b006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:40.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.219+0000 7ff9b6000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9b00b5c90 0x7ff9b00b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:40.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.219+0000 7ff9b6000700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b006c5f0 con 0x7ff9b0158c70 2024-05-10T04:22:40.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.219+0000 7ff9b6000700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b00b65e0 con 0x7ff9b0162000 2024-05-10T04:22:40.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.219+0000 7ff9b6000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b0162850 con 0x7ff9b00b5c90 2024-05-10T04:22:40.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.219+0000 7ff9af400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff9b0158c70 0x7ff9b015ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:40.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.220+0000 7ff9af400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff9b0158c70 0x7ff9b015ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33860/0 (socket says 172.21.15.80:33860) 2024-05-10T04:22:40.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.220+0000 7ff9af400700 1 -- 172.21.15.80:0/3543941682 learned_addr learned my addr 172.21.15.80:0/3543941682 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:40.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.220+0000 7ff9aea00700 1 --2- 172.21.15.80:0/3543941682 >> v2:172.21.15.106:3300/0 conn(0x7ff9b0162000 0x7ff9b006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:40.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.220+0000 7ff9afe00700 1 --2- 172.21.15.80:0/3543941682 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9b00b5c90 0x7ff9b00b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:40.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.220+0000 7ff9af400700 1 -- 172.21.15.80:0/3543941682 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9b00b5c90 msgr2=0x7ff9b00b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:40.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.220+0000 7ff9af400700 1 --2- 172.21.15.80:0/3543941682 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9b00b5c90 0x7ff9b00b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:40.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.220+0000 7ff9af400700 1 -- 172.21.15.80:0/3543941682 >> v2:172.21.15.106:3300/0 conn(0x7ff9b0162000 msgr2=0x7ff9b006ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:40.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.220+0000 7ff9af400700 1 --2- 172.21.15.80:0/3543941682 >> v2:172.21.15.106:3300/0 conn(0x7ff9b0162000 0x7ff9b006ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:40.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.220+0000 7ff9af400700 1 -- 172.21.15.80:0/3543941682 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b0162b30 con 0x7ff9b0158c70 2024-05-10T04:22:40.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.220+0000 7ff9aea00700 1 --2- 172.21.15.80:0/3543941682 >> v2:172.21.15.106:3300/0 conn(0x7ff9b0162000 0x7ff9b006ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:22:40.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.220+0000 7ff9afe00700 1 --2- 172.21.15.80:0/3543941682 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9b00b5c90 0x7ff9b00b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:22:40.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.220+0000 7ff9af400700 1 --2- 172.21.15.80:0/3543941682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9b0158c70 0x7ff9b015ea10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9b006d440 tx=0x7ff9a0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f8de7469c9561f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:40.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.220+0000 7ff9ae000700 1 -- 172.21.15.80:0/3543941682 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000b870 con 0x7ff9b0158c70 2024-05-10T04:22:40.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.221+0000 7ff9ae000700 1 -- 172.21.15.80:0/3543941682 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a000b9d0 con 0x7ff9b0158c70 2024-05-10T04:22:40.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.221+0000 7ff9ae000700 1 -- 172.21.15.80:0/3543941682 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000bd60 con 0x7ff9b0158c70 2024-05-10T04:22:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.221+0000 7ff9b6000700 1 -- 172.21.15.80:0/3543941682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9b0158c70 msgr2=0x7ff9b015ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.221+0000 7ff9b6000700 1 --2- 172.21.15.80:0/3543941682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9b0158c70 0x7ff9b015ea10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9b006d440 tx=0x7ff9a0009bd0 comp rx=0 tx=0).stop 2024-05-10T04:22:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.221+0000 7ff9b6000700 1 -- 172.21.15.80:0/3543941682 shutdown_connections 2024-05-10T04:22:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.221+0000 7ff9b6000700 1 --2- 172.21.15.80:0/3543941682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9b0158c70 0x7ff9b015ea10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.221+0000 7ff9b6000700 1 --2- 172.21.15.80:0/3543941682 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9b00b5c90 0x7ff9b00b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.221+0000 7ff9b6000700 1 --2- 172.21.15.80:0/3543941682 >> v2:172.21.15.106:3300/0 conn(0x7ff9b0162000 0x7ff9b006ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.221+0000 7ff9b6000700 1 -- 172.21.15.80:0/3543941682 >> 172.21.15.80:0/3543941682 conn(0x7ff9b00d0d30 msgr2=0x7ff9b00d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.221+0000 7ff9b6000700 1 -- 172.21.15.80:0/3543941682 shutdown_connections 2024-05-10T04:22:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.221+0000 7ff9b6000700 1 -- 172.21.15.80:0/3543941682 wait complete. 2024-05-10T04:22:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.224+0000 7ff9b6000700 1 Processor -- start 2024-05-10T04:22:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.224+0000 7ff9b6000700 1 -- start start 2024-05-10T04:22:40.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.225+0000 7ff9b6000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9b00b5c90 0x7ff9b00cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:40.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.225+0000 7ff9b6000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9b0158c70 0x7ff9b00cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:40.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.225+0000 7ff9b6000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9b0162000 0x7ff9b0148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:40.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.225+0000 7ff9b6000700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00ccdd0 con 0x7ff9b00b5c90 2024-05-10T04:22:40.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.225+0000 7ff9b6000700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b01495f0 con 0x7ff9b0162000 2024-05-10T04:22:40.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.225+0000 7ff9b6000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00ce3b0 con 0x7ff9b0158c70 2024-05-10T04:22:40.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.225+0000 7ff9af400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9b00b5c90 0x7ff9b00cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:40.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.225+0000 7ff9af400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9b00b5c90 0x7ff9b00cde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33872/0 (socket says 172.21.15.80:33872) 2024-05-10T04:22:40.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.225+0000 7ff9af400700 1 -- 172.21.15.80:0/3056245929 learned_addr learned my addr 172.21.15.80:0/3056245929 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:40.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.226+0000 7ff9afe00700 1 --2- 172.21.15.80:0/3056245929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9b0162000 0x7ff9b0148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:40.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.226+0000 7ff9aea00700 1 --2- 172.21.15.80:0/3056245929 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9b0158c70 0x7ff9b00cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:40.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.226+0000 7ff9af400700 1 -- 172.21.15.80:0/3056245929 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9b0158c70 msgr2=0x7ff9b00cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:40.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.226+0000 7ff9af400700 1 --2- 172.21.15.80:0/3056245929 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9b0158c70 0x7ff9b00cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:40.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.226+0000 7ff9af400700 1 -- 172.21.15.80:0/3056245929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9b0162000 msgr2=0x7ff9b0148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:40.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.226+0000 7ff9af400700 1 --2- 172.21.15.80:0/3056245929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9b0162000 0x7ff9b0148a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:40.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.226+0000 7ff9af400700 1 -- 172.21.15.80:0/3056245929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a0009550 con 0x7ff9b00b5c90 2024-05-10T04:22:40.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.226+0000 7ff9aea00700 1 --2- 172.21.15.80:0/3056245929 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9b0158c70 0x7ff9b00cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:40.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.226+0000 7ff9af400700 1 --2- 172.21.15.80:0/3056245929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9b00b5c90 0x7ff9b00cde70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0013000 tx=0x7ff9a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:40.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.226+0000 7ff9a7400700 1 -- 172.21.15.80:0/3056245929 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0004310 con 0x7ff9b00b5c90 2024-05-10T04:22:40.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.226+0000 7ff9a7400700 1 -- 172.21.15.80:0/3056245929 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a001e070 con 0x7ff9b00b5c90 2024-05-10T04:22:40.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.226+0000 7ff9b6000700 1 -- 172.21.15.80:0/3056245929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b00cc150 con 0x7ff9b00b5c90 2024-05-10T04:22:40.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.226+0000 7ff9a7400700 1 -- 172.21.15.80:0/3056245929 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a00036a0 con 0x7ff9b00b5c90 2024-05-10T04:22:40.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.227+0000 7ff9b6000700 1 -- 172.21.15.80:0/3056245929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b00cc710 con 0x7ff9b00b5c90 2024-05-10T04:22:40.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.227+0000 7ff9b6000700 1 -- 172.21.15.80:0/3056245929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b00ce600 con 0x7ff9b00b5c90 2024-05-10T04:22:40.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.228+0000 7ff9a7400700 1 -- 172.21.15.80:0/3056245929 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff9a0020030 con 0x7ff9b00b5c90 2024-05-10T04:22:40.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.229+0000 7ff9a7400700 1 --2- 172.21.15.80:0/3056245929 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff99006ac90 0x7ff99006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:40.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.229+0000 7ff9a7400700 1 -- 172.21.15.80:0/3056245929 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9a008a400 con 0x7ff9b00b5c90 2024-05-10T04:22:40.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.230+0000 7ff9aea00700 1 --2- 172.21.15.80:0/3056245929 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff99006ac90 0x7ff99006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:40.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.231+0000 7ff9aea00700 1 --2- 172.21.15.80:0/3056245929 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff99006ac90 0x7ff99006d1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff99c006fd0 tx=0x7ff99c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:40.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.234+0000 7ff9a7400700 1 -- 172.21.15.80:0/3056245929 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff9a00555d0 con 0x7ff9b00b5c90 2024-05-10T04:22:40.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.488+0000 7ff9b6000700 1 -- 172.21.15.80:0/3056245929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff9b00732b0 con 0x7ff9b00b5c90 2024-05-10T04:22:40.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.922+0000 7ff9a7400700 1 -- 172.21.15.80:0/3056245929 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff9a0058bf0 con 0x7ff9b00b5c90 2024-05-10T04:22:40.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.925+0000 7ff9b6000700 1 -- 172.21.15.80:0/3056245929 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff99006ac90 msgr2=0x7ff99006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:40.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.925+0000 7ff9b6000700 1 --2- 172.21.15.80:0/3056245929 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff99006ac90 0x7ff99006d1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff99c006fd0 tx=0x7ff99c008040 comp rx=0 tx=0).stop 2024-05-10T04:22:40.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.925+0000 7ff9b6000700 1 -- 172.21.15.80:0/3056245929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9b00b5c90 msgr2=0x7ff9b00cde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:40.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.925+0000 7ff9b6000700 1 --2- 172.21.15.80:0/3056245929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9b00b5c90 0x7ff9b00cde70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0013000 tx=0x7ff9a0004750 comp rx=0 tx=0).stop 2024-05-10T04:22:40.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.925+0000 7ff9b6000700 1 -- 172.21.15.80:0/3056245929 shutdown_connections 2024-05-10T04:22:40.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.925+0000 7ff9b6000700 1 --2- 172.21.15.80:0/3056245929 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff99006ac90 0x7ff99006d1a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:40.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.925+0000 7ff9b6000700 1 --2- 172.21.15.80:0/3056245929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9b00b5c90 0x7ff9b00cde70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:40.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.925+0000 7ff9b6000700 1 --2- 172.21.15.80:0/3056245929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9b0162000 0x7ff9b0148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:40.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.925+0000 7ff9b6000700 1 --2- 172.21.15.80:0/3056245929 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9b0158c70 0x7ff9b00cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:40.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.925+0000 7ff9b6000700 1 -- 172.21.15.80:0/3056245929 >> 172.21.15.80:0/3056245929 conn(0x7ff9b00d0d30 msgr2=0x7ff9b0161080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:40.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.925+0000 7ff9b6000700 1 -- 172.21.15.80:0/3056245929 shutdown_connections 2024-05-10T04:22:40.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:40.925+0000 7ff9b6000700 1 -- 172.21.15.80:0/3056245929 wait complete. 2024-05-10T04:22:40.951 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T04:22:40.952 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:22:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.209+0000 7f5baf800700 1 Processor -- start 2024-05-10T04:22:41.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.209+0000 7f5baf800700 1 -- start start 2024-05-10T04:22:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.211+0000 7f5baf800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ba80b2f50 0x7f5ba8161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.211+0000 7f5baf800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5ba80d0d40 0x7f5ba80d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.211+0000 7f5baf800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba80d28c0 con 0x7f5ba80d3030 2024-05-10T04:22:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.211+0000 7f5baf800700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba80b3360 con 0x7f5ba80d0d40 2024-05-10T04:22:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.211+0000 7f5baf800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba81624e0 con 0x7f5ba80b2f50 2024-05-10T04:22:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.211+0000 7f5ba7e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5ba80d3030 0x7f5ba80d0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39584/0 (socket says 172.21.15.80:39584) 2024-05-10T04:22:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.211+0000 7f5ba7e00700 1 -- 172.21.15.80:0/3235713656 learned_addr learned my addr 172.21.15.80:0/3235713656 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.211+0000 7f5bad800700 1 --2- 172.21.15.80:0/3235713656 >> v2:172.21.15.80:3300/0 conn(0x7f5ba80d0d40 0x7f5ba80d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.211+0000 7f5bace00700 1 --2- 172.21.15.80:0/3235713656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ba80b2f50 0x7f5ba8161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.211+0000 7f5ba7400700 1 -- 172.21.15.80:0/3235713656 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707787396 0 0) 0x7f5ba80d28c0 con 0x7f5ba80d3030 2024-05-10T04:22:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.211+0000 7f5bad800700 1 -- 172.21.15.80:0/3235713656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ba80b2f50 msgr2=0x7f5ba8161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.211+0000 7f5bad800700 1 --2- 172.21.15.80:0/3235713656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ba80b2f50 0x7f5ba8161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.211+0000 7f5bad800700 1 -- 172.21.15.80:0/3235713656 >> v1:172.21.15.80:6789/0 conn(0x7f5ba80d3030 legacy=0x7f5ba80d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.211+0000 7f5bad800700 1 -- 172.21.15.80:0/3235713656 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba80d2ba0 con 0x7f5ba80d0d40 2024-05-10T04:22:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.212+0000 7f5bace00700 1 --2- 172.21.15.80:0/3235713656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ba80b2f50 0x7f5ba8161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.212+0000 7f5bad800700 1 --2- 172.21.15.80:0/3235713656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ba80d0d40 0x7f5ba80d3440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009d90 tx=0x7f5ba000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06039bf9962b07 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.212+0000 7f5ba7400700 1 -- 172.21.15.80:0/3235713656 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba000e070 con 0x7f5ba80d0d40 2024-05-10T04:22:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.212+0000 7f5ba7400700 1 -- 172.21.15.80:0/3235713656 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba000bbd0 con 0x7f5ba80d0d40 2024-05-10T04:22:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.212+0000 7f5ba7400700 1 -- 172.21.15.80:0/3235713656 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0012430 con 0x7f5ba80d0d40 2024-05-10T04:22:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.213+0000 7f5baf800700 1 -- 172.21.15.80:0/3235713656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ba80d0d40 msgr2=0x7f5ba80d3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.213+0000 7f5baf800700 1 --2- 172.21.15.80:0/3235713656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ba80d0d40 0x7f5ba80d3440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009d90 tx=0x7f5ba000b330 comp rx=0 tx=0).stop 2024-05-10T04:22:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.213+0000 7f5baf800700 1 -- 172.21.15.80:0/3235713656 shutdown_connections 2024-05-10T04:22:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.213+0000 7f5baf800700 1 --2- 172.21.15.80:0/3235713656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ba80d0d40 0x7f5ba80d3440 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.213+0000 7f5baf800700 1 --2- 172.21.15.80:0/3235713656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ba80b2f50 0x7f5ba8161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.213+0000 7f5baf800700 1 -- 172.21.15.80:0/3235713656 >> 172.21.15.80:0/3235713656 conn(0x7f5ba806c3f0 msgr2=0x7f5ba806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:41.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.213+0000 7f5baf800700 1 -- 172.21.15.80:0/3235713656 shutdown_connections 2024-05-10T04:22:41.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.213+0000 7f5baf800700 1 -- 172.21.15.80:0/3235713656 wait complete. 2024-05-10T04:22:41.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.216+0000 7f5baf800700 1 Processor -- start 2024-05-10T04:22:41.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.216+0000 7f5baf800700 1 -- start start 2024-05-10T04:22:41.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.218+0000 7f5baf800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ba80b2f50 0x7f5ba81f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:41.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.218+0000 7f5baf800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ba80d0d40 0x7f5ba81f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:41.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.218+0000 7f5baf800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ba80d3030 0x7f5ba815c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:41.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.218+0000 7f5baf800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba81f4a40 con 0x7f5ba80b2f50 2024-05-10T04:22:41.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.218+0000 7f5baf800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba81f4e60 con 0x7f5ba80d3030 2024-05-10T04:22:41.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.218+0000 7f5baf800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba8159d30 con 0x7f5ba80d0d40 2024-05-10T04:22:41.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.218+0000 7f5bace00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ba80b2f50 0x7f5ba81f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:41.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.218+0000 7f5bace00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ba80b2f50 0x7f5ba81f7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33896/0 (socket says 172.21.15.80:33896) 2024-05-10T04:22:41.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.218+0000 7f5bace00700 1 -- 172.21.15.80:0/84003070 learned_addr learned my addr 172.21.15.80:0/84003070 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:41.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.218+0000 7f5ba7e00700 1 --2- 172.21.15.80:0/84003070 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ba80d0d40 0x7f5ba81f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:41.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.218+0000 7f5bad800700 1 --2- 172.21.15.80:0/84003070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ba80d3030 0x7f5ba815c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:41.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.218+0000 7f5bace00700 1 -- 172.21.15.80:0/84003070 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ba80d0d40 msgr2=0x7f5ba81f8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:41.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.218+0000 7f5bace00700 1 --2- 172.21.15.80:0/84003070 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ba80d0d40 0x7f5ba81f8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.218+0000 7f5bace00700 1 -- 172.21.15.80:0/84003070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ba80d3030 msgr2=0x7f5ba815c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:41.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.218+0000 7f5bace00700 1 --2- 172.21.15.80:0/84003070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ba80d3030 0x7f5ba815c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.218+0000 7f5bace00700 1 -- 172.21.15.80:0/84003070 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba0009a70 con 0x7f5ba80b2f50 2024-05-10T04:22:41.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.218+0000 7f5ba7e00700 1 --2- 172.21.15.80:0/84003070 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ba80d0d40 0x7f5ba81f8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:41.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.219+0000 7f5bace00700 1 --2- 172.21.15.80:0/84003070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ba80b2f50 0x7f5ba81f7970 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00e7e0 tx=0x7f5b9c00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:41.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.219+0000 7f5ba4c00700 1 -- 172.21.15.80:0/84003070 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c00c030 con 0x7f5ba80b2f50 2024-05-10T04:22:41.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.219+0000 7f5ba4c00700 1 -- 172.21.15.80:0/84003070 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9c013610 con 0x7f5ba80b2f50 2024-05-10T04:22:41.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.219+0000 7f5ba4c00700 1 -- 172.21.15.80:0/84003070 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c0139a0 con 0x7f5ba80b2f50 2024-05-10T04:22:41.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.219+0000 7f5baf800700 1 -- 172.21.15.80:0/84003070 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba80c7930 con 0x7f5ba80b2f50 2024-05-10T04:22:41.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.219+0000 7f5baf800700 1 -- 172.21.15.80:0/84003070 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba80c7ef0 con 0x7f5ba80b2f50 2024-05-10T04:22:41.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.220+0000 7f5baf800700 1 -- 172.21.15.80:0/84003070 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba80b4e00 con 0x7f5ba80b2f50 2024-05-10T04:22:41.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.221+0000 7f5ba4c00700 1 -- 172.21.15.80:0/84003070 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5b9c013b00 con 0x7f5ba80b2f50 2024-05-10T04:22:41.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.222+0000 7f5ba4c00700 1 --2- 172.21.15.80:0/84003070 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5b8806acc0 0x7f5b8806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:41.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.222+0000 7f5ba4c00700 1 -- 172.21.15.80:0/84003070 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b9c088e70 con 0x7f5ba80b2f50 2024-05-10T04:22:41.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.222+0000 7f5ba7e00700 1 --2- 172.21.15.80:0/84003070 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5b8806acc0 0x7f5b8806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:41.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.223+0000 7f5ba7e00700 1 --2- 172.21.15.80:0/84003070 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5b8806acc0 0x7f5b8806d1d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ba81621c0 tx=0x7f5b94007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:41.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.226+0000 7f5ba4c00700 1 -- 172.21.15.80:0/84003070 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5b9c053f20 con 0x7f5ba80b2f50 2024-05-10T04:22:41.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.474+0000 7f5baf800700 1 -- 172.21.15.80:0/84003070 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ba8074af0 con 0x7f5ba80b2f50 2024-05-10T04:22:41.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.475+0000 7f5ba4c00700 1 -- 172.21.15.80:0/84003070 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4731 (secure 0 0 0) 0x7f5b9c057540 con 0x7f5ba80b2f50 2024-05-10T04:22:41.476 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:41.476 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4189316245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4189316245},{"type":"v1","addr":"172.21.15.106:6836","nonce":4189316245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/4150483341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":4150483341},{"type":"v1","addr":"172.21.15.80:6833","nonce":4150483341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1287697381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1287697381},{"type":"v1","addr":"172.21.15.80:6835","nonce":1287697381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:22:37.482943+0000","modified":"2024-05-10T04:22:40.916280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/961352916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":961352916},{"type":"v1","addr":"172.21.15.106:6837","nonce":961352916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:22:41.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.477+0000 7f5baf800700 1 -- 172.21.15.80:0/84003070 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5b8806acc0 msgr2=0x7f5b8806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:41.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.477+0000 7f5baf800700 1 --2- 172.21.15.80:0/84003070 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5b8806acc0 0x7f5b8806d1d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ba81621c0 tx=0x7f5b94007d50 comp rx=0 tx=0).stop 2024-05-10T04:22:41.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.477+0000 7f5baf800700 1 -- 172.21.15.80:0/84003070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ba80b2f50 msgr2=0x7f5ba81f7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:41.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.477+0000 7f5baf800700 1 --2- 172.21.15.80:0/84003070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ba80b2f50 0x7f5ba81f7970 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00e7e0 tx=0x7f5b9c00eba0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.477+0000 7f5baf800700 1 -- 172.21.15.80:0/84003070 shutdown_connections 2024-05-10T04:22:41.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.477+0000 7f5baf800700 1 --2- 172.21.15.80:0/84003070 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5b8806acc0 0x7f5b8806d1d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.477+0000 7f5baf800700 1 --2- 172.21.15.80:0/84003070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ba80b2f50 0x7f5ba81f7970 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.477+0000 7f5baf800700 1 --2- 172.21.15.80:0/84003070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ba80d3030 0x7f5ba815c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.477+0000 7f5baf800700 1 --2- 172.21.15.80:0/84003070 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ba80d0d40 0x7f5ba81f8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.477+0000 7f5baf800700 1 -- 172.21.15.80:0/84003070 >> 172.21.15.80:0/84003070 conn(0x7f5ba806c3f0 msgr2=0x7f5ba80cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:41.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.477+0000 7f5baf800700 1 -- 172.21.15.80:0/84003070 shutdown_connections 2024-05-10T04:22:41.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.478+0000 7f5baf800700 1 -- 172.21.15.80:0/84003070 wait complete. 2024-05-10T04:22:41.480 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2024-05-10T04:22:41.505 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:22:41.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.764+0000 7f70a5600700 1 Processor -- start 2024-05-10T04:22:41.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.764+0000 7f70a5600700 1 -- start start 2024-05-10T04:22:41.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.765+0000 7f70a5600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f70a00b2f50 0x7f70a0161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:41.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.765+0000 7f70a5600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70a00d0d40 0x7f70a00d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:41.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.766+0000 7f70a5600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a00d28c0 con 0x7f70a00d3030 2024-05-10T04:22:41.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.766+0000 7f70a5600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a00b3360 con 0x7f70a00b2f50 2024-05-10T04:22:41.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.766+0000 7f70a5600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a01624e0 con 0x7f70a00d0d40 2024-05-10T04:22:41.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.766+0000 7f709f400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70a00d0d40 0x7f70a00d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:41.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.766+0000 7f709f400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70a00d0d40 0x7f70a00d3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:56640/0 (socket says 172.21.15.80:56640) 2024-05-10T04:22:41.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.766+0000 7f709f400700 1 -- 172.21.15.80:0/1715377297 learned_addr learned my addr 172.21.15.80:0/1715377297 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:41.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.766+0000 7f709ea00700 1 --2- 172.21.15.80:0/1715377297 >> v2:172.21.15.106:3300/0 conn(0x7f70a00b2f50 0x7f70a0161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:41.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.766+0000 7f709f400700 1 -- 172.21.15.80:0/1715377297 >> v2:172.21.15.106:3300/0 conn(0x7f70a00b2f50 msgr2=0x7f70a0161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:41.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.766+0000 7f709f400700 1 --2- 172.21.15.80:0/1715377297 >> v2:172.21.15.106:3300/0 conn(0x7f70a00b2f50 0x7f70a0161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.766+0000 7f709f400700 1 -- 172.21.15.80:0/1715377297 >> v1:172.21.15.106:6789/0 conn(0x7f70a00d3030 legacy=0x7f70a00d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:41.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.766+0000 7f709f400700 1 -- 172.21.15.80:0/1715377297 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a00d2ba0 con 0x7f70a00d0d40 2024-05-10T04:22:41.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.766+0000 7f709ea00700 1 --2- 172.21.15.80:0/1715377297 >> v2:172.21.15.106:3300/0 conn(0x7f70a00b2f50 0x7f70a0161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:41.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.767+0000 7f709f400700 1 --2- 172.21.15.80:0/1715377297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70a00d0d40 0x7f70a00d3440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7098009e50 tx=0x7f709800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78290307b86c8e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:41.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.767+0000 7f709e000700 1 -- 172.21.15.80:0/1715377297 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709800e070 con 0x7f70a00d0d40 2024-05-10T04:22:41.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.767+0000 7f709e000700 1 -- 172.21.15.80:0/1715377297 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709800b910 con 0x7f70a00d0d40 2024-05-10T04:22:41.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.767+0000 7f709e000700 1 -- 172.21.15.80:0/1715377297 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709800bcc0 con 0x7f70a00d0d40 2024-05-10T04:22:41.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.768+0000 7f70a5600700 1 -- 172.21.15.80:0/1715377297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70a00d0d40 msgr2=0x7f70a00d3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:41.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.768+0000 7f70a5600700 1 --2- 172.21.15.80:0/1715377297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70a00d0d40 0x7f70a00d3440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7098009e50 tx=0x7f709800b330 comp rx=0 tx=0).stop 2024-05-10T04:22:41.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.768+0000 7f70a5600700 1 -- 172.21.15.80:0/1715377297 shutdown_connections 2024-05-10T04:22:41.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.768+0000 7f70a5600700 1 --2- 172.21.15.80:0/1715377297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70a00d0d40 0x7f70a00d3440 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.768+0000 7f70a5600700 1 --2- 172.21.15.80:0/1715377297 >> v2:172.21.15.106:3300/0 conn(0x7f70a00b2f50 0x7f70a0161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.768+0000 7f70a5600700 1 -- 172.21.15.80:0/1715377297 >> 172.21.15.80:0/1715377297 conn(0x7f70a006c3f0 msgr2=0x7f70a006c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:41.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.768+0000 7f70a5600700 1 -- 172.21.15.80:0/1715377297 shutdown_connections 2024-05-10T04:22:41.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.768+0000 7f70a5600700 1 -- 172.21.15.80:0/1715377297 wait complete. 2024-05-10T04:22:41.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.770+0000 7f70a5600700 1 Processor -- start 2024-05-10T04:22:41.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.770+0000 7f70a5600700 1 -- start start 2024-05-10T04:22:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.772+0000 7f70a5600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70a00b2f50 0x7f70a014c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.772+0000 7f70a5600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a00d0d40 0x7f70a014cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.772+0000 7f70a5600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a00d3030 0x7f70a014ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.772+0000 7f70a5600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a014e0a0 con 0x7f70a00d3030 2024-05-10T04:22:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.772+0000 7f70a5600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a014f800 con 0x7f70a00d0d40 2024-05-10T04:22:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.772+0000 7f70a5600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a014bcb0 con 0x7f70a00b2f50 2024-05-10T04:22:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.772+0000 7f709f400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a00d3030 0x7f70a014ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.772+0000 7f709f400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a00d3030 0x7f70a014ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33904/0 (socket says 172.21.15.80:33904) 2024-05-10T04:22:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.772+0000 7f709f400700 1 -- 172.21.15.80:0/1352221029 learned_addr learned my addr 172.21.15.80:0/1352221029 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.772+0000 7f709ea00700 1 --2- 172.21.15.80:0/1352221029 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70a00b2f50 0x7f70a014c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.772+0000 7f7097e00700 1 --2- 172.21.15.80:0/1352221029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a00d0d40 0x7f70a014cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.772+0000 7f709f400700 1 -- 172.21.15.80:0/1352221029 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70a00b2f50 msgr2=0x7f70a014c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.772+0000 7f709f400700 1 --2- 172.21.15.80:0/1352221029 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70a00b2f50 0x7f70a014c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.772+0000 7f709f400700 1 -- 172.21.15.80:0/1352221029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a00d0d40 msgr2=0x7f70a014cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.772+0000 7f709f400700 1 --2- 172.21.15.80:0/1352221029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a00d0d40 0x7f70a014cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.773+0000 7f709f400700 1 -- 172.21.15.80:0/1352221029 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70900094a0 con 0x7f70a00d3030 2024-05-10T04:22:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.773+0000 7f709f400700 1 --2- 172.21.15.80:0/1352221029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a00d3030 0x7f70a014ad90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f70a00ce920 tx=0x7f7098004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.773+0000 7f7096a00700 1 -- 172.21.15.80:0/1352221029 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7098004800 con 0x7f70a00d3030 2024-05-10T04:22:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.773+0000 7f7096a00700 1 -- 172.21.15.80:0/1352221029 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7098004960 con 0x7f70a00d3030 2024-05-10T04:22:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.773+0000 7f70a5600700 1 -- 172.21.15.80:0/1352221029 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7098009b30 con 0x7f70a00d3030 2024-05-10T04:22:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.773+0000 7f7096a00700 1 -- 172.21.15.80:0/1352221029 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709801b670 con 0x7f70a00d3030 2024-05-10T04:22:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.773+0000 7f70a5600700 1 -- 172.21.15.80:0/1352221029 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a014c7a0 con 0x7f70a00d3030 2024-05-10T04:22:41.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.774+0000 7f70a5600700 1 -- 172.21.15.80:0/1352221029 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a014e1e0 con 0x7f70a00d3030 2024-05-10T04:22:41.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.775+0000 7f7096a00700 1 -- 172.21.15.80:0/1352221029 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f709801b7d0 con 0x7f70a00d3030 2024-05-10T04:22:41.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.776+0000 7f7096a00700 1 --2- 172.21.15.80:0/1352221029 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f707c06ac90 0x7f707c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:41.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.776+0000 7f7096a00700 1 -- 172.21.15.80:0/1352221029 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f709808abd0 con 0x7f70a00d3030 2024-05-10T04:22:41.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.777+0000 7f709ea00700 1 --2- 172.21.15.80:0/1352221029 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f707c06ac90 0x7f707c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:41.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.777+0000 7f709ea00700 1 --2- 172.21.15.80:0/1352221029 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f707c06ac90 0x7f707c06d1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f70a008d080 tx=0x7f7090009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:41.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.781+0000 7f7096a00700 1 -- 172.21.15.80:0/1352221029 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f70a014e1e0 con 0x7f70a00d3030 2024-05-10T04:22:41.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.991+0000 7f70a5600700 1 -- 172.21.15.80:0/1352221029 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70a014e1e0 con 0x7f70a00d3030 2024-05-10T04:22:41.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.992+0000 7f7096a00700 1 -- 172.21.15.80:0/1352221029 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f70a014e1e0 con 0x7f70a00d3030 2024-05-10T04:22:41.993 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:41.994 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:38.485422+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:22:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.994+0000 7f70a5600700 1 -- 172.21.15.80:0/1352221029 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f707c06ac90 msgr2=0x7f707c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.994+0000 7f70a5600700 1 --2- 172.21.15.80:0/1352221029 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f707c06ac90 0x7f707c06d1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f70a008d080 tx=0x7f7090009210 comp rx=0 tx=0).stop 2024-05-10T04:22:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.994+0000 7f70a5600700 1 -- 172.21.15.80:0/1352221029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a00d3030 msgr2=0x7f70a014ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.994+0000 7f70a5600700 1 --2- 172.21.15.80:0/1352221029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a00d3030 0x7f70a014ad90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f70a00ce920 tx=0x7f7098004ad0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.994+0000 7f70a5600700 1 -- 172.21.15.80:0/1352221029 shutdown_connections 2024-05-10T04:22:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.994+0000 7f70a5600700 1 --2- 172.21.15.80:0/1352221029 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f707c06ac90 0x7f707c06d1a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.994+0000 7f70a5600700 1 --2- 172.21.15.80:0/1352221029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a00d3030 0x7f70a014ad90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.994+0000 7f70a5600700 1 --2- 172.21.15.80:0/1352221029 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70a00b2f50 0x7f70a014c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.994+0000 7f70a5600700 1 --2- 172.21.15.80:0/1352221029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a00d0d40 0x7f70a014cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:41.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.994+0000 7f70a5600700 1 -- 172.21.15.80:0/1352221029 >> 172.21.15.80:0/1352221029 conn(0x7f70a006c3f0 msgr2=0x7f70a00b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:41.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.994+0000 7f70a5600700 1 -- 172.21.15.80:0/1352221029 shutdown_connections 2024-05-10T04:22:41.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:41.994+0000 7f70a5600700 1 -- 172.21.15.80:0/1352221029 wait complete. 2024-05-10T04:22:42.021 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-10T04:22:42.022 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:22:42.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.279+0000 7f5931800700 1 Processor -- start 2024-05-10T04:22:42.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.279+0000 7f5931800700 1 -- start start 2024-05-10T04:22:42.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.281+0000 7f5931800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f592c0b2f50 0x7f592c161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.281+0000 7f5931800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c0d28c0 con 0x7f592c0d0d40 2024-05-10T04:22:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.282+0000 7f5931800700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c0d2ba0 con 0x7f592c0d3030 2024-05-10T04:22:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.282+0000 7f5931800700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c0b3360 con 0x7f592c0b2f50 2024-05-10T04:22:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.282+0000 7f592aa00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f592c0b2f50 0x7f592c161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.282+0000 7f592b400700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f592c0d0d40 0x7f592c0b7320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39598/0 (socket says 172.21.15.80:39598) 2024-05-10T04:22:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.282+0000 7f592b400700 1 -- 172.21.15.80:0/3222212252 learned_addr learned my addr 172.21.15.80:0/3222212252 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.282+0000 7f592aa00700 1 -- 172.21.15.80:0/3222212252 >> v1:172.21.15.106:6789/0 conn(0x7f592c0d3030 legacy=0x7f592c0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.282+0000 7f592aa00700 1 -- 172.21.15.80:0/3222212252 >> v1:172.21.15.80:6789/0 conn(0x7f592c0d0d40 legacy=0x7f592c0b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.282+0000 7f592aa00700 1 -- 172.21.15.80:0/3222212252 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c0cf970 con 0x7f592c0b2f50 2024-05-10T04:22:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.282+0000 7f5929600700 1 -- 172.21.15.80:0/3222212252 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844433123 0 0) 0x7f592c0d28c0 con 0x7f592c0d0d40 2024-05-10T04:22:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.282+0000 7f592aa00700 1 --2- 172.21.15.80:0/3222212252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592c0b2f50 0x7f592c161fa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f591c009840 tx=0x7f591c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95f0735f62c2711 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.283+0000 7f5929600700 1 -- 172.21.15.80:0/3222212252 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c011830 con 0x7f592c0b2f50 2024-05-10T04:22:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.283+0000 7f5929600700 1 -- 172.21.15.80:0/3222212252 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c011990 con 0x7f592c0b2f50 2024-05-10T04:22:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.283+0000 7f5929600700 1 -- 172.21.15.80:0/3222212252 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c011d20 con 0x7f592c0b2f50 2024-05-10T04:22:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.283+0000 7f5931800700 1 -- 172.21.15.80:0/3222212252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592c0b2f50 msgr2=0x7f592c161fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.283+0000 7f5931800700 1 --2- 172.21.15.80:0/3222212252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592c0b2f50 0x7f592c161fa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f591c009840 tx=0x7f591c009b50 comp rx=0 tx=0).stop 2024-05-10T04:22:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.283+0000 7f5931800700 1 -- 172.21.15.80:0/3222212252 shutdown_connections 2024-05-10T04:22:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.283+0000 7f5931800700 1 --2- 172.21.15.80:0/3222212252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592c0b2f50 0x7f592c161fa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.283+0000 7f5931800700 1 -- 172.21.15.80:0/3222212252 >> 172.21.15.80:0/3222212252 conn(0x7f592c06c3f0 msgr2=0x7f592c06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.284+0000 7f5931800700 1 -- 172.21.15.80:0/3222212252 shutdown_connections 2024-05-10T04:22:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.284+0000 7f5931800700 1 -- 172.21.15.80:0/3222212252 wait complete. 2024-05-10T04:22:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.286+0000 7f5931800700 1 Processor -- start 2024-05-10T04:22:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.286+0000 7f5931800700 1 -- start start 2024-05-10T04:22:42.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.287+0000 7f5931800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f592c0b2f50 0x7f592c14f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:42.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.287+0000 7f5931800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f592c0d0d40 0x7f592c0c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:42.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.287+0000 7f5931800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592c0d3030 0x7f592c0c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:42.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.287+0000 7f5931800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0c81b0 con 0x7f592c0d3030 2024-05-10T04:22:42.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.287+0000 7f5931800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c1e7dc0 con 0x7f592c0d0d40 2024-05-10T04:22:42.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.287+0000 7f5931800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592c1e80a0 con 0x7f592c0b2f50 2024-05-10T04:22:42.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.287+0000 7f592b400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592c0d3030 0x7f592c0c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:42.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.288+0000 7f592b400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592c0d3030 0x7f592c0c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33918/0 (socket says 172.21.15.80:33918) 2024-05-10T04:22:42.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.288+0000 7f592b400700 1 -- 172.21.15.80:0/2854883317 learned_addr learned my addr 172.21.15.80:0/2854883317 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:42.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.288+0000 7f592aa00700 1 --2- 172.21.15.80:0/2854883317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f592c0b2f50 0x7f592c14f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:42.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.288+0000 7f592a000700 1 --2- 172.21.15.80:0/2854883317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f592c0d0d40 0x7f592c0c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:42.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.288+0000 7f592b400700 1 -- 172.21.15.80:0/2854883317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f592c0b2f50 msgr2=0x7f592c14f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:42.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.288+0000 7f592b400700 1 --2- 172.21.15.80:0/2854883317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f592c0b2f50 0x7f592c14f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:42.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.288+0000 7f592b400700 1 -- 172.21.15.80:0/2854883317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f592c0d0d40 msgr2=0x7f592c0c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:42.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.288+0000 7f592b400700 1 --2- 172.21.15.80:0/2854883317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f592c0d0d40 0x7f592c0c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:42.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.288+0000 7f592b400700 1 -- 172.21.15.80:0/2854883317 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c0094a0 con 0x7f592c0d3030 2024-05-10T04:22:42.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.288+0000 7f592b400700 1 --2- 172.21.15.80:0/2854883317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592c0d3030 0x7f592c0c92d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f592400cbd0 tx=0x7f592400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:42.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.288+0000 7f5922a00700 1 -- 172.21.15.80:0/2854883317 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592400ab10 con 0x7f592c0d3030 2024-05-10T04:22:42.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.288+0000 7f5922a00700 1 -- 172.21.15.80:0/2854883317 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592400ac90 con 0x7f592c0d3030 2024-05-10T04:22:42.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.288+0000 7f5931800700 1 -- 172.21.15.80:0/2854883317 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c0cb1f0 con 0x7f592c0d3030 2024-05-10T04:22:42.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.289+0000 7f5922a00700 1 -- 172.21.15.80:0/2854883317 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59240070d0 con 0x7f592c0d3030 2024-05-10T04:22:42.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.289+0000 7f5931800700 1 -- 172.21.15.80:0/2854883317 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c0c8400 con 0x7f592c0d3030 2024-05-10T04:22:42.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.290+0000 7f5931800700 1 -- 172.21.15.80:0/2854883317 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592c1e96b0 con 0x7f592c0d3030 2024-05-10T04:22:42.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.291+0000 7f5922a00700 1 -- 172.21.15.80:0/2854883317 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5924007230 con 0x7f592c0d3030 2024-05-10T04:22:42.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.291+0000 7f5922a00700 1 --2- 172.21.15.80:0/2854883317 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f590c06acc0 0x7f590c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:42.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.292+0000 7f5922a00700 1 -- 172.21.15.80:0/2854883317 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5924089130 con 0x7f592c0d3030 2024-05-10T04:22:42.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.292+0000 7f592aa00700 1 --2- 172.21.15.80:0/2854883317 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f590c06acc0 0x7f590c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:42.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.293+0000 7f592aa00700 1 --2- 172.21.15.80:0/2854883317 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f590c06acc0 0x7f590c06d1d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f591c009840 tx=0x7f591c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:42.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.296+0000 7f5922a00700 1 -- 172.21.15.80:0/2854883317 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f592c1e96b0 con 0x7f592c0d3030 2024-05-10T04:22:42.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.495+0000 7f5931800700 1 -- 172.21.15.80:0/2854883317 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f592c162c90 con 0x7f590c06acc0 2024-05-10T04:22:42.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.504+0000 7f5922a00700 1 -- 172.21.15.80:0/2854883317 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249835 (secure 0 0 0) 0x7f591c011c80 con 0x7f590c06acc0 2024-05-10T04:22:42.509 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:42.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.509+0000 7f5931800700 1 -- 172.21.15.80:0/2854883317 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f590c06acc0 msgr2=0x7f590c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:42.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.509+0000 7f5931800700 1 --2- 172.21.15.80:0/2854883317 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f590c06acc0 0x7f590c06d1d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f591c009840 tx=0x7f591c01c040 comp rx=0 tx=0).stop 2024-05-10T04:22:42.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.509+0000 7f5931800700 1 -- 172.21.15.80:0/2854883317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592c0d3030 msgr2=0x7f592c0c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:42.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.509+0000 7f5931800700 1 --2- 172.21.15.80:0/2854883317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592c0d3030 0x7f592c0c92d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f592400cbd0 tx=0x7f592400cf90 comp rx=0 tx=0).stop 2024-05-10T04:22:42.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.509+0000 7f5931800700 1 -- 172.21.15.80:0/2854883317 shutdown_connections 2024-05-10T04:22:42.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.509+0000 7f5931800700 1 --2- 172.21.15.80:0/2854883317 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f590c06acc0 0x7f590c06d1d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:42.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.509+0000 7f5931800700 1 --2- 172.21.15.80:0/2854883317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592c0d3030 0x7f592c0c92d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:42.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.509+0000 7f5931800700 1 --2- 172.21.15.80:0/2854883317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f592c0b2f50 0x7f592c14f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:42.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.509+0000 7f5931800700 1 --2- 172.21.15.80:0/2854883317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f592c0d0d40 0x7f592c0c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:42.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.509+0000 7f5931800700 1 -- 172.21.15.80:0/2854883317 >> 172.21.15.80:0/2854883317 conn(0x7f592c06c3f0 msgr2=0x7f592c15cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:42.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.509+0000 7f5931800700 1 -- 172.21.15.80:0/2854883317 shutdown_connections 2024-05-10T04:22:42.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.509+0000 7f5931800700 1 -- 172.21.15.80:0/2854883317 wait complete. 2024-05-10T04:22:42.512 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-10T04:22:42.538 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-10T04:22:40.734753+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219308,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755412,"statfs":{"total":773094113280,"available":772869541888,"internally_reserved":0,"allocated":2433024,"data_stored":1546584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.835648"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-10T04:22:29.884747+0000","last_change":"2024-05-10T04:22:27.829537+0000","last_active":"2024-05-10T04:22:29.884747+0000","last_peered":"2024-05-10T04:22:29.884747+0000","last_clean":"2024-05-10T04:22:29.884747+0000","last_became_active":"2024-05-10T04:22:27.828179+0000","last_became_peered":"2024-05-10T04:22:27.828179+0000","last_unstale":"2024-05-10T04:22:29.884747+0000","last_undegraded":"2024-05-10T04:22:29.884747+0000","last_fullsized":"2024-05-10T04:22:29.884747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_clean_scrub_stamp":"2024-05-10T04:22:26.813824+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:23.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:35.888653+0000","last_change":"2024-05-10T04:22:35.888653+0000","last_active":"2024-05-10T04:22:35.888653+0000","last_peered":"2024-05-10T04:22:35.888653+0000","last_clean":"2024-05-10T04:22:35.888653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:35.888653+0000","last_undegraded":"2024-05-10T04:22:35.888653+0000","last_fullsized":"2024-05-10T04:22:35.888653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T04:22:36.898270+0000","last_change":"2024-05-10T04:22:36.898270+0000","last_active":"2024-05-10T04:22:36.898270+0000","last_peered":"2024-05-10T04:22:36.898270+0000","last_clean":"2024-05-10T04:22:36.898270+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T04:22:36.898270+0000","last_undegraded":"2024-05-10T04:22:36.898270+0000","last_fullsized":"2024-05-10T04:22:36.898270+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28376,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343464,"statfs":{"total":96636764160,"available":96607707136,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:22:42.542 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:22:42.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.835+0000 7fd70f400700 1 Processor -- start 2024-05-10T04:22:42.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.836+0000 7fd70f400700 1 -- start start 2024-05-10T04:22:42.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.837+0000 7fd70f400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd7080b2f50 0x7fd708161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:42.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.837+0000 7fd70f400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7080d3030 0x7fd7080d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:42.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.837+0000 7fd70f400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd7080d0630 0x7fd7080d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:42.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.837+0000 7fd70f400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7080b3360 con 0x7fd7080d0630 2024-05-10T04:22:42.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.837+0000 7fd70f400700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7081624e0 con 0x7fd7080b2f50 2024-05-10T04:22:42.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.837+0000 7fd70f400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7080d28c0 con 0x7fd7080d3030 2024-05-10T04:22:42.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.838+0000 7fd70d400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd7080d0630 0x7fd7080d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:42.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.838+0000 7fd70d400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd7080d0630 0x7fd7080d0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52720/0 (socket says 172.21.15.80:52720) 2024-05-10T04:22:42.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.838+0000 7fd70d400700 1 -- 172.21.15.80:0/1479918671 learned_addr learned my addr 172.21.15.80:0/1479918671 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:42.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.838+0000 7fd707e00700 1 --2- 172.21.15.80:0/1479918671 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7080d3030 0x7fd7080d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:42.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.838+0000 7fd70ca00700 1 --2- 172.21.15.80:0/1479918671 >> v2:172.21.15.106:3300/0 conn(0x7fd7080b2f50 0x7fd708161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:42.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.838+0000 7fd70d400700 1 -- 172.21.15.80:0/1479918671 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7080d3030 msgr2=0x7fd7080d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:42.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.838+0000 7fd70d400700 1 --2- 172.21.15.80:0/1479918671 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7080d3030 0x7fd7080d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:42.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.838+0000 7fd70d400700 1 -- 172.21.15.80:0/1479918671 >> v2:172.21.15.106:3300/0 conn(0x7fd7080b2f50 msgr2=0x7fd708161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:42.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.838+0000 7fd70d400700 1 --2- 172.21.15.80:0/1479918671 >> v2:172.21.15.106:3300/0 conn(0x7fd7080b2f50 0x7fd708161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:42.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.838+0000 7fd70d400700 1 -- 172.21.15.80:0/1479918671 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7080d2ba0 con 0x7fd7080d0630 2024-05-10T04:22:42.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.838+0000 7fd707e00700 1 --2- 172.21.15.80:0/1479918671 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7080d3030 0x7fd7080d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:42.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.838+0000 7fd70d400700 1 --2- 172.21.15.80:0/1479918671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7080d0630 0x7fd7080d0a40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd70806d410 tx=0x7fd70000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce7bd3d30d3ee0d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:42.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.839+0000 7fd707400700 1 -- 172.21.15.80:0/1479918671 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70000e070 con 0x7fd7080d0630 2024-05-10T04:22:42.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.839+0000 7fd707400700 1 -- 172.21.15.80:0/1479918671 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70000b910 con 0x7fd7080d0630 2024-05-10T04:22:42.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.839+0000 7fd707400700 1 -- 172.21.15.80:0/1479918671 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70000bcc0 con 0x7fd7080d0630 2024-05-10T04:22:42.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.839+0000 7fd70f400700 1 -- 172.21.15.80:0/1479918671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7080d0630 msgr2=0x7fd7080d0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:42.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.839+0000 7fd70f400700 1 --2- 172.21.15.80:0/1479918671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7080d0630 0x7fd7080d0a40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd70806d410 tx=0x7fd70000b330 comp rx=0 tx=0).stop 2024-05-10T04:22:42.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.839+0000 7fd70f400700 1 -- 172.21.15.80:0/1479918671 shutdown_connections 2024-05-10T04:22:42.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.839+0000 7fd70f400700 1 --2- 172.21.15.80:0/1479918671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7080d0630 0x7fd7080d0a40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:42.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.839+0000 7fd70f400700 1 --2- 172.21.15.80:0/1479918671 >> v2:172.21.15.106:3300/0 conn(0x7fd7080b2f50 0x7fd708161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:42.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.839+0000 7fd70f400700 1 --2- 172.21.15.80:0/1479918671 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7080d3030 0x7fd7080d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:42.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.839+0000 7fd70f400700 1 -- 172.21.15.80:0/1479918671 >> 172.21.15.80:0/1479918671 conn(0x7fd70806c3f0 msgr2=0x7fd70806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:42.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.840+0000 7fd70f400700 1 -- 172.21.15.80:0/1479918671 shutdown_connections 2024-05-10T04:22:42.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.840+0000 7fd70f400700 1 -- 172.21.15.80:0/1479918671 wait complete. 2024-05-10T04:22:42.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.842+0000 7fd70f400700 1 Processor -- start 2024-05-10T04:22:42.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.842+0000 7fd70f400700 1 -- start start 2024-05-10T04:22:42.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.843+0000 7fd70f400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7080b2f50 0x7fd7080cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:42.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.843+0000 7fd70f400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7080d0630 0x7fd70815e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:42.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.843+0000 7fd70f400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7080d3030 0x7fd7081e9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:42.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.844+0000 7fd70f400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70815fc50 con 0x7fd7080b2f50 2024-05-10T04:22:42.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.844+0000 7fd70f400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7080cc7f0 con 0x7fd7080d0630 2024-05-10T04:22:42.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.844+0000 7fd70f400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7080cc530 con 0x7fd7080d3030 2024-05-10T04:22:42.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.844+0000 7fd70ca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7080b2f50 0x7fd7080cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:42.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.844+0000 7fd70ca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7080b2f50 0x7fd7080cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52728/0 (socket says 172.21.15.80:52728) 2024-05-10T04:22:42.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.844+0000 7fd70ca00700 1 -- 172.21.15.80:0/3676899466 learned_addr learned my addr 172.21.15.80:0/3676899466 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:42.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.844+0000 7fd707e00700 1 --2- 172.21.15.80:0/3676899466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7080d0630 0x7fd70815e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:42.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.844+0000 7fd70d400700 1 --2- 172.21.15.80:0/3676899466 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7080d3030 0x7fd7081e9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:42.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.844+0000 7fd70ca00700 1 -- 172.21.15.80:0/3676899466 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7080d3030 msgr2=0x7fd7081e9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:42.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.844+0000 7fd70ca00700 1 --2- 172.21.15.80:0/3676899466 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7080d3030 0x7fd7081e9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:42.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.844+0000 7fd70ca00700 1 -- 172.21.15.80:0/3676899466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7080d0630 msgr2=0x7fd70815e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:42.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.844+0000 7fd70ca00700 1 --2- 172.21.15.80:0/3676899466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7080d0630 0x7fd70815e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:42.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.844+0000 7fd70ca00700 1 -- 172.21.15.80:0/3676899466 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd700009b30 con 0x7fd7080b2f50 2024-05-10T04:22:42.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.844+0000 7fd70ca00700 1 --2- 172.21.15.80:0/3676899466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7080b2f50 0x7fd7080cbff0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00e870 tx=0x7fd6fc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:42.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.845+0000 7fd704c00700 1 -- 172.21.15.80:0/3676899466 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc00c640 con 0x7fd7080b2f50 2024-05-10T04:22:42.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.845+0000 7fd704c00700 1 -- 172.21.15.80:0/3676899466 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc00c7a0 con 0x7fd7080b2f50 2024-05-10T04:22:42.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.845+0000 7fd70f400700 1 -- 172.21.15.80:0/3676899466 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7080cca40 con 0x7fd7080b2f50 2024-05-10T04:22:42.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.845+0000 7fd704c00700 1 -- 172.21.15.80:0/3676899466 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc00cb30 con 0x7fd7080b2f50 2024-05-10T04:22:42.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.845+0000 7fd70f400700 1 -- 172.21.15.80:0/3676899466 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7080cd000 con 0x7fd7080b2f50 2024-05-10T04:22:42.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.846+0000 7fd70f400700 1 -- 172.21.15.80:0/3676899466 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd708074af0 con 0x7fd7080b2f50 2024-05-10T04:22:42.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.847+0000 7fd704c00700 1 -- 172.21.15.80:0/3676899466 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd6fc00cc90 con 0x7fd7080b2f50 2024-05-10T04:22:42.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.848+0000 7fd704c00700 1 --2- 172.21.15.80:0/3676899466 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd6e806acc0 0x7fd6e806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:42.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.848+0000 7fd704c00700 1 -- 172.21.15.80:0/3676899466 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6fc089310 con 0x7fd7080b2f50 2024-05-10T04:22:42.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.849+0000 7fd707e00700 1 --2- 172.21.15.80:0/3676899466 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd6e806acc0 0x7fd6e806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:42.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.849+0000 7fd707e00700 1 --2- 172.21.15.80:0/3676899466 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd6e806acc0 0x7fd6e806d1d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd708161620 tx=0x7fd6f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:42.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:42.853+0000 7fd704c00700 1 -- 172.21.15.80:0/3676899466 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd6fc0543c0 con 0x7fd7080b2f50 2024-05-10T04:22:43.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.058+0000 7fd70f400700 1 -- 172.21.15.80:0/3676899466 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd7081629b0 con 0x7fd6e806acc0 2024-05-10T04:22:43.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.067+0000 7fd704c00700 1 -- 172.21.15.80:0/3676899466 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264714 (secure 0 0 0) 0x7fd6f400cda0 con 0x7fd6e806acc0 2024-05-10T04:22:43.072 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:43.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.071+0000 7fd70f400700 1 -- 172.21.15.80:0/3676899466 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd6e806acc0 msgr2=0x7fd6e806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:43.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.071+0000 7fd70f400700 1 --2- 172.21.15.80:0/3676899466 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd6e806acc0 0x7fd6e806d1d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd708161620 tx=0x7fd6f4008040 comp rx=0 tx=0).stop 2024-05-10T04:22:43.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.071+0000 7fd70f400700 1 -- 172.21.15.80:0/3676899466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7080b2f50 msgr2=0x7fd7080cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:43.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.071+0000 7fd70f400700 1 --2- 172.21.15.80:0/3676899466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7080b2f50 0x7fd7080cbff0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00e870 tx=0x7fd6fc00ec30 comp rx=0 tx=0).stop 2024-05-10T04:22:43.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.071+0000 7fd70f400700 1 -- 172.21.15.80:0/3676899466 shutdown_connections 2024-05-10T04:22:43.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.071+0000 7fd70f400700 1 --2- 172.21.15.80:0/3676899466 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd6e806acc0 0x7fd6e806d1d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.071+0000 7fd70f400700 1 --2- 172.21.15.80:0/3676899466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7080b2f50 0x7fd7080cbff0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.071+0000 7fd70f400700 1 --2- 172.21.15.80:0/3676899466 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7080d3030 0x7fd7081e9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.071+0000 7fd70f400700 1 --2- 172.21.15.80:0/3676899466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7080d0630 0x7fd70815e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.071+0000 7fd70f400700 1 -- 172.21.15.80:0/3676899466 >> 172.21.15.80:0/3676899466 conn(0x7fd70806c3f0 msgr2=0x7fd7080c98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:43.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.071+0000 7fd70f400700 1 -- 172.21.15.80:0/3676899466 shutdown_connections 2024-05-10T04:22:43.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.071+0000 7fd70f400700 1 -- 172.21.15.80:0/3676899466 wait complete. 2024-05-10T04:22:43.075 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-10T04:22:43.100 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-10T04:22:42.735283+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001501"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.071084+0000","last_change":"2024-05-10T04:22:37.529212+0000","last_active":"2024-05-10T04:22:39.071084+0000","last_peered":"2024-05-10T04:22:39.071084+0000","last_clean":"2024-05-10T04:22:39.071084+0000","last_became_active":"2024-05-10T04:22:37.528975+0000","last_became_peered":"2024-05-10T04:22:37.528975+0000","last_unstale":"2024-05-10T04:22:39.071084+0000","last_undegraded":"2024-05-10T04:22:39.071084+0000","last_fullsized":"2024-05-10T04:22:39.071084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:43:31.418620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496348+0000","last_change":"2024-05-10T04:22:37.513971+0000","last_active":"2024-05-10T04:22:38.496348+0000","last_peered":"2024-05-10T04:22:38.496348+0000","last_clean":"2024-05-10T04:22:38.496348+0000","last_became_active":"2024-05-10T04:22:37.513528+0000","last_became_peered":"2024-05-10T04:22:37.513528+0000","last_unstale":"2024-05-10T04:22:38.496348+0000","last_undegraded":"2024-05-10T04:22:38.496348+0000","last_fullsized":"2024-05-10T04:22:38.496348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:27:09.485253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565409+0000","last_change":"2024-05-10T04:22:37.505391+0000","last_active":"2024-05-10T04:22:38.565409+0000","last_peered":"2024-05-10T04:22:38.565409+0000","last_clean":"2024-05-10T04:22:38.565409+0000","last_became_active":"2024-05-10T04:22:37.505063+0000","last_became_peered":"2024-05-10T04:22:37.505063+0000","last_unstale":"2024-05-10T04:22:38.565409+0000","last_undegraded":"2024-05-10T04:22:38.565409+0000","last_fullsized":"2024-05-10T04:22:38.565409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:27:50.672963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496838+0000","last_change":"2024-05-10T04:22:37.520462+0000","last_active":"2024-05-10T04:22:38.496838+0000","last_peered":"2024-05-10T04:22:38.496838+0000","last_clean":"2024-05-10T04:22:38.496838+0000","last_became_active":"2024-05-10T04:22:37.519497+0000","last_became_peered":"2024-05-10T04:22:37.519497+0000","last_unstale":"2024-05-10T04:22:38.496838+0000","last_undegraded":"2024-05-10T04:22:38.496838+0000","last_fullsized":"2024-05-10T04:22:38.496838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:21.117834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070309+0000","last_change":"2024-05-10T04:22:37.526517+0000","last_active":"2024-05-10T04:22:39.070309+0000","last_peered":"2024-05-10T04:22:39.070309+0000","last_clean":"2024-05-10T04:22:39.070309+0000","last_became_active":"2024-05-10T04:22:37.526181+0000","last_became_peered":"2024-05-10T04:22:37.526181+0000","last_unstale":"2024-05-10T04:22:39.070309+0000","last_undegraded":"2024-05-10T04:22:39.070309+0000","last_fullsized":"2024-05-10T04:22:39.070309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:21:00.214222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496509+0000","last_change":"2024-05-10T04:22:37.513739+0000","last_active":"2024-05-10T04:22:38.496509+0000","last_peered":"2024-05-10T04:22:38.496509+0000","last_clean":"2024-05-10T04:22:38.496509+0000","last_became_active":"2024-05-10T04:22:37.513348+0000","last_became_peered":"2024-05-10T04:22:37.513348+0000","last_unstale":"2024-05-10T04:22:38.496509+0000","last_undegraded":"2024-05-10T04:22:38.496509+0000","last_fullsized":"2024-05-10T04:22:38.496509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:50.806224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070073+0000","last_change":"2024-05-10T04:22:37.523784+0000","last_active":"2024-05-10T04:22:39.070073+0000","last_peered":"2024-05-10T04:22:39.070073+0000","last_clean":"2024-05-10T04:22:39.070073+0000","last_became_active":"2024-05-10T04:22:37.523472+0000","last_became_peered":"2024-05-10T04:22:37.523472+0000","last_unstale":"2024-05-10T04:22:39.070073+0000","last_undegraded":"2024-05-10T04:22:39.070073+0000","last_fullsized":"2024-05-10T04:22:39.070073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:19:35.892439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068081+0000","last_change":"2024-05-10T04:22:37.530486+0000","last_active":"2024-05-10T04:22:39.068081+0000","last_peered":"2024-05-10T04:22:39.068081+0000","last_clean":"2024-05-10T04:22:39.068081+0000","last_became_active":"2024-05-10T04:22:37.530129+0000","last_became_peered":"2024-05-10T04:22:37.530129+0000","last_unstale":"2024-05-10T04:22:39.068081+0000","last_undegraded":"2024-05-10T04:22:39.068081+0000","last_fullsized":"2024-05-10T04:22:39.068081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:21:00.214222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.071177+0000","last_change":"2024-05-10T04:22:37.528608+0000","last_active":"2024-05-10T04:22:39.071177+0000","last_peered":"2024-05-10T04:22:39.071177+0000","last_clean":"2024-05-10T04:22:39.071177+0000","last_became_active":"2024-05-10T04:22:37.528314+0000","last_became_peered":"2024-05-10T04:22:37.528314+0000","last_unstale":"2024-05-10T04:22:39.071177+0000","last_undegraded":"2024-05-10T04:22:39.071177+0000","last_fullsized":"2024-05-10T04:22:39.071177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:29:02.206457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069683+0000","last_change":"2024-05-10T04:22:37.516245+0000","last_active":"2024-05-10T04:22:39.069683+0000","last_peered":"2024-05-10T04:22:39.069683+0000","last_clean":"2024-05-10T04:22:39.069683+0000","last_became_active":"2024-05-10T04:22:37.515936+0000","last_became_peered":"2024-05-10T04:22:37.515936+0000","last_unstale":"2024-05-10T04:22:39.069683+0000","last_undegraded":"2024-05-10T04:22:39.069683+0000","last_fullsized":"2024-05-10T04:22:39.069683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:21.117834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.071024+0000","last_change":"2024-05-10T04:22:37.527304+0000","last_active":"2024-05-10T04:22:39.071024+0000","last_peered":"2024-05-10T04:22:39.071024+0000","last_clean":"2024-05-10T04:22:39.071024+0000","last_became_active":"2024-05-10T04:22:37.526971+0000","last_became_peered":"2024-05-10T04:22:37.526971+0000","last_unstale":"2024-05-10T04:22:39.071024+0000","last_undegraded":"2024-05-10T04:22:39.071024+0000","last_fullsized":"2024-05-10T04:22:39.071024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:50:46.925328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070689+0000","last_change":"2024-05-10T04:22:37.502589+0000","last_active":"2024-05-10T04:22:39.070689+0000","last_peered":"2024-05-10T04:22:39.070689+0000","last_clean":"2024-05-10T04:22:39.070689+0000","last_became_active":"2024-05-10T04:22:37.502178+0000","last_became_peered":"2024-05-10T04:22:37.502178+0000","last_unstale":"2024-05-10T04:22:39.070689+0000","last_undegraded":"2024-05-10T04:22:39.070689+0000","last_fullsized":"2024-05-10T04:22:39.070689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:36:22.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068213+0000","last_change":"2024-05-10T04:22:37.510847+0000","last_active":"2024-05-10T04:22:39.068213+0000","last_peered":"2024-05-10T04:22:39.068213+0000","last_clean":"2024-05-10T04:22:39.068213+0000","last_became_active":"2024-05-10T04:22:37.510633+0000","last_became_peered":"2024-05-10T04:22:37.510633+0000","last_unstale":"2024-05-10T04:22:39.068213+0000","last_undegraded":"2024-05-10T04:22:39.068213+0000","last_fullsized":"2024-05-10T04:22:39.068213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:58.202277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565340+0000","last_change":"2024-05-10T04:22:37.510710+0000","last_active":"2024-05-10T04:22:38.565340+0000","last_peered":"2024-05-10T04:22:38.565340+0000","last_clean":"2024-05-10T04:22:38.565340+0000","last_became_active":"2024-05-10T04:22:37.509156+0000","last_became_peered":"2024-05-10T04:22:37.509156+0000","last_unstale":"2024-05-10T04:22:38.565340+0000","last_undegraded":"2024-05-10T04:22:38.565340+0000","last_fullsized":"2024-05-10T04:22:38.565340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:51:34.367433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.495937+0000","last_change":"2024-05-10T04:22:37.510383+0000","last_active":"2024-05-10T04:22:38.495937+0000","last_peered":"2024-05-10T04:22:38.495937+0000","last_clean":"2024-05-10T04:22:38.495937+0000","last_became_active":"2024-05-10T04:22:37.507435+0000","last_became_peered":"2024-05-10T04:22:37.507435+0000","last_unstale":"2024-05-10T04:22:38.495937+0000","last_undegraded":"2024-05-10T04:22:38.495937+0000","last_fullsized":"2024-05-10T04:22:38.495937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:32:34.172364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496433+0000","last_change":"2024-05-10T04:22:37.513653+0000","last_active":"2024-05-10T04:22:38.496433+0000","last_peered":"2024-05-10T04:22:38.496433+0000","last_clean":"2024-05-10T04:22:38.496433+0000","last_became_active":"2024-05-10T04:22:37.513360+0000","last_became_peered":"2024-05-10T04:22:37.513360+0000","last_unstale":"2024-05-10T04:22:38.496433+0000","last_undegraded":"2024-05-10T04:22:38.496433+0000","last_fullsized":"2024-05-10T04:22:38.496433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:32:34.172364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497048+0000","last_change":"2024-05-10T04:22:37.512778+0000","last_active":"2024-05-10T04:22:38.497048+0000","last_peered":"2024-05-10T04:22:38.497048+0000","last_clean":"2024-05-10T04:22:38.497048+0000","last_became_active":"2024-05-10T04:22:37.512065+0000","last_became_peered":"2024-05-10T04:22:37.512065+0000","last_unstale":"2024-05-10T04:22:38.497048+0000","last_undegraded":"2024-05-10T04:22:38.497048+0000","last_fullsized":"2024-05-10T04:22:38.497048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:02:11.073471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497418+0000","last_change":"2024-05-10T04:22:37.512740+0000","last_active":"2024-05-10T04:22:38.497418+0000","last_peered":"2024-05-10T04:22:38.497418+0000","last_clean":"2024-05-10T04:22:38.497418+0000","last_became_active":"2024-05-10T04:22:37.511158+0000","last_became_peered":"2024-05-10T04:22:37.511158+0000","last_unstale":"2024-05-10T04:22:38.497418+0000","last_undegraded":"2024-05-10T04:22:38.497418+0000","last_fullsized":"2024-05-10T04:22:38.497418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:03.281665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070431+0000","last_change":"2024-05-10T04:22:37.527306+0000","last_active":"2024-05-10T04:22:39.070431+0000","last_peered":"2024-05-10T04:22:39.070431+0000","last_clean":"2024-05-10T04:22:39.070431+0000","last_became_active":"2024-05-10T04:22:37.527036+0000","last_became_peered":"2024-05-10T04:22:37.527036+0000","last_unstale":"2024-05-10T04:22:39.070431+0000","last_undegraded":"2024-05-10T04:22:39.070431+0000","last_fullsized":"2024-05-10T04:22:39.070431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:28.560590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565568+0000","last_change":"2024-05-10T04:22:36.932349+0000","last_active":"2024-05-10T04:22:38.565568+0000","last_peered":"2024-05-10T04:22:38.565568+0000","last_clean":"2024-05-10T04:22:38.565568+0000","last_became_active":"2024-05-10T04:22:36.931526+0000","last_became_peered":"2024-05-10T04:22:36.931526+0000","last_unstale":"2024-05-10T04:22:38.565568+0000","last_undegraded":"2024-05-10T04:22:38.565568+0000","last_fullsized":"2024-05-10T04:22:38.565568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:57:15.621386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068537+0000","last_change":"2024-05-10T04:22:37.511862+0000","last_active":"2024-05-10T04:22:39.068537+0000","last_peered":"2024-05-10T04:22:39.068537+0000","last_clean":"2024-05-10T04:22:39.068537+0000","last_became_active":"2024-05-10T04:22:37.511535+0000","last_became_peered":"2024-05-10T04:22:37.511535+0000","last_unstale":"2024-05-10T04:22:39.068537+0000","last_undegraded":"2024-05-10T04:22:39.068537+0000","last_fullsized":"2024-05-10T04:22:39.068537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:27:09.485253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068563+0000","last_change":"2024-05-10T04:22:36.930693+0000","last_active":"2024-05-10T04:22:39.068563+0000","last_peered":"2024-05-10T04:22:39.068563+0000","last_clean":"2024-05-10T04:22:39.068563+0000","last_became_active":"2024-05-10T04:22:36.929916+0000","last_became_peered":"2024-05-10T04:22:36.929916+0000","last_unstale":"2024-05-10T04:22:39.068563+0000","last_undegraded":"2024-05-10T04:22:39.068563+0000","last_fullsized":"2024-05-10T04:22:39.068563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:13:55.237529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565543+0000","last_change":"2024-05-10T04:22:37.526069+0000","last_active":"2024-05-10T04:22:38.565543+0000","last_peered":"2024-05-10T04:22:38.565543+0000","last_clean":"2024-05-10T04:22:38.565543+0000","last_became_active":"2024-05-10T04:22:37.525791+0000","last_became_peered":"2024-05-10T04:22:37.525791+0000","last_unstale":"2024-05-10T04:22:38.565543+0000","last_undegraded":"2024-05-10T04:22:38.565543+0000","last_fullsized":"2024-05-10T04:22:38.565543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:14.343190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070684+0000","last_change":"2024-05-10T04:22:36.939770+0000","last_active":"2024-05-10T04:22:39.070684+0000","last_peered":"2024-05-10T04:22:39.070684+0000","last_clean":"2024-05-10T04:22:39.070684+0000","last_became_active":"2024-05-10T04:22:36.939301+0000","last_became_peered":"2024-05-10T04:22:36.939301+0000","last_unstale":"2024-05-10T04:22:39.070684+0000","last_undegraded":"2024-05-10T04:22:39.070684+0000","last_fullsized":"2024-05-10T04:22:39.070684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:27:49.663346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496562+0000","last_change":"2024-05-10T04:22:37.507133+0000","last_active":"2024-05-10T04:22:38.496562+0000","last_peered":"2024-05-10T04:22:38.496562+0000","last_clean":"2024-05-10T04:22:38.496562+0000","last_became_active":"2024-05-10T04:22:37.506811+0000","last_became_peered":"2024-05-10T04:22:37.506811+0000","last_unstale":"2024-05-10T04:22:38.496562+0000","last_undegraded":"2024-05-10T04:22:38.496562+0000","last_fullsized":"2024-05-10T04:22:38.496562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:28.560590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070333+0000","last_change":"2024-05-10T04:22:36.937289+0000","last_active":"2024-05-10T04:22:39.070333+0000","last_peered":"2024-05-10T04:22:39.070333+0000","last_clean":"2024-05-10T04:22:39.070333+0000","last_became_active":"2024-05-10T04:22:36.936972+0000","last_became_peered":"2024-05-10T04:22:36.936972+0000","last_unstale":"2024-05-10T04:22:39.070333+0000","last_undegraded":"2024-05-10T04:22:39.070333+0000","last_fullsized":"2024-05-10T04:22:39.070333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:06.712574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496845+0000","last_change":"2024-05-10T04:22:37.509008+0000","last_active":"2024-05-10T04:22:38.496845+0000","last_peered":"2024-05-10T04:22:38.496845+0000","last_clean":"2024-05-10T04:22:38.496845+0000","last_became_active":"2024-05-10T04:22:37.508188+0000","last_became_peered":"2024-05-10T04:22:37.508188+0000","last_unstale":"2024-05-10T04:22:38.496845+0000","last_undegraded":"2024-05-10T04:22:38.496845+0000","last_fullsized":"2024-05-10T04:22:38.496845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:58.202277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068360+0000","last_change":"2024-05-10T04:22:36.931519+0000","last_active":"2024-05-10T04:22:39.068360+0000","last_peered":"2024-05-10T04:22:39.068360+0000","last_clean":"2024-05-10T04:22:39.068360+0000","last_became_active":"2024-05-10T04:22:36.930555+0000","last_became_peered":"2024-05-10T04:22:36.930555+0000","last_unstale":"2024-05-10T04:22:39.068360+0000","last_undegraded":"2024-05-10T04:22:39.068360+0000","last_fullsized":"2024-05-10T04:22:39.068360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:00.426110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069534+0000","last_change":"2024-05-10T04:22:37.510204+0000","last_active":"2024-05-10T04:22:39.069534+0000","last_peered":"2024-05-10T04:22:39.069534+0000","last_clean":"2024-05-10T04:22:39.069534+0000","last_became_active":"2024-05-10T04:22:37.509393+0000","last_became_peered":"2024-05-10T04:22:37.509393+0000","last_unstale":"2024-05-10T04:22:39.069534+0000","last_undegraded":"2024-05-10T04:22:39.069534+0000","last_fullsized":"2024-05-10T04:22:39.069534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:03.281665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069401+0000","last_change":"2024-05-10T04:22:36.939267+0000","last_active":"2024-05-10T04:22:39.069401+0000","last_peered":"2024-05-10T04:22:39.069401+0000","last_clean":"2024-05-10T04:22:39.069401+0000","last_became_active":"2024-05-10T04:22:36.938965+0000","last_became_peered":"2024-05-10T04:22:36.938965+0000","last_unstale":"2024-05-10T04:22:39.069401+0000","last_undegraded":"2024-05-10T04:22:39.069401+0000","last_fullsized":"2024-05-10T04:22:39.069401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:34:08.587305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565609+0000","last_change":"2024-05-10T04:22:37.506554+0000","last_active":"2024-05-10T04:22:38.565609+0000","last_peered":"2024-05-10T04:22:38.565609+0000","last_clean":"2024-05-10T04:22:38.565609+0000","last_became_active":"2024-05-10T04:22:37.506176+0000","last_became_peered":"2024-05-10T04:22:37.506176+0000","last_unstale":"2024-05-10T04:22:38.565609+0000","last_undegraded":"2024-05-10T04:22:38.565609+0000","last_fullsized":"2024-05-10T04:22:38.565609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:21.117834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068191+0000","last_change":"2024-05-10T04:22:36.925541+0000","last_active":"2024-05-10T04:22:39.068191+0000","last_peered":"2024-05-10T04:22:39.068191+0000","last_clean":"2024-05-10T04:22:39.068191+0000","last_became_active":"2024-05-10T04:22:36.925205+0000","last_became_peered":"2024-05-10T04:22:36.925205+0000","last_unstale":"2024-05-10T04:22:39.068191+0000","last_undegraded":"2024-05-10T04:22:39.068191+0000","last_fullsized":"2024-05-10T04:22:39.068191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:20.974889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068123+0000","last_change":"2024-05-10T04:22:37.510685+0000","last_active":"2024-05-10T04:22:39.068123+0000","last_peered":"2024-05-10T04:22:39.068123+0000","last_clean":"2024-05-10T04:22:39.068123+0000","last_became_active":"2024-05-10T04:22:37.510373+0000","last_became_peered":"2024-05-10T04:22:37.510373+0000","last_unstale":"2024-05-10T04:22:39.068123+0000","last_undegraded":"2024-05-10T04:22:39.068123+0000","last_fullsized":"2024-05-10T04:22:39.068123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:44.231090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496383+0000","last_change":"2024-05-10T04:22:36.928180+0000","last_active":"2024-05-10T04:22:38.496383+0000","last_peered":"2024-05-10T04:22:38.496383+0000","last_clean":"2024-05-10T04:22:38.496383+0000","last_became_active":"2024-05-10T04:22:36.927821+0000","last_became_peered":"2024-05-10T04:22:36.927821+0000","last_unstale":"2024-05-10T04:22:38.496383+0000","last_undegraded":"2024-05-10T04:22:38.496383+0000","last_fullsized":"2024-05-10T04:22:38.496383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:45:19.397807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496112+0000","last_change":"2024-05-10T04:22:37.516811+0000","last_active":"2024-05-10T04:22:38.496112+0000","last_peered":"2024-05-10T04:22:38.496112+0000","last_clean":"2024-05-10T04:22:38.496112+0000","last_became_active":"2024-05-10T04:22:37.511489+0000","last_became_peered":"2024-05-10T04:22:37.511489+0000","last_unstale":"2024-05-10T04:22:38.496112+0000","last_undegraded":"2024-05-10T04:22:38.496112+0000","last_fullsized":"2024-05-10T04:22:38.496112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:44.231090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069855+0000","last_change":"2024-05-10T04:22:36.931435+0000","last_active":"2024-05-10T04:22:39.069855+0000","last_peered":"2024-05-10T04:22:39.069855+0000","last_clean":"2024-05-10T04:22:39.069855+0000","last_became_active":"2024-05-10T04:22:36.930942+0000","last_became_peered":"2024-05-10T04:22:36.930942+0000","last_unstale":"2024-05-10T04:22:39.069855+0000","last_undegraded":"2024-05-10T04:22:39.069855+0000","last_fullsized":"2024-05-10T04:22:39.069855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:45:19.397807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496995+0000","last_change":"2024-05-10T04:22:37.512758+0000","last_active":"2024-05-10T04:22:38.496995+0000","last_peered":"2024-05-10T04:22:38.496995+0000","last_clean":"2024-05-10T04:22:38.496995+0000","last_became_active":"2024-05-10T04:22:37.512328+0000","last_became_peered":"2024-05-10T04:22:37.512328+0000","last_unstale":"2024-05-10T04:22:38.496995+0000","last_undegraded":"2024-05-10T04:22:38.496995+0000","last_fullsized":"2024-05-10T04:22:38.496995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:23:17.836129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496870+0000","last_change":"2024-05-10T04:22:36.930650+0000","last_active":"2024-05-10T04:22:38.496870+0000","last_peered":"2024-05-10T04:22:38.496870+0000","last_clean":"2024-05-10T04:22:38.496870+0000","last_became_active":"2024-05-10T04:22:36.929660+0000","last_became_peered":"2024-05-10T04:22:36.929660+0000","last_unstale":"2024-05-10T04:22:38.496870+0000","last_undegraded":"2024-05-10T04:22:38.496870+0000","last_fullsized":"2024-05-10T04:22:38.496870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:49:54.352088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565607+0000","last_change":"2024-05-10T04:22:37.516984+0000","last_active":"2024-05-10T04:22:38.565607+0000","last_peered":"2024-05-10T04:22:38.565607+0000","last_clean":"2024-05-10T04:22:38.565607+0000","last_became_active":"2024-05-10T04:22:37.516708+0000","last_became_peered":"2024-05-10T04:22:37.516708+0000","last_unstale":"2024-05-10T04:22:38.565607+0000","last_undegraded":"2024-05-10T04:22:38.565607+0000","last_fullsized":"2024-05-10T04:22:38.565607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:50:46.925328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496445+0000","last_change":"2024-05-10T04:22:36.933595+0000","last_active":"2024-05-10T04:22:38.496445+0000","last_peered":"2024-05-10T04:22:38.496445+0000","last_clean":"2024-05-10T04:22:38.496445+0000","last_became_active":"2024-05-10T04:22:36.933244+0000","last_became_peered":"2024-05-10T04:22:36.933244+0000","last_unstale":"2024-05-10T04:22:38.496445+0000","last_undegraded":"2024-05-10T04:22:38.496445+0000","last_fullsized":"2024-05-10T04:22:38.496445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:34:08.587305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070569+0000","last_change":"2024-05-10T04:22:37.521115+0000","last_active":"2024-05-10T04:22:39.070569+0000","last_peered":"2024-05-10T04:22:39.070569+0000","last_clean":"2024-05-10T04:22:39.070569+0000","last_became_active":"2024-05-10T04:22:37.520685+0000","last_became_peered":"2024-05-10T04:22:37.520685+0000","last_unstale":"2024-05-10T04:22:39.070569+0000","last_undegraded":"2024-05-10T04:22:39.070569+0000","last_fullsized":"2024-05-10T04:22:39.070569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:58:32.047404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069983+0000","last_change":"2024-05-10T04:22:36.934708+0000","last_active":"2024-05-10T04:22:39.069983+0000","last_peered":"2024-05-10T04:22:39.069983+0000","last_clean":"2024-05-10T04:22:39.069983+0000","last_became_active":"2024-05-10T04:22:36.934415+0000","last_became_peered":"2024-05-10T04:22:36.934415+0000","last_unstale":"2024-05-10T04:22:39.069983+0000","last_undegraded":"2024-05-10T04:22:39.069983+0000","last_fullsized":"2024-05-10T04:22:39.069983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:49:54.352088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070498+0000","last_change":"2024-05-10T04:22:37.526943+0000","last_active":"2024-05-10T04:22:39.070498+0000","last_peered":"2024-05-10T04:22:39.070498+0000","last_clean":"2024-05-10T04:22:39.070498+0000","last_became_active":"2024-05-10T04:22:37.524757+0000","last_became_peered":"2024-05-10T04:22:37.524757+0000","last_unstale":"2024-05-10T04:22:39.070498+0000","last_undegraded":"2024-05-10T04:22:39.070498+0000","last_fullsized":"2024-05-10T04:22:39.070498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:23:17.836129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565473+0000","last_change":"2024-05-10T04:22:36.938772+0000","last_active":"2024-05-10T04:22:38.565473+0000","last_peered":"2024-05-10T04:22:38.565473+0000","last_clean":"2024-05-10T04:22:38.565473+0000","last_became_active":"2024-05-10T04:22:36.938463+0000","last_became_peered":"2024-05-10T04:22:36.938463+0000","last_unstale":"2024-05-10T04:22:38.565473+0000","last_undegraded":"2024-05-10T04:22:38.565473+0000","last_fullsized":"2024-05-10T04:22:38.565473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:00.426110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565316+0000","last_change":"2024-05-10T04:22:37.516169+0000","last_active":"2024-05-10T04:22:38.565316+0000","last_peered":"2024-05-10T04:22:38.565316+0000","last_clean":"2024-05-10T04:22:38.565316+0000","last_became_active":"2024-05-10T04:22:37.515199+0000","last_became_peered":"2024-05-10T04:22:37.515199+0000","last_unstale":"2024-05-10T04:22:38.565316+0000","last_undegraded":"2024-05-10T04:22:38.565316+0000","last_fullsized":"2024-05-10T04:22:38.565316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:44.231090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497050+0000","last_change":"2024-05-10T04:22:36.927348+0000","last_active":"2024-05-10T04:22:38.497050+0000","last_peered":"2024-05-10T04:22:38.497050+0000","last_clean":"2024-05-10T04:22:38.497050+0000","last_became_active":"2024-05-10T04:22:36.927029+0000","last_became_peered":"2024-05-10T04:22:36.927029+0000","last_unstale":"2024-05-10T04:22:38.497050+0000","last_undegraded":"2024-05-10T04:22:38.497050+0000","last_fullsized":"2024-05-10T04:22:38.497050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:55.721524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070438+0000","last_change":"2024-05-10T04:22:37.519929+0000","last_active":"2024-05-10T04:22:39.070438+0000","last_peered":"2024-05-10T04:22:39.070438+0000","last_clean":"2024-05-10T04:22:39.070438+0000","last_became_active":"2024-05-10T04:22:37.518788+0000","last_became_peered":"2024-05-10T04:22:37.518788+0000","last_unstale":"2024-05-10T04:22:39.070438+0000","last_undegraded":"2024-05-10T04:22:39.070438+0000","last_fullsized":"2024-05-10T04:22:39.070438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:02:11.073471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069352+0000","last_change":"2024-05-10T04:22:36.937577+0000","last_active":"2024-05-10T04:22:39.069352+0000","last_peered":"2024-05-10T04:22:39.069352+0000","last_clean":"2024-05-10T04:22:39.069352+0000","last_became_active":"2024-05-10T04:22:36.937300+0000","last_became_peered":"2024-05-10T04:22:36.937300+0000","last_unstale":"2024-05-10T04:22:39.069352+0000","last_undegraded":"2024-05-10T04:22:39.069352+0000","last_fullsized":"2024-05-10T04:22:39.069352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:20.974889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069757+0000","last_change":"2024-05-10T04:22:37.507070+0000","last_active":"2024-05-10T04:22:39.069757+0000","last_peered":"2024-05-10T04:22:39.069757+0000","last_clean":"2024-05-10T04:22:39.069757+0000","last_became_active":"2024-05-10T04:22:37.506325+0000","last_became_peered":"2024-05-10T04:22:37.506325+0000","last_unstale":"2024-05-10T04:22:39.069757+0000","last_undegraded":"2024-05-10T04:22:39.069757+0000","last_fullsized":"2024-05-10T04:22:39.069757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:14.343190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497219+0000","last_change":"2024-05-10T04:22:36.924331+0000","last_active":"2024-05-10T04:22:38.497219+0000","last_peered":"2024-05-10T04:22:38.497219+0000","last_clean":"2024-05-10T04:22:38.497219+0000","last_became_active":"2024-05-10T04:22:36.923979+0000","last_became_peered":"2024-05-10T04:22:36.923979+0000","last_unstale":"2024-05-10T04:22:38.497219+0000","last_undegraded":"2024-05-10T04:22:38.497219+0000","last_fullsized":"2024-05-10T04:22:38.497219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:13:55.237529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070337+0000","last_change":"2024-05-10T04:22:37.518033+0000","last_active":"2024-05-10T04:22:39.070337+0000","last_peered":"2024-05-10T04:22:39.070337+0000","last_clean":"2024-05-10T04:22:39.070337+0000","last_became_active":"2024-05-10T04:22:37.517618+0000","last_became_peered":"2024-05-10T04:22:37.517618+0000","last_unstale":"2024-05-10T04:22:39.070337+0000","last_undegraded":"2024-05-10T04:22:39.070337+0000","last_fullsized":"2024-05-10T04:22:39.070337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:04:22.431028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070758+0000","last_change":"2024-05-10T04:22:36.927567+0000","last_active":"2024-05-10T04:22:39.070758+0000","last_peered":"2024-05-10T04:22:39.070758+0000","last_clean":"2024-05-10T04:22:39.070758+0000","last_became_active":"2024-05-10T04:22:36.927215+0000","last_became_peered":"2024-05-10T04:22:36.927215+0000","last_unstale":"2024-05-10T04:22:39.070758+0000","last_undegraded":"2024-05-10T04:22:39.070758+0000","last_fullsized":"2024-05-10T04:22:39.070758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:00.426110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070495+0000","last_change":"2024-05-10T04:22:37.525145+0000","last_active":"2024-05-10T04:22:39.070495+0000","last_peered":"2024-05-10T04:22:39.070495+0000","last_clean":"2024-05-10T04:22:39.070495+0000","last_became_active":"2024-05-10T04:22:37.524777+0000","last_became_peered":"2024-05-10T04:22:37.524777+0000","last_unstale":"2024-05-10T04:22:39.070495+0000","last_undegraded":"2024-05-10T04:22:39.070495+0000","last_fullsized":"2024-05-10T04:22:39.070495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:42.373586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496253+0000","last_change":"2024-05-10T04:22:36.928079+0000","last_active":"2024-05-10T04:22:38.496253+0000","last_peered":"2024-05-10T04:22:38.496253+0000","last_clean":"2024-05-10T04:22:38.496253+0000","last_became_active":"2024-05-10T04:22:36.927807+0000","last_became_peered":"2024-05-10T04:22:36.927807+0000","last_unstale":"2024-05-10T04:22:38.496253+0000","last_undegraded":"2024-05-10T04:22:38.496253+0000","last_fullsized":"2024-05-10T04:22:38.496253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:49:54.352088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496907+0000","last_change":"2024-05-10T04:22:37.523430+0000","last_active":"2024-05-10T04:22:38.496907+0000","last_peered":"2024-05-10T04:22:38.496907+0000","last_clean":"2024-05-10T04:22:38.496907+0000","last_became_active":"2024-05-10T04:22:37.523130+0000","last_became_peered":"2024-05-10T04:22:37.523130+0000","last_unstale":"2024-05-10T04:22:38.496907+0000","last_undegraded":"2024-05-10T04:22:38.496907+0000","last_fullsized":"2024-05-10T04:22:38.496907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:04:22.431028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496929+0000","last_change":"2024-05-10T04:22:36.928078+0000","last_active":"2024-05-10T04:22:38.496929+0000","last_peered":"2024-05-10T04:22:38.496929+0000","last_clean":"2024-05-10T04:22:38.496929+0000","last_became_active":"2024-05-10T04:22:36.927734+0000","last_became_peered":"2024-05-10T04:22:36.927734+0000","last_unstale":"2024-05-10T04:22:38.496929+0000","last_undegraded":"2024-05-10T04:22:38.496929+0000","last_fullsized":"2024-05-10T04:22:38.496929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:20.974889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069661+0000","last_change":"2024-05-10T04:22:37.509565+0000","last_active":"2024-05-10T04:22:39.069661+0000","last_peered":"2024-05-10T04:22:39.069661+0000","last_clean":"2024-05-10T04:22:39.069661+0000","last_became_active":"2024-05-10T04:22:37.508788+0000","last_became_peered":"2024-05-10T04:22:37.508788+0000","last_unstale":"2024-05-10T04:22:39.069661+0000","last_undegraded":"2024-05-10T04:22:39.069661+0000","last_fullsized":"2024-05-10T04:22:39.069661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:43.080008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.495916+0000","last_change":"2024-05-10T04:22:37.513544+0000","last_active":"2024-05-10T04:22:38.495916+0000","last_peered":"2024-05-10T04:22:38.495916+0000","last_clean":"2024-05-10T04:22:38.495916+0000","last_became_active":"2024-05-10T04:22:37.513229+0000","last_became_peered":"2024-05-10T04:22:37.513229+0000","last_unstale":"2024-05-10T04:22:38.495916+0000","last_undegraded":"2024-05-10T04:22:38.495916+0000","last_fullsized":"2024-05-10T04:22:38.495916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:21.117834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497135+0000","last_change":"2024-05-10T04:22:36.916069+0000","last_active":"2024-05-10T04:22:38.497135+0000","last_peered":"2024-05-10T04:22:38.497135+0000","last_clean":"2024-05-10T04:22:38.497135+0000","last_became_active":"2024-05-10T04:22:36.915725+0000","last_became_peered":"2024-05-10T04:22:36.915725+0000","last_unstale":"2024-05-10T04:22:38.497135+0000","last_undegraded":"2024-05-10T04:22:38.497135+0000","last_fullsized":"2024-05-10T04:22:38.497135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:20.974889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068254+0000","last_change":"2024-05-10T04:22:37.525366+0000","last_active":"2024-05-10T04:22:39.068254+0000","last_peered":"2024-05-10T04:22:39.068254+0000","last_clean":"2024-05-10T04:22:39.068254+0000","last_became_active":"2024-05-10T04:22:37.525122+0000","last_became_peered":"2024-05-10T04:22:37.525122+0000","last_unstale":"2024-05-10T04:22:39.068254+0000","last_undegraded":"2024-05-10T04:22:39.068254+0000","last_fullsized":"2024-05-10T04:22:39.068254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:04:22.431028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496402+0000","last_change":"2024-05-10T04:22:36.926870+0000","last_active":"2024-05-10T04:22:38.496402+0000","last_peered":"2024-05-10T04:22:38.496402+0000","last_clean":"2024-05-10T04:22:38.496402+0000","last_became_active":"2024-05-10T04:22:36.926076+0000","last_became_peered":"2024-05-10T04:22:36.926076+0000","last_unstale":"2024-05-10T04:22:38.496402+0000","last_undegraded":"2024-05-10T04:22:38.496402+0000","last_fullsized":"2024-05-10T04:22:38.496402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:34:08.587305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-10T04:22:37.508301+0000","last_change":"2024-05-10T04:22:27.829537+0000","last_active":"2024-05-10T04:22:37.508301+0000","last_peered":"2024-05-10T04:22:37.508301+0000","last_clean":"2024-05-10T04:22:37.508301+0000","last_became_active":"2024-05-10T04:22:27.828179+0000","last_became_peered":"2024-05-10T04:22:27.828179+0000","last_unstale":"2024-05-10T04:22:37.508301+0000","last_undegraded":"2024-05-10T04:22:37.508301+0000","last_fullsized":"2024-05-10T04:22:37.508301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_clean_scrub_stamp":"2024-05-10T04:22:26.813824+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:23.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565196+0000","last_change":"2024-05-10T04:22:37.505786+0000","last_active":"2024-05-10T04:22:38.565196+0000","last_peered":"2024-05-10T04:22:38.565196+0000","last_clean":"2024-05-10T04:22:38.565196+0000","last_became_active":"2024-05-10T04:22:37.505505+0000","last_became_peered":"2024-05-10T04:22:37.505505+0000","last_unstale":"2024-05-10T04:22:38.565196+0000","last_undegraded":"2024-05-10T04:22:38.565196+0000","last_fullsized":"2024-05-10T04:22:38.565196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:58.202277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069932+0000","last_change":"2024-05-10T04:22:36.936346+0000","last_active":"2024-05-10T04:22:39.069932+0000","last_peered":"2024-05-10T04:22:39.069932+0000","last_clean":"2024-05-10T04:22:39.069932+0000","last_became_active":"2024-05-10T04:22:36.935973+0000","last_became_peered":"2024-05-10T04:22:36.935973+0000","last_unstale":"2024-05-10T04:22:39.069932+0000","last_undegraded":"2024-05-10T04:22:39.069932+0000","last_fullsized":"2024-05-10T04:22:39.069932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:02.272048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070608+0000","last_change":"2024-05-10T04:22:36.936645+0000","last_active":"2024-05-10T04:22:39.070608+0000","last_peered":"2024-05-10T04:22:39.070608+0000","last_clean":"2024-05-10T04:22:39.070608+0000","last_became_active":"2024-05-10T04:22:36.936136+0000","last_became_peered":"2024-05-10T04:22:36.936136+0000","last_unstale":"2024-05-10T04:22:39.070608+0000","last_undegraded":"2024-05-10T04:22:39.070608+0000","last_fullsized":"2024-05-10T04:22:39.070608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:36:21.914720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496170+0000","last_change":"2024-05-10T04:22:37.507676+0000","last_active":"2024-05-10T04:22:38.496170+0000","last_peered":"2024-05-10T04:22:38.496170+0000","last_clean":"2024-05-10T04:22:38.496170+0000","last_became_active":"2024-05-10T04:22:37.506346+0000","last_became_peered":"2024-05-10T04:22:37.506346+0000","last_unstale":"2024-05-10T04:22:38.496170+0000","last_undegraded":"2024-05-10T04:22:38.496170+0000","last_fullsized":"2024-05-10T04:22:38.496170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:50:46.925328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496251+0000","last_change":"2024-05-10T04:22:36.929577+0000","last_active":"2024-05-10T04:22:38.496251+0000","last_peered":"2024-05-10T04:22:38.496251+0000","last_clean":"2024-05-10T04:22:38.496251+0000","last_became_active":"2024-05-10T04:22:36.929233+0000","last_became_peered":"2024-05-10T04:22:36.929233+0000","last_unstale":"2024-05-10T04:22:38.496251+0000","last_undegraded":"2024-05-10T04:22:38.496251+0000","last_fullsized":"2024-05-10T04:22:38.496251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:02.272048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068722+0000","last_change":"2024-05-10T04:22:37.519249+0000","last_active":"2024-05-10T04:22:39.068722+0000","last_peered":"2024-05-10T04:22:39.068722+0000","last_clean":"2024-05-10T04:22:39.068722+0000","last_became_active":"2024-05-10T04:22:37.516952+0000","last_became_peered":"2024-05-10T04:22:37.516952+0000","last_unstale":"2024-05-10T04:22:39.068722+0000","last_undegraded":"2024-05-10T04:22:39.068722+0000","last_fullsized":"2024-05-10T04:22:39.068722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:21.117834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069775+0000","last_change":"2024-05-10T04:22:36.931235+0000","last_active":"2024-05-10T04:22:39.069775+0000","last_peered":"2024-05-10T04:22:39.069775+0000","last_clean":"2024-05-10T04:22:39.069775+0000","last_became_active":"2024-05-10T04:22:36.930721+0000","last_became_peered":"2024-05-10T04:22:36.930721+0000","last_unstale":"2024-05-10T04:22:39.069775+0000","last_undegraded":"2024-05-10T04:22:39.069775+0000","last_fullsized":"2024-05-10T04:22:39.069775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:55.721524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565564+0000","last_change":"2024-05-10T04:22:37.508611+0000","last_active":"2024-05-10T04:22:38.565564+0000","last_peered":"2024-05-10T04:22:38.565564+0000","last_clean":"2024-05-10T04:22:38.565564+0000","last_became_active":"2024-05-10T04:22:37.508350+0000","last_became_peered":"2024-05-10T04:22:37.508350+0000","last_unstale":"2024-05-10T04:22:38.565564+0000","last_undegraded":"2024-05-10T04:22:38.565564+0000","last_fullsized":"2024-05-10T04:22:38.565564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:05:50.563476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069633+0000","last_change":"2024-05-10T04:22:36.936567+0000","last_active":"2024-05-10T04:22:39.069633+0000","last_peered":"2024-05-10T04:22:39.069633+0000","last_clean":"2024-05-10T04:22:39.069633+0000","last_became_active":"2024-05-10T04:22:36.936129+0000","last_became_peered":"2024-05-10T04:22:36.936129+0000","last_unstale":"2024-05-10T04:22:39.069633+0000","last_undegraded":"2024-05-10T04:22:39.069633+0000","last_fullsized":"2024-05-10T04:22:39.069633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:58:31.037787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070074+0000","last_change":"2024-05-10T04:22:37.501502+0000","last_active":"2024-05-10T04:22:39.070074+0000","last_peered":"2024-05-10T04:22:39.070074+0000","last_clean":"2024-05-10T04:22:39.070074+0000","last_became_active":"2024-05-10T04:22:37.499775+0000","last_became_peered":"2024-05-10T04:22:37.499775+0000","last_unstale":"2024-05-10T04:22:39.070074+0000","last_undegraded":"2024-05-10T04:22:39.070074+0000","last_fullsized":"2024-05-10T04:22:39.070074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:49:55.361705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.495945+0000","last_change":"2024-05-10T04:22:36.932162+0000","last_active":"2024-05-10T04:22:38.495945+0000","last_peered":"2024-05-10T04:22:38.495945+0000","last_clean":"2024-05-10T04:22:38.495945+0000","last_became_active":"2024-05-10T04:22:36.931860+0000","last_became_peered":"2024-05-10T04:22:36.931860+0000","last_unstale":"2024-05-10T04:22:38.495945+0000","last_undegraded":"2024-05-10T04:22:38.495945+0000","last_fullsized":"2024-05-10T04:22:38.495945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:58:31.037787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068207+0000","last_change":"2024-05-10T04:22:37.509114+0000","last_active":"2024-05-10T04:22:39.068207+0000","last_peered":"2024-05-10T04:22:39.068207+0000","last_clean":"2024-05-10T04:22:39.068207+0000","last_became_active":"2024-05-10T04:22:37.508839+0000","last_became_peered":"2024-05-10T04:22:37.508839+0000","last_unstale":"2024-05-10T04:22:39.068207+0000","last_undegraded":"2024-05-10T04:22:39.068207+0000","last_fullsized":"2024-05-10T04:22:39.068207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:05:50.563476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496138+0000","last_change":"2024-05-10T04:22:36.928410+0000","last_active":"2024-05-10T04:22:38.496138+0000","last_peered":"2024-05-10T04:22:38.496138+0000","last_clean":"2024-05-10T04:22:38.496138+0000","last_became_active":"2024-05-10T04:22:36.927343+0000","last_became_peered":"2024-05-10T04:22:36.927343+0000","last_unstale":"2024-05-10T04:22:38.496138+0000","last_undegraded":"2024-05-10T04:22:38.496138+0000","last_fullsized":"2024-05-10T04:22:38.496138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:06.712574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068415+0000","last_change":"2024-05-10T04:22:37.507850+0000","last_active":"2024-05-10T04:22:39.068415+0000","last_peered":"2024-05-10T04:22:39.068415+0000","last_clean":"2024-05-10T04:22:39.068415+0000","last_became_active":"2024-05-10T04:22:37.507569+0000","last_became_peered":"2024-05-10T04:22:37.507569+0000","last_unstale":"2024-05-10T04:22:39.068415+0000","last_undegraded":"2024-05-10T04:22:39.068415+0000","last_fullsized":"2024-05-10T04:22:39.068415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:32:34.172364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070553+0000","last_change":"2024-05-10T04:22:36.938914+0000","last_active":"2024-05-10T04:22:39.070553+0000","last_peered":"2024-05-10T04:22:39.070553+0000","last_clean":"2024-05-10T04:22:39.070553+0000","last_became_active":"2024-05-10T04:22:36.938595+0000","last_became_peered":"2024-05-10T04:22:36.938595+0000","last_unstale":"2024-05-10T04:22:39.070553+0000","last_undegraded":"2024-05-10T04:22:39.070553+0000","last_fullsized":"2024-05-10T04:22:39.070553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:42.070391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069442+0000","last_change":"2024-05-10T04:22:37.505070+0000","last_active":"2024-05-10T04:22:39.069442+0000","last_peered":"2024-05-10T04:22:39.069442+0000","last_clean":"2024-05-10T04:22:39.069442+0000","last_became_active":"2024-05-10T04:22:37.504723+0000","last_became_peered":"2024-05-10T04:22:37.504723+0000","last_unstale":"2024-05-10T04:22:39.069442+0000","last_undegraded":"2024-05-10T04:22:39.069442+0000","last_fullsized":"2024-05-10T04:22:39.069442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:43:11.310124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497386+0000","last_change":"2024-05-10T04:22:36.922648+0000","last_active":"2024-05-10T04:22:38.497386+0000","last_peered":"2024-05-10T04:22:38.497386+0000","last_clean":"2024-05-10T04:22:38.497386+0000","last_became_active":"2024-05-10T04:22:36.922257+0000","last_became_peered":"2024-05-10T04:22:36.922257+0000","last_unstale":"2024-05-10T04:22:38.497386+0000","last_undegraded":"2024-05-10T04:22:38.497386+0000","last_fullsized":"2024-05-10T04:22:38.497386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:45:19.397807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070568+0000","last_change":"2024-05-10T04:22:37.531232+0000","last_active":"2024-05-10T04:22:39.070568+0000","last_peered":"2024-05-10T04:22:39.070568+0000","last_clean":"2024-05-10T04:22:39.070568+0000","last_became_active":"2024-05-10T04:22:37.530843+0000","last_became_peered":"2024-05-10T04:22:37.530843+0000","last_unstale":"2024-05-10T04:22:39.070568+0000","last_undegraded":"2024-05-10T04:22:39.070568+0000","last_fullsized":"2024-05-10T04:22:39.070568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:50.806224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496380+0000","last_change":"2024-05-10T04:22:36.936617+0000","last_active":"2024-05-10T04:22:38.496380+0000","last_peered":"2024-05-10T04:22:38.496380+0000","last_clean":"2024-05-10T04:22:38.496380+0000","last_became_active":"2024-05-10T04:22:36.936285+0000","last_became_peered":"2024-05-10T04:22:36.936285+0000","last_unstale":"2024-05-10T04:22:38.496380+0000","last_undegraded":"2024-05-10T04:22:38.496380+0000","last_fullsized":"2024-05-10T04:22:38.496380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:36:21.914720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496722+0000","last_change":"2024-05-10T04:22:37.520651+0000","last_active":"2024-05-10T04:22:38.496722+0000","last_peered":"2024-05-10T04:22:38.496722+0000","last_clean":"2024-05-10T04:22:38.496722+0000","last_became_active":"2024-05-10T04:22:37.519874+0000","last_became_peered":"2024-05-10T04:22:37.519874+0000","last_unstale":"2024-05-10T04:22:38.496722+0000","last_undegraded":"2024-05-10T04:22:38.496722+0000","last_fullsized":"2024-05-10T04:22:38.496722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:44.231090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497498+0000","last_change":"2024-05-10T04:22:36.919541+0000","last_active":"2024-05-10T04:22:38.497498+0000","last_peered":"2024-05-10T04:22:38.497498+0000","last_clean":"2024-05-10T04:22:38.497498+0000","last_became_active":"2024-05-10T04:22:36.918920+0000","last_became_peered":"2024-05-10T04:22:36.918920+0000","last_unstale":"2024-05-10T04:22:38.497498+0000","last_undegraded":"2024-05-10T04:22:38.497498+0000","last_fullsized":"2024-05-10T04:22:38.497498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:55.721524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070854+0000","last_change":"2024-05-10T04:22:37.527580+0000","last_active":"2024-05-10T04:22:39.070854+0000","last_peered":"2024-05-10T04:22:39.070854+0000","last_clean":"2024-05-10T04:22:39.070854+0000","last_became_active":"2024-05-10T04:22:37.527300+0000","last_became_peered":"2024-05-10T04:22:37.527300+0000","last_unstale":"2024-05-10T04:22:39.070854+0000","last_undegraded":"2024-05-10T04:22:39.070854+0000","last_fullsized":"2024-05-10T04:22:39.070854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:20:47.909486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069677+0000","last_change":"2024-05-10T04:22:37.510392+0000","last_active":"2024-05-10T04:22:39.069677+0000","last_peered":"2024-05-10T04:22:39.069677+0000","last_clean":"2024-05-10T04:22:39.069677+0000","last_became_active":"2024-05-10T04:22:37.510025+0000","last_became_peered":"2024-05-10T04:22:37.510025+0000","last_unstale":"2024-05-10T04:22:39.069677+0000","last_undegraded":"2024-05-10T04:22:39.069677+0000","last_fullsized":"2024-05-10T04:22:39.069677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:32:34.172364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497241+0000","last_change":"2024-05-10T04:22:37.509539+0000","last_active":"2024-05-10T04:22:38.497241+0000","last_peered":"2024-05-10T04:22:38.497241+0000","last_clean":"2024-05-10T04:22:38.497241+0000","last_became_active":"2024-05-10T04:22:37.508940+0000","last_became_peered":"2024-05-10T04:22:37.508940+0000","last_unstale":"2024-05-10T04:22:38.497241+0000","last_undegraded":"2024-05-10T04:22:38.497241+0000","last_fullsized":"2024-05-10T04:22:38.497241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:36:22.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496640+0000","last_change":"2024-05-10T04:22:37.522117+0000","last_active":"2024-05-10T04:22:38.496640+0000","last_peered":"2024-05-10T04:22:38.496640+0000","last_clean":"2024-05-10T04:22:38.496640+0000","last_became_active":"2024-05-10T04:22:37.519139+0000","last_became_peered":"2024-05-10T04:22:37.519139+0000","last_unstale":"2024-05-10T04:22:38.496640+0000","last_undegraded":"2024-05-10T04:22:38.496640+0000","last_fullsized":"2024-05-10T04:22:38.496640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:21:00.214222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565462+0000","last_change":"2024-05-10T04:22:37.519204+0000","last_active":"2024-05-10T04:22:38.565462+0000","last_peered":"2024-05-10T04:22:38.565462+0000","last_clean":"2024-05-10T04:22:38.565462+0000","last_became_active":"2024-05-10T04:22:37.517860+0000","last_became_peered":"2024-05-10T04:22:37.517860+0000","last_unstale":"2024-05-10T04:22:38.565462+0000","last_undegraded":"2024-05-10T04:22:38.565462+0000","last_fullsized":"2024-05-10T04:22:38.565462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:43:11.310124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068533+0000","last_change":"2024-05-10T04:22:37.504218+0000","last_active":"2024-05-10T04:22:39.068533+0000","last_peered":"2024-05-10T04:22:39.068533+0000","last_clean":"2024-05-10T04:22:39.068533+0000","last_became_active":"2024-05-10T04:22:37.503947+0000","last_became_peered":"2024-05-10T04:22:37.503947+0000","last_unstale":"2024-05-10T04:22:39.068533+0000","last_undegraded":"2024-05-10T04:22:39.068533+0000","last_fullsized":"2024-05-10T04:22:39.068533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:14.343190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496322+0000","last_change":"2024-05-10T04:22:37.519414+0000","last_active":"2024-05-10T04:22:38.496322+0000","last_peered":"2024-05-10T04:22:38.496322+0000","last_clean":"2024-05-10T04:22:38.496322+0000","last_became_active":"2024-05-10T04:22:37.516543+0000","last_became_peered":"2024-05-10T04:22:37.516543+0000","last_unstale":"2024-05-10T04:22:38.496322+0000","last_undegraded":"2024-05-10T04:22:38.496322+0000","last_fullsized":"2024-05-10T04:22:38.496322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:51:34.367433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069529+0000","last_change":"2024-05-10T04:22:37.514037+0000","last_active":"2024-05-10T04:22:39.069529+0000","last_peered":"2024-05-10T04:22:39.069529+0000","last_clean":"2024-05-10T04:22:39.069529+0000","last_became_active":"2024-05-10T04:22:37.513712+0000","last_became_peered":"2024-05-10T04:22:37.513712+0000","last_unstale":"2024-05-10T04:22:39.069529+0000","last_undegraded":"2024-05-10T04:22:39.069529+0000","last_fullsized":"2024-05-10T04:22:39.069529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:44.231090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068643+0000","last_change":"2024-05-10T04:22:37.506846+0000","last_active":"2024-05-10T04:22:39.068643+0000","last_peered":"2024-05-10T04:22:39.068643+0000","last_clean":"2024-05-10T04:22:39.068643+0000","last_became_active":"2024-05-10T04:22:37.506474+0000","last_became_peered":"2024-05-10T04:22:37.506474+0000","last_unstale":"2024-05-10T04:22:39.068643+0000","last_undegraded":"2024-05-10T04:22:39.068643+0000","last_fullsized":"2024-05-10T04:22:39.068643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:47:50.791426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496480+0000","last_change":"2024-05-10T04:22:37.521288+0000","last_active":"2024-05-10T04:22:38.496480+0000","last_peered":"2024-05-10T04:22:38.496480+0000","last_clean":"2024-05-10T04:22:38.496480+0000","last_became_active":"2024-05-10T04:22:37.520951+0000","last_became_peered":"2024-05-10T04:22:37.520951+0000","last_unstale":"2024-05-10T04:22:38.496480+0000","last_undegraded":"2024-05-10T04:22:38.496480+0000","last_fullsized":"2024-05-10T04:22:38.496480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:14.343190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068105+0000","last_change":"2024-05-10T04:22:37.503799+0000","last_active":"2024-05-10T04:22:39.068105+0000","last_peered":"2024-05-10T04:22:39.068105+0000","last_clean":"2024-05-10T04:22:39.068105+0000","last_became_active":"2024-05-10T04:22:37.503081+0000","last_became_peered":"2024-05-10T04:22:37.503081+0000","last_unstale":"2024-05-10T04:22:39.068105+0000","last_undegraded":"2024-05-10T04:22:39.068105+0000","last_fullsized":"2024-05-10T04:22:39.068105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:50:46.925328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497145+0000","last_change":"2024-05-10T04:22:37.522075+0000","last_active":"2024-05-10T04:22:38.497145+0000","last_peered":"2024-05-10T04:22:38.497145+0000","last_clean":"2024-05-10T04:22:38.497145+0000","last_became_active":"2024-05-10T04:22:37.518004+0000","last_became_peered":"2024-05-10T04:22:37.518004+0000","last_unstale":"2024-05-10T04:22:38.497145+0000","last_undegraded":"2024-05-10T04:22:38.497145+0000","last_fullsized":"2024-05-10T04:22:38.497145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:42.373586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565375+0000","last_change":"2024-05-10T04:22:37.519285+0000","last_active":"2024-05-10T04:22:38.565375+0000","last_peered":"2024-05-10T04:22:38.565375+0000","last_clean":"2024-05-10T04:22:38.565375+0000","last_became_active":"2024-05-10T04:22:37.518230+0000","last_became_peered":"2024-05-10T04:22:37.518230+0000","last_unstale":"2024-05-10T04:22:38.565375+0000","last_undegraded":"2024-05-10T04:22:38.565375+0000","last_fullsized":"2024-05-10T04:22:38.565375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:32:34.172364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070158+0000","last_change":"2024-05-10T04:22:37.505032+0000","last_active":"2024-05-10T04:22:39.070158+0000","last_peered":"2024-05-10T04:22:39.070158+0000","last_clean":"2024-05-10T04:22:39.070158+0000","last_became_active":"2024-05-10T04:22:37.504674+0000","last_became_peered":"2024-05-10T04:22:37.504674+0000","last_unstale":"2024-05-10T04:22:39.070158+0000","last_undegraded":"2024-05-10T04:22:39.070158+0000","last_fullsized":"2024-05-10T04:22:39.070158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:51:34.367433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:22:43.104 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-10T04:22:43.104 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-10T04:22:43.104 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-10T04:22:43.105 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-10T04:22:43.105 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-10T04:22:43.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.398+0000 7f4502200700 1 Processor -- start 2024-05-10T04:22:43.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.398+0000 7f4502200700 1 -- start start 2024-05-10T04:22:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.400+0000 7f4502200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f44fc161fa0 0x7f44fc0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.400+0000 7f4502200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc0d0b70 0x7f44fc0b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.400+0000 7f4502200700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44fc0d28c0 con 0x7f44fc0b2f50 2024-05-10T04:22:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.400+0000 7f4502200700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc0b3360 con 0x7f44fc161fa0 2024-05-10T04:22:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.400+0000 7f4502200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc0d2ba0 con 0x7f44fc0d0b70 2024-05-10T04:22:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.400+0000 7f44f3e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f44fc161fa0 0x7f44fc0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.400+0000 7f44f3e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f44fc161fa0 0x7f44fc0d0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52744/0 (socket says 172.21.15.80:52744) 2024-05-10T04:22:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.400+0000 7f44f3e00700 1 -- 172.21.15.80:0/878311669 learned_addr learned my addr 172.21.15.80:0/878311669 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.400+0000 7f44fbe00700 1 --2- 172.21.15.80:0/878311669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc0d0b70 0x7f44fc0b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.401+0000 7f44f3e00700 1 -- 172.21.15.80:0/878311669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc0d0b70 msgr2=0x7f44fc0b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.401+0000 7f44f3e00700 1 --2- 172.21.15.80:0/878311669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc0d0b70 0x7f44fc0b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.401+0000 7f44f3e00700 1 -- 172.21.15.80:0/878311669 >> v1:172.21.15.106:6789/0 conn(0x7f44fc0b2f50 legacy=0x7f44fc0d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.401+0000 7f44f3e00700 1 -- 172.21.15.80:0/878311669 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc0cf970 con 0x7f44fc161fa0 2024-05-10T04:22:43.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.401+0000 7f44f3e00700 1 --2- 172.21.15.80:0/878311669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc161fa0 0x7f44fc0d0630 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f44e40098f0 tx=0x7f44e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c64c7798771155 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:43.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.401+0000 7f44faa00700 1 -- 172.21.15.80:0/878311669 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4011830 con 0x7f44fc161fa0 2024-05-10T04:22:43.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.401+0000 7f44faa00700 1 -- 172.21.15.80:0/878311669 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e4011990 con 0x7f44fc161fa0 2024-05-10T04:22:43.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.401+0000 7f44faa00700 1 -- 172.21.15.80:0/878311669 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4011d20 con 0x7f44fc161fa0 2024-05-10T04:22:43.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.402+0000 7f4502200700 1 -- 172.21.15.80:0/878311669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc161fa0 msgr2=0x7f44fc0d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:43.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.402+0000 7f4502200700 1 --2- 172.21.15.80:0/878311669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc161fa0 0x7f44fc0d0630 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f44e40098f0 tx=0x7f44e4009c00 comp rx=0 tx=0).stop 2024-05-10T04:22:43.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.402+0000 7f4502200700 1 -- 172.21.15.80:0/878311669 shutdown_connections 2024-05-10T04:22:43.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.402+0000 7f4502200700 1 --2- 172.21.15.80:0/878311669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc0d0b70 0x7f44fc0b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.402+0000 7f4502200700 1 --2- 172.21.15.80:0/878311669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc161fa0 0x7f44fc0d0630 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.402+0000 7f4502200700 1 -- 172.21.15.80:0/878311669 >> 172.21.15.80:0/878311669 conn(0x7f44fc06c3f0 msgr2=0x7f44fc06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:43.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.402+0000 7f4502200700 1 -- 172.21.15.80:0/878311669 shutdown_connections 2024-05-10T04:22:43.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.402+0000 7f4502200700 1 -- 172.21.15.80:0/878311669 wait complete. 2024-05-10T04:22:43.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.405+0000 7f4502200700 1 Processor -- start 2024-05-10T04:22:43.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.405+0000 7f4502200700 1 -- start start 2024-05-10T04:22:43.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.407+0000 7f4502200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0b2f50 0x7f44fc0ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:43.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.407+0000 7f4502200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc0d0b70 0x7f44fc15ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:43.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.407+0000 7f4502200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc161fa0 0x7f44fc0c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:43.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.407+0000 7f4502200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc1f4740 con 0x7f44fc0b2f50 2024-05-10T04:22:43.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.407+0000 7f4502200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc0c89e0 con 0x7f44fc0d0b70 2024-05-10T04:22:43.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.407+0000 7f4502200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc0c8c30 con 0x7f44fc161fa0 2024-05-10T04:22:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.407+0000 7f44fb400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0b2f50 0x7f44fc0ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.407+0000 7f44fb400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0b2f50 0x7f44fc0ab140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52746/0 (socket says 172.21.15.80:52746) 2024-05-10T04:22:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.407+0000 7f44fb400700 1 -- 172.21.15.80:0/4003716485 learned_addr learned my addr 172.21.15.80:0/4003716485 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.407+0000 7f44f3e00700 1 --2- 172.21.15.80:0/4003716485 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc0d0b70 0x7f44fc15ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.407+0000 7f44fbe00700 1 --2- 172.21.15.80:0/4003716485 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc161fa0 0x7f44fc0c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.407+0000 7f44fb400700 1 -- 172.21.15.80:0/4003716485 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc161fa0 msgr2=0x7f44fc0c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.407+0000 7f44fb400700 1 --2- 172.21.15.80:0/4003716485 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc161fa0 0x7f44fc0c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.407+0000 7f44fb400700 1 -- 172.21.15.80:0/4003716485 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc0d0b70 msgr2=0x7f44fc15ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.407+0000 7f44fb400700 1 --2- 172.21.15.80:0/4003716485 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc0d0b70 0x7f44fc15ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.407+0000 7f44fb400700 1 -- 172.21.15.80:0/4003716485 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e4009550 con 0x7f44fc0b2f50 2024-05-10T04:22:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.407+0000 7f44f3e00700 1 --2- 172.21.15.80:0/4003716485 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc0d0b70 0x7f44fc15ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.408+0000 7f44fb400700 1 --2- 172.21.15.80:0/4003716485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0b2f50 0x7f44fc0ab140 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00c430 tx=0x7f44ec00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.408+0000 7f44f3400700 1 -- 172.21.15.80:0/4003716485 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec0052d0 con 0x7f44fc0b2f50 2024-05-10T04:22:43.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.408+0000 7f44f3400700 1 -- 172.21.15.80:0/4003716485 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ec005430 con 0x7f44fc0b2f50 2024-05-10T04:22:43.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.408+0000 7f4502200700 1 -- 172.21.15.80:0/4003716485 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44fc0c8f10 con 0x7f44fc0b2f50 2024-05-10T04:22:43.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.408+0000 7f44f3400700 1 -- 172.21.15.80:0/4003716485 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec0038c0 con 0x7f44fc0b2f50 2024-05-10T04:22:43.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.408+0000 7f4502200700 1 -- 172.21.15.80:0/4003716485 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc0c94d0 con 0x7f44fc0b2f50 2024-05-10T04:22:43.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.409+0000 7f4502200700 1 -- 172.21.15.80:0/4003716485 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44fc074af0 con 0x7f44fc0b2f50 2024-05-10T04:22:43.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.410+0000 7f44f3400700 1 -- 172.21.15.80:0/4003716485 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f44ec003a20 con 0x7f44fc0b2f50 2024-05-10T04:22:43.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.411+0000 7f44f3400700 1 --2- 172.21.15.80:0/4003716485 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44d806acc0 0x7f44d806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:43.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.411+0000 7f44f3400700 1 -- 172.21.15.80:0/4003716485 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44ec088730 con 0x7f44fc0b2f50 2024-05-10T04:22:43.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.411+0000 7f44f3e00700 1 --2- 172.21.15.80:0/4003716485 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44d806acc0 0x7f44d806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:43.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.412+0000 7f44f3e00700 1 --2- 172.21.15.80:0/4003716485 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44d806acc0 0x7f44d806d1d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f44e4014040 tx=0x7f44e4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:43.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.415+0000 7f44f3400700 1 -- 172.21.15.80:0/4003716485 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f44ec053900 con 0x7f44fc0b2f50 2024-05-10T04:22:43.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.677+0000 7f4502200700 1 -- 172.21.15.80:0/4003716485 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f44fc0b34a0 con 0x7f44fc0b2f50 2024-05-10T04:22:43.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.680+0000 7f44f3400700 1 -- 172.21.15.80:0/4003716485 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170944 (secure 0 0 0) 0x7f44ec056f20 con 0x7f44fc0b2f50 2024-05-10T04:22:43.683 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:43.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.684+0000 7f4502200700 1 -- 172.21.15.80:0/4003716485 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44d806acc0 msgr2=0x7f44d806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:43.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.684+0000 7f4502200700 1 --2- 172.21.15.80:0/4003716485 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44d806acc0 0x7f44d806d1d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f44e4014040 tx=0x7f44e4008030 comp rx=0 tx=0).stop 2024-05-10T04:22:43.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.684+0000 7f4502200700 1 -- 172.21.15.80:0/4003716485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0b2f50 msgr2=0x7f44fc0ab140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:43.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.684+0000 7f4502200700 1 --2- 172.21.15.80:0/4003716485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0b2f50 0x7f44fc0ab140 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00c430 tx=0x7f44ec00c7f0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.684+0000 7f4502200700 1 -- 172.21.15.80:0/4003716485 shutdown_connections 2024-05-10T04:22:43.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.684+0000 7f4502200700 1 --2- 172.21.15.80:0/4003716485 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44d806acc0 0x7f44d806d1d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.684+0000 7f4502200700 1 --2- 172.21.15.80:0/4003716485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0b2f50 0x7f44fc0ab140 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.684+0000 7f4502200700 1 --2- 172.21.15.80:0/4003716485 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc161fa0 0x7f44fc0c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.684+0000 7f4502200700 1 --2- 172.21.15.80:0/4003716485 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc0d0b70 0x7f44fc15ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.684+0000 7f4502200700 1 -- 172.21.15.80:0/4003716485 >> 172.21.15.80:0/4003716485 conn(0x7f44fc06c3f0 msgr2=0x7f44fc0cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:43.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.684+0000 7f4502200700 1 -- 172.21.15.80:0/4003716485 shutdown_connections 2024-05-10T04:22:43.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.684+0000 7f4502200700 1 -- 172.21.15.80:0/4003716485 wait complete. 2024-05-10T04:22:43.710 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":41218},{"type":"v1","addr":"172.21.15.106:6833","nonce":41218}]},"active_addr":"172.21.15.106:6833/41218","active_change":"2024-05-10T04:22:18.719623+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":1058535291}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":1794213380}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":3674223255}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":3983008358}]}]} 2024-05-10T04:22:43.714 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-10T04:22:43.714 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-10T04:22:43.715 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:22:43.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.972+0000 7f6d08600700 1 Processor -- start 2024-05-10T04:22:43.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.973+0000 7f6d08600700 1 -- start start 2024-05-10T04:22:43.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.974+0000 7f6d08600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d000b2f50 0x7f6d00161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:43.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.974+0000 7f6d08600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d000d3030 0x7f6d000d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:43.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.974+0000 7f6d08600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6d000d0630 0x7f6d000d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:43.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.974+0000 7f6d08600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d000b3360 con 0x7f6d000b2f50 2024-05-10T04:22:43.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.974+0000 7f6d08600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d001624e0 con 0x7f6d000d0630 2024-05-10T04:22:43.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.974+0000 7f6d08600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d000d28c0 con 0x7f6d000d3030 2024-05-10T04:22:43.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.974+0000 7f6d05c00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d000b2f50 0x7f6d00161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:43.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.975+0000 7f6d05c00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d000b2f50 0x7f6d00161fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52752/0 (socket says 172.21.15.80:52752) 2024-05-10T04:22:43.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.975+0000 7f6d05c00700 1 -- 172.21.15.80:0/2790444565 learned_addr learned my addr 172.21.15.80:0/2790444565 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:43.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.975+0000 7f6d05200700 1 --2- 172.21.15.80:0/2790444565 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d000d3030 0x7f6d000d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:43.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.975+0000 7f6d06600700 1 --2- 172.21.15.80:0/2790444565 >> v2:172.21.15.106:3300/0 conn(0x7f6d000d0630 0x7f6d000d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:43.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.975+0000 7f6d05c00700 1 -- 172.21.15.80:0/2790444565 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d000d3030 msgr2=0x7f6d000d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:43.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.975+0000 7f6d05c00700 1 --2- 172.21.15.80:0/2790444565 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d000d3030 0x7f6d000d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.975+0000 7f6d05c00700 1 -- 172.21.15.80:0/2790444565 >> v2:172.21.15.106:3300/0 conn(0x7f6d000d0630 msgr2=0x7f6d000d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:43.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.975+0000 7f6d05c00700 1 --2- 172.21.15.80:0/2790444565 >> v2:172.21.15.106:3300/0 conn(0x7f6d000d0630 0x7f6d000d0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.975+0000 7f6d05c00700 1 -- 172.21.15.80:0/2790444565 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d000d2ba0 con 0x7f6d000b2f50 2024-05-10T04:22:43.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.975+0000 7f6d05c00700 1 --2- 172.21.15.80:0/2790444565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d000b2f50 0x7f6d00161fa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6d00067a10 tx=0x7f6cf4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357efc30f1c2b356 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:43.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.975+0000 7f6cffe00700 1 -- 172.21.15.80:0/2790444565 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf400b870 con 0x7f6d000b2f50 2024-05-10T04:22:43.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.975+0000 7f6cffe00700 1 -- 172.21.15.80:0/2790444565 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf400b9d0 con 0x7f6d000b2f50 2024-05-10T04:22:43.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.975+0000 7f6cffe00700 1 -- 172.21.15.80:0/2790444565 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf400bd60 con 0x7f6d000b2f50 2024-05-10T04:22:43.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.976+0000 7f6d08600700 1 -- 172.21.15.80:0/2790444565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d000b2f50 msgr2=0x7f6d00161fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:43.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.976+0000 7f6d08600700 1 --2- 172.21.15.80:0/2790444565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d000b2f50 0x7f6d00161fa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6d00067a10 tx=0x7f6cf4009bd0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.976+0000 7f6d08600700 1 -- 172.21.15.80:0/2790444565 shutdown_connections 2024-05-10T04:22:43.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.976+0000 7f6d08600700 1 --2- 172.21.15.80:0/2790444565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d000b2f50 0x7f6d00161fa0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.976+0000 7f6d08600700 1 --2- 172.21.15.80:0/2790444565 >> v2:172.21.15.106:3300/0 conn(0x7f6d000d0630 0x7f6d000d0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.976+0000 7f6d08600700 1 --2- 172.21.15.80:0/2790444565 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d000d3030 0x7f6d000d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.976+0000 7f6d08600700 1 -- 172.21.15.80:0/2790444565 >> 172.21.15.80:0/2790444565 conn(0x7f6d0006c3f0 msgr2=0x7f6d0006c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:43.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.976+0000 7f6d08600700 1 -- 172.21.15.80:0/2790444565 shutdown_connections 2024-05-10T04:22:43.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.976+0000 7f6d08600700 1 -- 172.21.15.80:0/2790444565 wait complete. 2024-05-10T04:22:43.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.979+0000 7f6d08600700 1 Processor -- start 2024-05-10T04:22:43.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.979+0000 7f6d08600700 1 -- start start 2024-05-10T04:22:43.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.980+0000 7f6d08600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d000b2f50 0x7f6d000ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:43.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.980+0000 7f6d08600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d000d0630 0x7f6d00157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:43.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.980+0000 7f6d08600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d000d3030 0x7f6d000b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:43.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.980+0000 7f6d08600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d000b01c0 con 0x7f6d000d3030 2024-05-10T04:22:43.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.980+0000 7f6d08600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d000ade60 con 0x7f6d000b2f50 2024-05-10T04:22:43.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.980+0000 7f6d08600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d000ae0b0 con 0x7f6d000d0630 2024-05-10T04:22:43.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.980+0000 7f6d06600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d000d3030 0x7f6d000b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:43.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.980+0000 7f6d06600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d000d3030 0x7f6d000b4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52756/0 (socket says 172.21.15.80:52756) 2024-05-10T04:22:43.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.981+0000 7f6d06600700 1 -- 172.21.15.80:0/2823870318 learned_addr learned my addr 172.21.15.80:0/2823870318 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:43.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.981+0000 7f6d05c00700 1 --2- 172.21.15.80:0/2823870318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d000b2f50 0x7f6d000ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:43.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.981+0000 7f6d05200700 1 --2- 172.21.15.80:0/2823870318 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d000d0630 0x7f6d00157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:43.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.981+0000 7f6d06600700 1 -- 172.21.15.80:0/2823870318 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d000d0630 msgr2=0x7f6d00157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:43.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.981+0000 7f6d06600700 1 --2- 172.21.15.80:0/2823870318 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d000d0630 0x7f6d00157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.981+0000 7f6d06600700 1 -- 172.21.15.80:0/2823870318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d000b2f50 msgr2=0x7f6d000ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:43.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.981+0000 7f6d06600700 1 --2- 172.21.15.80:0/2823870318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d000b2f50 0x7f6d000ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:43.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.981+0000 7f6d06600700 1 -- 172.21.15.80:0/2823870318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf4009550 con 0x7f6d000d3030 2024-05-10T04:22:43.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.981+0000 7f6d06600700 1 --2- 172.21.15.80:0/2823870318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d000d3030 0x7f6d000b4af0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8007d10 tx=0x7f6cf800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:43.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.981+0000 7f6cfd600700 1 -- 172.21.15.80:0/2823870318 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf800ed30 con 0x7f6d000d3030 2024-05-10T04:22:43.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.981+0000 7f6cfd600700 1 -- 172.21.15.80:0/2823870318 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf800ee90 con 0x7f6d000d3030 2024-05-10T04:22:43.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.981+0000 7f6d08600700 1 -- 172.21.15.80:0/2823870318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d000ae390 con 0x7f6d000d3030 2024-05-10T04:22:43.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.982+0000 7f6cfd600700 1 -- 172.21.15.80:0/2823870318 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8014660 con 0x7f6d000d3030 2024-05-10T04:22:43.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.982+0000 7f6d08600700 1 -- 172.21.15.80:0/2823870318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d000abeb0 con 0x7f6d000d3030 2024-05-10T04:22:43.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.983+0000 7f6d08600700 1 -- 172.21.15.80:0/2823870318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d00074af0 con 0x7f6d000d3030 2024-05-10T04:22:43.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.984+0000 7f6cfd600700 1 -- 172.21.15.80:0/2823870318 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6cf80147c0 con 0x7f6d000d3030 2024-05-10T04:22:43.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.985+0000 7f6cfd600700 1 --2- 172.21.15.80:0/2823870318 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6ce006ac90 0x7f6ce006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:43.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.985+0000 7f6cfd600700 1 -- 172.21.15.80:0/2823870318 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cf80899b0 con 0x7f6d000d3030 2024-05-10T04:22:43.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.986+0000 7f6d05c00700 1 --2- 172.21.15.80:0/2823870318 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6ce006ac90 0x7f6ce006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:43.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.986+0000 7f6d05c00700 1 --2- 172.21.15.80:0/2823870318 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6ce006ac90 0x7f6ce006d1a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6d00067a10 tx=0x7f6cf4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:43.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:43.990+0000 7f6cfd600700 1 -- 172.21.15.80:0/2823870318 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6cf8054a60 con 0x7f6d000d3030 2024-05-10T04:22:44.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.197+0000 7f6d08600700 1 -- 172.21.15.80:0/2823870318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d000b34a0 con 0x7f6d000d3030 2024-05-10T04:22:44.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.198+0000 7f6cfd600700 1 -- 172.21.15.80:0/2823870318 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f6cf8007e60 con 0x7f6d000d3030 2024-05-10T04:22:44.200 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:44.200 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:38.485422+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:22:44.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.201+0000 7f6d08600700 1 -- 172.21.15.80:0/2823870318 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6ce006ac90 msgr2=0x7f6ce006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:44.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.201+0000 7f6d08600700 1 --2- 172.21.15.80:0/2823870318 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6ce006ac90 0x7f6ce006d1a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6d00067a10 tx=0x7f6cf4008030 comp rx=0 tx=0).stop 2024-05-10T04:22:44.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.201+0000 7f6d08600700 1 -- 172.21.15.80:0/2823870318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d000d3030 msgr2=0x7f6d000b4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:44.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.201+0000 7f6d08600700 1 --2- 172.21.15.80:0/2823870318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d000d3030 0x7f6d000b4af0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8007d10 tx=0x7f6cf800e3c0 comp rx=0 tx=0).stop 2024-05-10T04:22:44.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.201+0000 7f6d08600700 1 -- 172.21.15.80:0/2823870318 shutdown_connections 2024-05-10T04:22:44.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.201+0000 7f6d08600700 1 --2- 172.21.15.80:0/2823870318 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6ce006ac90 0x7f6ce006d1a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:44.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.201+0000 7f6d08600700 1 --2- 172.21.15.80:0/2823870318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d000d3030 0x7f6d000b4af0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:44.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.201+0000 7f6d08600700 1 --2- 172.21.15.80:0/2823870318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d000b2f50 0x7f6d000ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:44.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.201+0000 7f6d08600700 1 --2- 172.21.15.80:0/2823870318 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d000d0630 0x7f6d00157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:44.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.201+0000 7f6d08600700 1 -- 172.21.15.80:0/2823870318 >> 172.21.15.80:0/2823870318 conn(0x7f6d0006c3f0 msgr2=0x7f6d000cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:44.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.201+0000 7f6d08600700 1 -- 172.21.15.80:0/2823870318 shutdown_connections 2024-05-10T04:22:44.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.201+0000 7f6d08600700 1 -- 172.21.15.80:0/2823870318 wait complete. 2024-05-10T04:22:44.229 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-10T04:22:44.230 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:22:44.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.487+0000 7fa8cb800700 1 Processor -- start 2024-05-10T04:22:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.488+0000 7fa8cb800700 1 -- start start 2024-05-10T04:22:44.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.489+0000 7fa8cb800700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa8c40d0d40 0x7fa8c40b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:44.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.489+0000 7fa8cb800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c40d28c0 con 0x7fa8c40b2f50 2024-05-10T04:22:44.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.489+0000 7fa8cb800700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c40d2ba0 con 0x7fa8c4161fa0 2024-05-10T04:22:44.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.489+0000 7fa8cb800700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c40b3360 con 0x7fa8c40d0d40 2024-05-10T04:22:44.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.489+0000 7fa8c8e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa8c40b2f50 0x7fa8c40d3030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41478/0 (socket says 172.21.15.80:41478) 2024-05-10T04:22:44.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.489+0000 7fa8c8e00700 1 -- 172.21.15.80:0/3865947622 learned_addr learned my addr 172.21.15.80:0/3865947622 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:44.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.490+0000 7fa8c9800700 1 --2- 172.21.15.80:0/3865947622 >> v2:172.21.15.106:3300/0 conn(0x7fa8c40d0d40 0x7fa8c40b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:44.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.490+0000 7fa8c3400700 1 -- 172.21.15.80:0/3865947622 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176563885 0 0) 0x7fa8c40d28c0 con 0x7fa8c40b2f50 2024-05-10T04:22:44.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.490+0000 7fa8c3400700 1 -- 172.21.15.80:0/3865947622 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8ac0035b0 con 0x7fa8c40b2f50 2024-05-10T04:22:44.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.490+0000 7fa8c9800700 1 -- 172.21.15.80:0/3865947622 >> v1:172.21.15.106:6789/0 conn(0x7fa8c4161fa0 legacy=0x7fa8c40d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:44.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.490+0000 7fa8c9800700 1 -- 172.21.15.80:0/3865947622 >> v1:172.21.15.80:6789/0 conn(0x7fa8c40b2f50 legacy=0x7fa8c40d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:44.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.490+0000 7fa8c9800700 1 -- 172.21.15.80:0/3865947622 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c40cf970 con 0x7fa8c40d0d40 2024-05-10T04:22:44.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.490+0000 7fa8c9800700 1 --2- 172.21.15.80:0/3865947622 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c40d0d40 0x7fa8c40b7320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009d90 tx=0x7fa8bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc76f0cb579d926d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:44.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.491+0000 7fa8c3400700 1 -- 172.21.15.80:0/3865947622 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00e070 con 0x7fa8c40d0d40 2024-05-10T04:22:44.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.491+0000 7fa8c3400700 1 -- 172.21.15.80:0/3865947622 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc00bb20 con 0x7fa8c40d0d40 2024-05-10T04:22:44.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.491+0000 7fa8c3400700 1 -- 172.21.15.80:0/3865947622 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc012430 con 0x7fa8c40d0d40 2024-05-10T04:22:44.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.491+0000 7fa8cb800700 1 -- 172.21.15.80:0/3865947622 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c40d0d40 msgr2=0x7fa8c40b7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:44.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.491+0000 7fa8cb800700 1 --2- 172.21.15.80:0/3865947622 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c40d0d40 0x7fa8c40b7320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009d90 tx=0x7fa8bc00b330 comp rx=0 tx=0).stop 2024-05-10T04:22:44.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.491+0000 7fa8cb800700 1 -- 172.21.15.80:0/3865947622 shutdown_connections 2024-05-10T04:22:44.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.491+0000 7fa8cb800700 1 --2- 172.21.15.80:0/3865947622 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c40d0d40 0x7fa8c40b7320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:44.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.491+0000 7fa8cb800700 1 -- 172.21.15.80:0/3865947622 >> 172.21.15.80:0/3865947622 conn(0x7fa8c406c3f0 msgr2=0x7fa8c406c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:44.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.492+0000 7fa8cb800700 1 -- 172.21.15.80:0/3865947622 shutdown_connections 2024-05-10T04:22:44.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.492+0000 7fa8cb800700 1 -- 172.21.15.80:0/3865947622 wait complete. 2024-05-10T04:22:44.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.494+0000 7fa8cb800700 1 Processor -- start 2024-05-10T04:22:44.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.494+0000 7fa8cb800700 1 -- start start 2024-05-10T04:22:44.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.495+0000 7fa8cb800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c40b2f50 0x7fa8c415c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:44.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.495+0000 7fa8cb800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8c40d0d40 0x7fa8c41fab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.495+0000 7fa8cb800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c4161fa0 0x7fa8c415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.495+0000 7fa8cb800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c41fc380 con 0x7fa8c4161fa0 2024-05-10T04:22:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.495+0000 7fa8cb800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c40c3ea0 con 0x7fa8c40b2f50 2024-05-10T04:22:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.495+0000 7fa8cb800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c4071580 con 0x7fa8c40d0d40 2024-05-10T04:22:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.496+0000 7fa8c9800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c4161fa0 0x7fa8c415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.496+0000 7fa8c9800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c4161fa0 0x7fa8c415cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52768/0 (socket says 172.21.15.80:52768) 2024-05-10T04:22:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.496+0000 7fa8c9800700 1 -- 172.21.15.80:0/2772287867 learned_addr learned my addr 172.21.15.80:0/2772287867 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.496+0000 7fa8c8e00700 1 --2- 172.21.15.80:0/2772287867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c40b2f50 0x7fa8c415c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.496+0000 7fa8c3e00700 1 --2- 172.21.15.80:0/2772287867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8c40d0d40 0x7fa8c41fab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.496+0000 7fa8c9800700 1 -- 172.21.15.80:0/2772287867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8c40d0d40 msgr2=0x7fa8c41fab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.496+0000 7fa8c9800700 1 --2- 172.21.15.80:0/2772287867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8c40d0d40 0x7fa8c41fab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.496+0000 7fa8c9800700 1 -- 172.21.15.80:0/2772287867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c40b2f50 msgr2=0x7fa8c415c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.496+0000 7fa8c9800700 1 --2- 172.21.15.80:0/2772287867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c40b2f50 0x7fa8c415c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:44.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.496+0000 7fa8c9800700 1 -- 172.21.15.80:0/2772287867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc009a70 con 0x7fa8c4161fa0 2024-05-10T04:22:44.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.497+0000 7fa8c9800700 1 --2- 172.21.15.80:0/2772287867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c4161fa0 0x7fa8c415cee0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc014040 tx=0x7fa8bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:44.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.497+0000 7fa8c0c00700 1 -- 172.21.15.80:0/2772287867 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc012430 con 0x7fa8c4161fa0 2024-05-10T04:22:44.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.497+0000 7fa8c0c00700 1 -- 172.21.15.80:0/2772287867 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc020070 con 0x7fa8c4161fa0 2024-05-10T04:22:44.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.497+0000 7fa8cb800700 1 -- 172.21.15.80:0/2772287867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c41fb5b0 con 0x7fa8c4161fa0 2024-05-10T04:22:44.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.497+0000 7fa8c0c00700 1 -- 172.21.15.80:0/2772287867 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc004280 con 0x7fa8c4161fa0 2024-05-10T04:22:44.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.497+0000 7fa8cb800700 1 -- 172.21.15.80:0/2772287867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c41fbae0 con 0x7fa8c4161fa0 2024-05-10T04:22:44.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.498+0000 7fa8cb800700 1 -- 172.21.15.80:0/2772287867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c4074af0 con 0x7fa8c4161fa0 2024-05-10T04:22:44.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.499+0000 7fa8c0c00700 1 -- 172.21.15.80:0/2772287867 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa8bc0043e0 con 0x7fa8c4161fa0 2024-05-10T04:22:44.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.500+0000 7fa8c0c00700 1 --2- 172.21.15.80:0/2772287867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa8a406ac90 0x7fa8a406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:44.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.500+0000 7fa8c0c00700 1 -- 172.21.15.80:0/2772287867 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8bc022070 con 0x7fa8c4161fa0 2024-05-10T04:22:44.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.501+0000 7fa8c8e00700 1 --2- 172.21.15.80:0/2772287867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa8a406ac90 0x7fa8a406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:44.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.501+0000 7fa8c8e00700 1 --2- 172.21.15.80:0/2772287867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa8a406ac90 0x7fa8a406d1a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8007fd0 tx=0x7fa8b8007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:44.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.504+0000 7fa8c0c00700 1 -- 172.21.15.80:0/2772287867 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa8bc0564b0 con 0x7fa8c4161fa0 2024-05-10T04:22:44.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.711+0000 7fa8cb800700 1 -- 172.21.15.80:0/2772287867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8c40c71e0 con 0x7fa8c4161fa0 2024-05-10T04:22:44.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.712+0000 7fa8c0c00700 1 -- 172.21.15.80:0/2772287867 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fa8bc01ae60 con 0x7fa8c4161fa0 2024-05-10T04:22:44.713 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:44.714 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:38.485422+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:22:44.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.714+0000 7fa8cb800700 1 -- 172.21.15.80:0/2772287867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa8a406ac90 msgr2=0x7fa8a406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:44.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.714+0000 7fa8cb800700 1 --2- 172.21.15.80:0/2772287867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa8a406ac90 0x7fa8a406d1a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8007fd0 tx=0x7fa8b8007dc0 comp rx=0 tx=0).stop 2024-05-10T04:22:44.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.714+0000 7fa8cb800700 1 -- 172.21.15.80:0/2772287867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c4161fa0 msgr2=0x7fa8c415cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:44.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.714+0000 7fa8cb800700 1 --2- 172.21.15.80:0/2772287867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c4161fa0 0x7fa8c415cee0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc014040 tx=0x7fa8bc004ad0 comp rx=0 tx=0).stop 2024-05-10T04:22:44.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.715+0000 7fa8cb800700 1 -- 172.21.15.80:0/2772287867 shutdown_connections 2024-05-10T04:22:44.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.715+0000 7fa8cb800700 1 --2- 172.21.15.80:0/2772287867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa8a406ac90 0x7fa8a406d1a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:44.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.715+0000 7fa8cb800700 1 --2- 172.21.15.80:0/2772287867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c4161fa0 0x7fa8c415cee0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:44.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.715+0000 7fa8cb800700 1 --2- 172.21.15.80:0/2772287867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c40b2f50 0x7fa8c415c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:44.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.715+0000 7fa8cb800700 1 --2- 172.21.15.80:0/2772287867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8c40d0d40 0x7fa8c41fab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:44.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.715+0000 7fa8cb800700 1 -- 172.21.15.80:0/2772287867 >> 172.21.15.80:0/2772287867 conn(0x7fa8c406c3f0 msgr2=0x7fa8c40cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:44.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.715+0000 7fa8cb800700 1 -- 172.21.15.80:0/2772287867 shutdown_connections 2024-05-10T04:22:44.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:44.715+0000 7fa8cb800700 1 -- 172.21.15.80:0/2772287867 wait complete. 2024-05-10T04:22:44.743 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-10T04:22:44.743 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-10T04:22:44.744 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-10T04:22:44.744 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-10T04:22:44.744 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-10T04:22:44.745 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-10T04:22:44.745 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-10T04:22:44.745 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-10T04:22:45.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.219+0000 7fcd81c00700 1 Processor -- start 2024-05-10T04:22:45.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.220+0000 7fcd81c00700 1 -- start start 2024-05-10T04:22:45.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.223+0000 7fcd81c00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcd7c15a020 0x7fcd7c06e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.223+0000 7fcd7aa00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcd7c15a020 0x7fcd7c06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.224+0000 7fcd81c00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcd7c06f4a0 0x7fcd7c15e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.224+0000 7fcd7aa00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcd7c15a020 0x7fcd7c06e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52776/0 (socket says 172.21.15.80:52776) 2024-05-10T04:22:45.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.224+0000 7fcd7aa00700 1 -- 172.21.15.80:0/365634035 learned_addr learned my addr 172.21.15.80:0/365634035 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.224+0000 7fcd81c00700 1 -- 172.21.15.80:0/365634035 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c0b2790 con 0x7fcd7c06eb50 2024-05-10T04:22:45.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.223+0000 7f03b4200700 1 Processor -- start 2024-05-10T04:22:45.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.224+0000 7fcd7b400700 1 --2- 172.21.15.80:0/365634035 >> v2:172.21.15.106:3300/0 conn(0x7fcd7c06f4a0 0x7fcd7c15e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.223+0000 7f03b4200700 1 -- start start 2024-05-10T04:22:45.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.224+0000 7f20de800700 1 Processor -- start 2024-05-10T04:22:45.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.224+0000 7fcd81c00700 1 -- 172.21.15.80:0/365634035 --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c0b3030 con 0x7fcd7c15a020 2024-05-10T04:22:45.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.225+0000 7fcd81c00700 1 -- 172.21.15.80:0/365634035 --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c06f0d0 con 0x7fcd7c06f4a0 2024-05-10T04:22:45.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.225+0000 7fcd79600700 1 -- 172.21.15.80:0/365634035 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020940401 0 0) 0x7fcd7c0b2790 con 0x7fcd7c06eb50 2024-05-10T04:22:45.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.225+0000 7fcd79600700 1 -- 172.21.15.80:0/365634035 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd600057c0 con 0x7fcd7c06eb50 2024-05-10T04:22:45.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.225+0000 7fcd7aa00700 1 -- 172.21.15.80:0/365634035 >> v2:172.21.15.106:3300/0 conn(0x7fcd7c06f4a0 msgr2=0x7fcd7c15e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.225+0000 7fcd7aa00700 1 --2- 172.21.15.80:0/365634035 >> v2:172.21.15.106:3300/0 conn(0x7fcd7c06f4a0 0x7fcd7c15e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.225+0000 7fcd7aa00700 1 -- 172.21.15.80:0/365634035 >> v1:172.21.15.106:6789/0 conn(0x7fcd7c06eb50 legacy=0x7fcd7c0713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.225+0000 7fcd7aa00700 1 -- 172.21.15.80:0/365634035 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c0b29e0 con 0x7fcd7c15a020 2024-05-10T04:22:45.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.225+0000 7fcd7b400700 1 --2- 172.21.15.80:0/365634035 >> v2:172.21.15.106:3300/0 conn(0x7fcd7c06f4a0 0x7fcd7c15e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:22:45.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.224+0000 7f20de800700 1 -- start start 2024-05-10T04:22:45.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.226+0000 7fcd7aa00700 1 --2- 172.21.15.80:0/365634035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd7c15a020 0x7fcd7c06e610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0af0d0 tx=0x7fcd6800fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e8f95364f02dd9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.226+0000 7f03b4200700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f03ac148e50 0x7f03ac0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.226+0000 7f03b4200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f03ac071da0 0x7f03ac1667c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.226+0000 7f03b4200700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ac06e790 con 0x7f03ac1663b0 2024-05-10T04:22:45.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.226+0000 7f03b4200700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ac149260 con 0x7f03ac071da0 2024-05-10T04:22:45.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.226+0000 7f03b4200700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ac06e1a0 con 0x7f03ac148e50 2024-05-10T04:22:45.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.227+0000 7f03b0e00700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f03ac1663b0 0x7f03ac071690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:47112/0 (socket says 172.21.15.80:47112) 2024-05-10T04:22:45.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.227+0000 7f03b0e00700 1 -- 172.21.15.80:0/1250620745 learned_addr learned my addr 172.21.15.80:0/1250620745 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:45.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.227+0000 7f03b2200700 1 --2- 172.21.15.80:0/1250620745 >> v2:172.21.15.80:3300/0 conn(0x7f03ac071da0 0x7f03ac1667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.227+0000 7f03abe00700 1 -- 172.21.15.80:0/1250620745 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430372288 0 0) 0x7f03ac06e790 con 0x7f03ac1663b0 2024-05-10T04:22:45.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.227+0000 7f03abe00700 1 -- 172.21.15.80:0/1250620745 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03940035b0 con 0x7f03ac1663b0 2024-05-10T04:22:45.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.227+0000 7f03abe00700 1 -- 172.21.15.80:0/1250620745 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3286126040 0 0) 0x7f03940035b0 con 0x7f03ac1663b0 2024-05-10T04:22:45.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7f03abe00700 1 -- 172.21.15.80:0/1250620745 >> v2:172.21.15.106:3300/0 conn(0x7f03ac148e50 msgr2=0x7f03ac0ca0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T04:22:45.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7f03abe00700 1 --2- 172.21.15.80:0/1250620745 >> v2:172.21.15.106:3300/0 conn(0x7f03ac148e50 0x7f03ac0ca0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7f03abe00700 1 -- 172.21.15.80:0/1250620745 >> v2:172.21.15.80:3300/0 conn(0x7f03ac071da0 msgr2=0x7f03ac1667c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7f03abe00700 1 --2- 172.21.15.80:0/1250620745 >> v2:172.21.15.80:3300/0 conn(0x7f03ac071da0 0x7f03ac1667c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7f03abe00700 1 -- 172.21.15.80:0/1250620745 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac166e00 con 0x7f03ac1663b0 2024-05-10T04:22:45.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7f03abe00700 1 -- 172.21.15.80:0/1250620745 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7f03a0001670 con 0x7f03ac1663b0 2024-05-10T04:22:45.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7f03abe00700 1 -- 172.21.15.80:0/1250620745 >> v1:172.21.15.106:6789/0 conn(0x7f03ac1663b0 legacy=0x7f03ac071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7f03abe00700 1 --2- 172.21.15.80:0/1250620745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0394003a00 0x7f0394003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7f03abe00700 1 --2- 172.21.15.80:0/1250620745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0394004850 0x7f0394004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7f03abe00700 1 --2- 172.21.15.80:0/1250620745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0394005210 0x7f039400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7f03abe00700 1 -- 172.21.15.80:0/1250620745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac149260 con 0x7f0394003a00 2024-05-10T04:22:45.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7f03abe00700 1 -- 172.21.15.80:0/1250620745 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac06e1a0 con 0x7f0394004850 2024-05-10T04:22:45.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7f03abe00700 1 -- 172.21.15.80:0/1250620745 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039400c230 con 0x7f0394005210 2024-05-10T04:22:45.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7fcd79600700 1 -- 172.21.15.80:0/365634035 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68004230 con 0x7fcd7c15a020 2024-05-10T04:22:45.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7fcd79600700 1 -- 172.21.15.80:0/365634035 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd68004390 con 0x7fcd7c15a020 2024-05-10T04:22:45.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7fcd79600700 1 -- 172.21.15.80:0/365634035 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68018850 con 0x7fcd7c15a020 2024-05-10T04:22:45.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7f03b2200700 1 --2- 172.21.15.80:0/1250620745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0394005210 0x7f039400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.228+0000 7f03b0e00700 1 --2- 172.21.15.80:0/1250620745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0394004850 0x7f0394004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.229+0000 7f03b2200700 1 -- 172.21.15.80:0/1250620745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0394004850 msgr2=0x7f0394004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.229+0000 7f03b2200700 1 --2- 172.21.15.80:0/1250620745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0394004850 0x7f0394004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.229+0000 7f03b2200700 1 -- 172.21.15.80:0/1250620745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0394003a00 msgr2=0x7f0394003e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T04:22:45.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.229+0000 7f03b2200700 1 --2- 172.21.15.80:0/1250620745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0394003a00 0x7f0394003e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.229+0000 7f03b2200700 1 -- 172.21.15.80:0/1250620745 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac166e00 con 0x7f0394005210 2024-05-10T04:22:45.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.229+0000 7f03b2200700 1 -- 172.21.15.80:0/1250620745 reap_dead start 2024-05-10T04:22:45.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.229+0000 7f03b2200700 1 --2- 172.21.15.80:0/1250620745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0394005210 0x7f039400ba10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f039c009b30 tx=0x7f0394005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90befbfa922865ed server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.230+0000 7fcd81c00700 1 -- 172.21.15.80:0/365634035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd7c15a020 msgr2=0x7fcd7c06e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.230+0000 7fcd81c00700 1 --2- 172.21.15.80:0/365634035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd7c15a020 0x7fcd7c06e610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0af0d0 tx=0x7fcd6800fc90 comp rx=0 tx=0).stop 2024-05-10T04:22:45.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.230+0000 7fcd81c00700 1 -- 172.21.15.80:0/365634035 shutdown_connections 2024-05-10T04:22:45.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.230+0000 7fcd81c00700 1 --2- 172.21.15.80:0/365634035 >> v2:172.21.15.106:3300/0 conn(0x7fcd7c06f4a0 0x7fcd7c15e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.230+0000 7fcd81c00700 1 --2- 172.21.15.80:0/365634035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd7c15a020 0x7fcd7c06e610 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.230+0000 7fcd81c00700 1 -- 172.21.15.80:0/365634035 >> 172.21.15.80:0/365634035 conn(0x7fcd7c0b1af0 msgr2=0x7fcd7c06ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.230+0000 7f03abe00700 1 -- 172.21.15.80:0/1250620745 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c009ea0 con 0x7f0394005210 2024-05-10T04:22:45.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.230+0000 7f03abe00700 1 -- 172.21.15.80:0/1250620745 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039c00e6c0 con 0x7f0394005210 2024-05-10T04:22:45.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.230+0000 7f03abe00700 1 -- 172.21.15.80:0/1250620745 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c00ea70 con 0x7f0394005210 2024-05-10T04:22:45.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.230+0000 7fcd81c00700 1 -- 172.21.15.80:0/365634035 shutdown_connections 2024-05-10T04:22:45.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.231+0000 7f20de800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20d8140870 0x7f20d813f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.232+0000 7f20de800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d813fdb0 con 0x7f20d8071690 2024-05-10T04:22:45.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.232+0000 7f20de800700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d80cf5b0 con 0x7f20d80cf080 2024-05-10T04:22:45.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.232+0000 7f20de800700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d80cf890 con 0x7f20d8140870 2024-05-10T04:22:45.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.232+0000 7f03b4200700 1 -- 172.21.15.80:0/1250620745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0394005210 msgr2=0x7f039400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.232+0000 7f03b4200700 1 --2- 172.21.15.80:0/1250620745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0394005210 0x7f039400ba10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f039c009b30 tx=0x7f0394005880 comp rx=0 tx=0).stop 2024-05-10T04:22:45.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.232+0000 7f20d7400700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f20d80cf080 0x7f20d80cbc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:47118/0 (socket says 172.21.15.80:47118) 2024-05-10T04:22:45.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.232+0000 7f20d7400700 1 -- 172.21.15.80:0/1129491981 learned_addr learned my addr 172.21.15.80:0/1129491981 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:45.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.232+0000 7fe9df600700 1 Processor -- start 2024-05-10T04:22:45.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.232+0000 7fe9df600700 1 -- start start 2024-05-10T04:22:45.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.232+0000 7f20d6a00700 1 --2- 172.21.15.80:0/1129491981 >> v2:172.21.15.80:3300/0 conn(0x7f20d8140870 0x7f20d813f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.233+0000 7f03b4200700 1 -- 172.21.15.80:0/1250620745 shutdown_connections 2024-05-10T04:22:45.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.233+0000 7f03b4200700 1 --2- 172.21.15.80:0/1250620745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0394005210 0x7f039400ba10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.233+0000 7f03b4200700 1 -- 172.21.15.80:0/1250620745 >> 172.21.15.80:0/1250620745 conn(0x7f03ac0cfa80 msgr2=0x7f03ac0cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.233+0000 7f20d6000700 1 -- 172.21.15.80:0/1129491981 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554852732 0 0) 0x7f20d80cf5b0 con 0x7f20d80cf080 2024-05-10T04:22:45.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.230+0000 7fcd81c00700 1 -- 172.21.15.80:0/365634035 wait complete. 2024-05-10T04:22:45.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.233+0000 7f20d6000700 1 -- 172.21.15.80:0/1129491981 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20bc0034b0 con 0x7f20d80cf080 2024-05-10T04:22:45.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.234+0000 7f20d6000700 1 -- 172.21.15.80:0/1129491981 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4060730832 0 0) 0x7f20bc0034b0 con 0x7f20d80cf080 2024-05-10T04:22:45.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.234+0000 7f20d6000700 1 -- 172.21.15.80:0/1129491981 >> v2:172.21.15.80:3300/0 conn(0x7f20d8140870 msgr2=0x7f20d813f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.234+0000 7f20d6000700 1 --2- 172.21.15.80:0/1129491981 >> v2:172.21.15.80:3300/0 conn(0x7f20d8140870 0x7f20d813f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.234+0000 7f20d6000700 1 -- 172.21.15.80:0/1129491981 >> v1:172.21.15.80:6789/0 conn(0x7f20d8071690 legacy=0x7f20d8071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.234+0000 7fcd81c00700 1 Processor -- start 2024-05-10T04:22:45.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.234+0000 7f20d6000700 1 -- 172.21.15.80:0/1129491981 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d8140070 con 0x7f20d80cf080 2024-05-10T04:22:45.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.234+0000 7f20d6000700 1 -- 172.21.15.80:0/1129491981 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7f20c4004d40 con 0x7f20d80cf080 2024-05-10T04:22:45.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.234+0000 7f20d6000700 1 -- 172.21.15.80:0/1129491981 >> v1:172.21.15.106:6789/0 conn(0x7f20d80cf080 legacy=0x7f20d80cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.234+0000 7f20d6000700 1 --2- 172.21.15.80:0/1129491981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20bc004ae0 0x7f20bc004f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.234+0000 7f20d6000700 1 --2- 172.21.15.80:0/1129491981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20bc0036f0 0x7f20bc003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.234+0000 7f20d6000700 1 --2- 172.21.15.80:0/1129491981 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20bc004290 0x7f20bc00fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.234+0000 7f20d6000700 1 -- 172.21.15.80:0/1129491981 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d80cf890 con 0x7f20bc004ae0 2024-05-10T04:22:45.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.234+0000 7f20d6000700 1 -- 172.21.15.80:0/1129491981 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc010600 con 0x7f20bc0036f0 2024-05-10T04:22:45.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.234+0000 7f20d6000700 1 -- 172.21.15.80:0/1129491981 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc0107c0 con 0x7f20bc004290 2024-05-10T04:22:45.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.235+0000 7f20d6a00700 1 --2- 172.21.15.80:0/1129491981 >> v2:172.21.15.80:3300/0 conn(0x7f20d8140870 0x7f20d813f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:45.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.234+0000 7fcd81c00700 1 -- start start 2024-05-10T04:22:45.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.235+0000 7fe9df600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d80b6f70 0x7fe9d808b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.235+0000 7f20d7400700 1 --2- 172.21.15.80:0/1129491981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20bc004ae0 0x7f20bc004f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.235+0000 7f20d7e00700 1 --2- 172.21.15.80:0/1129491981 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20bc004290 0x7f20bc00fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.236+0000 7f2e34200700 1 Processor -- start 2024-05-10T04:22:45.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.236+0000 7fe9df600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe9d8160e80 0x7fe9d80cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.236+0000 7fe9dcc00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d80b6f70 0x7fe9d808b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.236+0000 7fe9dcc00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d80b6f70 0x7fe9d808b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43052/0 (socket says 172.21.15.80:43052) 2024-05-10T04:22:45.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.236+0000 7fe9d7e00700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe9d808b720 0x7fe9d8160770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:47130/0 (socket says 172.21.15.80:47130) 2024-05-10T04:22:45.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.233+0000 7f03b4200700 1 -- 172.21.15.80:0/1250620745 shutdown_connections 2024-05-10T04:22:45.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.233+0000 7f03b4200700 1 -- 172.21.15.80:0/1250620745 wait complete. 2024-05-10T04:22:45.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.237+0000 7f2e34200700 1 -- start start 2024-05-10T04:22:45.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.237+0000 7fe9dcc00700 1 -- 172.21.15.80:0/1636758719 learned_addr learned my addr 172.21.15.80:0/1636758719 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.237+0000 7fe9dd600700 1 --2- 172.21.15.80:0/1636758719 >> v2:172.21.15.106:3300/0 conn(0x7fe9d8160e80 0x7fe9d80cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.237+0000 7fe9df600700 1 -- 172.21.15.80:0/1636758719 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d80b4510 con 0x7fe9d808b720 2024-05-10T04:22:45.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.237+0000 7fcd81c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd7c06eb50 0x7fcd7c0ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.237+0000 7fcd81c00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd7c06f4a0 0x7fcd7c0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.237+0000 7fcd81c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd7c15a020 0x7fcd7c14c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.237+0000 7fcd81c00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c14ec50 con 0x7fcd7c06eb50 2024-05-10T04:22:45.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.237+0000 7fcd81c00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c14af20 con 0x7fcd7c06f4a0 2024-05-10T04:22:45.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.237+0000 7fcd81c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c14b170 con 0x7fcd7c15a020 2024-05-10T04:22:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.237+0000 7fe9df600700 1 -- 172.21.15.80:0/1636758719 --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d80d08f0 con 0x7fe9d8160e80 2024-05-10T04:22:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.237+0000 7f03b4200700 1 Processor -- start 2024-05-10T04:22:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.237+0000 7fe9df600700 1 -- 172.21.15.80:0/1636758719 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d80d02c0 con 0x7fe9d80b6f70 2024-05-10T04:22:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.238+0000 7fcd7b400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd7c15a020 0x7fcd7c14c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.238+0000 7f03b4200700 1 -- start start 2024-05-10T04:22:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.238+0000 7fcd7b400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd7c15a020 0x7fcd7c14c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43066/0 (socket says 172.21.15.80:43066) 2024-05-10T04:22:45.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.238+0000 7fe9d7400700 1 -- 172.21.15.80:0/1636758719 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990078297 0 0) 0x7fe9d80b4510 con 0x7fe9d808b720 2024-05-10T04:22:45.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.238+0000 7fe9d7400700 1 -- 172.21.15.80:0/1636758719 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9c00035b0 con 0x7fe9d808b720 2024-05-10T04:22:45.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.238+0000 7fcd7a000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd7c06f4a0 0x7fcd7c0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.238+0000 7fcd7a000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd7c06f4a0 0x7fcd7c0cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37166/0 (socket says 172.21.15.80:37166) 2024-05-10T04:22:45.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.238+0000 7fcd7a000700 1 -- 172.21.15.80:0/865740890 learned_addr learned my addr 172.21.15.80:0/865740890 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.238+0000 7fe9dcc00700 1 -- 172.21.15.80:0/1636758719 >> v2:172.21.15.106:3300/0 conn(0x7fe9d8160e80 msgr2=0x7fe9d80cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.238+0000 7fe9dcc00700 1 --2- 172.21.15.80:0/1636758719 >> v2:172.21.15.106:3300/0 conn(0x7fe9d8160e80 0x7fe9d80cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.238+0000 7fe9dcc00700 1 -- 172.21.15.80:0/1636758719 >> v1:172.21.15.106:6789/0 conn(0x7fe9d808b720 legacy=0x7fe9d8160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.238+0000 7fe9dcc00700 1 -- 172.21.15.80:0/1636758719 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d80b2c40 con 0x7fe9d80b6f70 2024-05-10T04:22:45.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.239+0000 7fe9dcc00700 1 --2- 172.21.15.80:0/1636758719 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d80b6f70 0x7fe9d808b1e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0098f0 tx=0x7fe9cc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=449593c75ddcd978 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.236+0000 7f20d6a00700 1 --2- 172.21.15.80:0/1129491981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20bc0036f0 0x7f20bc003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.236+0000 7f20d7400700 1 -- 172.21.15.80:0/1129491981 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20bc004290 msgr2=0x7f20bc00fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.236+0000 7f20d7400700 1 --2- 172.21.15.80:0/1129491981 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20bc004290 0x7f20bc00fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.236+0000 7f20d7400700 1 -- 172.21.15.80:0/1129491981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20bc0036f0 msgr2=0x7f20bc003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.236+0000 7f20d7400700 1 --2- 172.21.15.80:0/1129491981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20bc0036f0 0x7f20bc003b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.236+0000 7f20d7400700 1 -- 172.21.15.80:0/1129491981 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d8140070 con 0x7f20bc004ae0 2024-05-10T04:22:45.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.236+0000 7f20d7e00700 1 -- 172.21.15.80:0/1129491981 reap_dead start 2024-05-10T04:22:45.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.237+0000 7f20d7400700 1 --2- 172.21.15.80:0/1129491981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20bc004ae0 0x7f20bc004f70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f20c400d380 tx=0x7f20bc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26d4ebb22e5cafa server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.237+0000 7f20d6000700 1 -- 172.21.15.80:0/1129491981 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c4015030 con 0x7f20bc004ae0 2024-05-10T04:22:45.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.238+0000 7f20d6000700 1 -- 172.21.15.80:0/1129491981 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c4010480 con 0x7f20bc004ae0 2024-05-10T04:22:45.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.239+0000 7f20de800700 1 -- 172.21.15.80:0/1129491981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20bc004ae0 msgr2=0x7f20bc004f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.239+0000 7f20de800700 1 --2- 172.21.15.80:0/1129491981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20bc004ae0 0x7f20bc004f70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f20c400d380 tx=0x7f20bc004770 comp rx=0 tx=0).stop 2024-05-10T04:22:45.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.239+0000 7fe9d7400700 1 -- 172.21.15.80:0/1636758719 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc004230 con 0x7fe9d80b6f70 2024-05-10T04:22:45.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.239+0000 7fcd7aa00700 1 --2- 172.21.15.80:0/865740890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd7c06eb50 0x7fcd7c0ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.239+0000 7fe9d7400700 1 -- 172.21.15.80:0/1636758719 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc004390 con 0x7fe9d80b6f70 2024-05-10T04:22:45.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.239+0000 7fcd7a000700 1 -- 172.21.15.80:0/865740890 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd7c15a020 msgr2=0x7fcd7c14c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.239+0000 7fcd7a000700 1 --2- 172.21.15.80:0/865740890 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd7c15a020 0x7fcd7c14c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.239+0000 7fcd7a000700 1 -- 172.21.15.80:0/865740890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd7c06eb50 msgr2=0x7fcd7c0ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.239+0000 7fcd7a000700 1 --2- 172.21.15.80:0/865740890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd7c06eb50 0x7fcd7c0ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.239+0000 7fe9d7400700 1 -- 172.21.15.80:0/1636758719 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0036a0 con 0x7fe9d80b6f70 2024-05-10T04:22:45.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.239+0000 7fcd7a000700 1 -- 172.21.15.80:0/865740890 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6800f610 con 0x7fcd7c06f4a0 2024-05-10T04:22:45.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.239+0000 7fcd7aa00700 1 --2- 172.21.15.80:0/865740890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd7c06eb50 0x7fcd7c0ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:22:45.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.239+0000 7fcd7a000700 1 --2- 172.21.15.80:0/865740890 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd7c06f4a0 0x7fcd7c0cec90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00c450 tx=0x7fcd6c00c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.240+0000 7fcd72a00700 1 -- 172.21.15.80:0/865740890 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c0054e0 con 0x7fcd7c06f4a0 2024-05-10T04:22:45.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.240+0000 7f20de800700 1 -- 172.21.15.80:0/1129491981 shutdown_connections 2024-05-10T04:22:45.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.240+0000 7f20de800700 1 --2- 172.21.15.80:0/1129491981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20bc004ae0 0x7f20bc004f70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.240+0000 7f20de800700 1 -- 172.21.15.80:0/1129491981 >> 172.21.15.80:0/1129491981 conn(0x7f20d80cfa80 msgr2=0x7f20d80cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.240+0000 7fcd72a00700 1 -- 172.21.15.80:0/865740890 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c003680 con 0x7fcd7c06f4a0 2024-05-10T04:22:45.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.240+0000 7fcd72a00700 1 -- 172.21.15.80:0/865740890 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c003a30 con 0x7fcd7c06f4a0 2024-05-10T04:22:45.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.240+0000 7fcd81c00700 1 -- 172.21.15.80:0/865740890 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c14b450 con 0x7fcd7c06f4a0 2024-05-10T04:22:45.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.240+0000 7fcd81c00700 1 -- 172.21.15.80:0/865740890 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c14ba10 con 0x7fcd7c06f4a0 2024-05-10T04:22:45.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.240+0000 7fe9df600700 1 -- 172.21.15.80:0/1636758719 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d80b6f70 msgr2=0x7fe9d808b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.240+0000 7fe9df600700 1 --2- 172.21.15.80:0/1636758719 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d80b6f70 0x7fe9d808b1e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0098f0 tx=0x7fe9cc009c00 comp rx=0 tx=0).stop 2024-05-10T04:22:45.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.240+0000 7fe5f0c00700 1 Processor -- start 2024-05-10T04:22:45.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.241+0000 7fbe62400700 1 Processor -- start 2024-05-10T04:22:45.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.241+0000 7f20de800700 1 -- 172.21.15.80:0/1129491981 shutdown_connections 2024-05-10T04:22:45.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.241+0000 7f20de800700 1 -- 172.21.15.80:0/1129491981 wait complete. 2024-05-10T04:22:45.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.241+0000 7fbe62400700 1 -- start start 2024-05-10T04:22:45.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.241+0000 7f03b4200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0394005210 0x7f03ac1fed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.241+0000 7f2e34200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e2c0cf080 0x7f2e2c13f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.241+0000 7f03b4200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03ac161070 0x7f03ac0b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.241+0000 7fe5f0c00700 1 -- start start 2024-05-10T04:22:45.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.242+0000 7f03b4200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03ac15d9b0 0x7f03ac0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.241+0000 7fcd81c00700 1 -- 172.21.15.80:0/865740890 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcd7c0b46e0 con 0x7fcd7c06f4a0 2024-05-10T04:22:45.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.242+0000 7f03b4200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0b4cb0 con 0x7f03ac15d9b0 2024-05-10T04:22:45.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.242+0000 7f03b4200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac161500 con 0x7f03ac161070 2024-05-10T04:22:45.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.242+0000 7f03b4200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac161750 con 0x7f0394005210 2024-05-10T04:22:45.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.242+0000 7f03b0e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03ac161070 0x7f03ac0b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.242+0000 7f03b0e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03ac161070 0x7f03ac0b3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37174/0 (socket says 172.21.15.80:37174) 2024-05-10T04:22:45.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.242+0000 7f03b0e00700 1 -- 172.21.15.80:0/752139422 learned_addr learned my addr 172.21.15.80:0/752139422 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.242+0000 7f03b1800700 1 --2- 172.21.15.80:0/752139422 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0394005210 0x7f03ac1fed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.242+0000 7f03b0e00700 1 -- 172.21.15.80:0/752139422 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0394005210 msgr2=0x7f03ac1fed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.243+0000 7f03b2200700 1 --2- 172.21.15.80:0/752139422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03ac15d9b0 0x7f03ac0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.243+0000 7f2e31800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e2c0cf080 0x7f2e2c13f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.243+0000 7f03b0e00700 1 --2- 172.21.15.80:0/752139422 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0394005210 0x7f03ac1fed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.243+0000 7f03b0e00700 1 -- 172.21.15.80:0/752139422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03ac15d9b0 msgr2=0x7f03ac0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.243+0000 7f03b0e00700 1 --2- 172.21.15.80:0/752139422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03ac15d9b0 0x7f03ac0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.243+0000 7f03b0e00700 1 -- 172.21.15.80:0/752139422 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac0720f0 con 0x7f03ac161070 2024-05-10T04:22:45.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.243+0000 7f03b2200700 1 --2- 172.21.15.80:0/752139422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03ac15d9b0 0x7f03ac0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:22:45.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.244+0000 7f03b0e00700 1 --2- 172.21.15.80:0/752139422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03ac161070 0x7f03ac0b3eb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f03a0001200 tx=0x7f03a0007640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.244+0000 7f03b1800700 1 --2- 172.21.15.80:0/752139422 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0394005210 0x7f03ac1fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:45.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.243+0000 7f2e34200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0d05a0 0x7f2e2c0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.244+0000 7fcd72a00700 1 -- 172.21.15.80:0/865740890 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcd6c003b90 con 0x7fcd7c06f4a0 2024-05-10T04:22:45.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.244+0000 7fe9df600700 1 -- 172.21.15.80:0/1636758719 shutdown_connections 2024-05-10T04:22:45.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.244+0000 7fe9df600700 1 --2- 172.21.15.80:0/1636758719 >> v2:172.21.15.106:3300/0 conn(0x7fe9d8160e80 0x7fe9d80cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.244+0000 7fe9df600700 1 --2- 172.21.15.80:0/1636758719 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d80b6f70 0x7fe9d808b1e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.244+0000 7fe9df600700 1 -- 172.21.15.80:0/1636758719 >> 172.21.15.80:0/1636758719 conn(0x7fe9d80b35c0 msgr2=0x7fe9d80b39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.243+0000 7f2e34200700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2c13fdb0 con 0x7f2e2c140870 2024-05-10T04:22:45.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.243+0000 7f2e34200700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2c0cf890 con 0x7f2e2c0cf080 2024-05-10T04:22:45.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.243+0000 7f2e34200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c0cf5b0 con 0x7f2e2c0d05a0 2024-05-10T04:22:45.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.243+0000 7f2e32200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0d05a0 0x7f2e2c0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.243+0000 7f2e32200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0d05a0 0x7f2e2c0cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43082/0 (socket says 172.21.15.80:43082) 2024-05-10T04:22:45.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.243+0000 7f2e32200700 1 -- 172.21.15.80:0/1178751608 learned_addr learned my addr 172.21.15.80:0/1178751608 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.244+0000 7f2e2be00700 1 -- 172.21.15.80:0/1178751608 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732859278 0 0) 0x7f2e2c13fdb0 con 0x7f2e2c140870 2024-05-10T04:22:45.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.244+0000 7f2e2be00700 1 -- 172.21.15.80:0/1178751608 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e140035b0 con 0x7f2e2c140870 2024-05-10T04:22:45.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.244+0000 7f2e32200700 1 -- 172.21.15.80:0/1178751608 >> v2:172.21.15.80:3300/0 conn(0x7f2e2c0cf080 msgr2=0x7f2e2c13f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.244+0000 7f2e32200700 1 --2- 172.21.15.80:0/1178751608 >> v2:172.21.15.80:3300/0 conn(0x7f2e2c0cf080 0x7f2e2c13f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.244+0000 7f2e32200700 1 -- 172.21.15.80:0/1178751608 >> v1:172.21.15.106:6789/0 conn(0x7f2e2c140870 legacy=0x7f2e2c0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.244+0000 7f2e32200700 1 -- 172.21.15.80:0/1178751608 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c140070 con 0x7f2e2c0d05a0 2024-05-10T04:22:45.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.245+0000 7fbe5b400700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fbe5c15ee80 0x7fbe5c15a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:47148/0 (socket says 172.21.15.80:47148) 2024-05-10T04:22:45.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.244+0000 7f03a9600700 1 -- 172.21.15.80:0/752139422 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a000f8a0 con 0x7f03ac161070 2024-05-10T04:22:45.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.244+0000 7f03b4200700 1 -- 172.21.15.80:0/752139422 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ac15cbf0 con 0x7f03ac161070 2024-05-10T04:22:45.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.245+0000 7f03a9600700 1 -- 172.21.15.80:0/752139422 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a000fa00 con 0x7f03ac161070 2024-05-10T04:22:45.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.245+0000 7f03a9600700 1 -- 172.21.15.80:0/752139422 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a000fd70 con 0x7f03ac161070 2024-05-10T04:22:45.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.245+0000 7f03b4200700 1 -- 172.21.15.80:0/752139422 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ac15d1b0 con 0x7f03ac161070 2024-05-10T04:22:45.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.245+0000 7fe5f0c00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe5e4056830 0x7fe5e40e5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.246+0000 7fcd72a00700 1 --2- 172.21.15.80:0/865740890 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcd5c06ac90 0x7fcd5c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.246+0000 7fcd72a00700 1 -- 172.21.15.80:0/865740890 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd6c088860 con 0x7fcd7c06f4a0 2024-05-10T04:22:45.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.246+0000 7fcd72a00700 1 --2- 172.21.15.80:0/865740890 >> [v2:172.21.15.80:6800/41469,v1:172.21.15.80:6801/41469] conn(0x7fcd5c072e80 0x7fcd5c0752d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.246+0000 7fcd72a00700 1 -- 172.21.15.80:0/865740890 --> [v2:172.21.15.80:6800/41469,v1:172.21.15.80:6801/41469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd5c0759a0 con 0x7fcd5c072e80 2024-05-10T04:22:45.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.246+0000 7fcd72a00700 1 -- 172.21.15.80:0/865740890 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd6c08ae40 con 0x7fcd7c06f4a0 2024-05-10T04:22:45.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.246+0000 7fe5f0c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5e400a6c0 0x7fe5e4052690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.246+0000 7f20de800700 1 Processor -- start 2024-05-10T04:22:45.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.246+0000 7fe5f0c00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e4055fc0 con 0x7fe5e40e1960 2024-05-10T04:22:45.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.246+0000 7fe5f0c00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e40562a0 con 0x7fe5e4056830 2024-05-10T04:22:45.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.246+0000 7fe5eb400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe5e4056830 0x7fe5e40e5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.246+0000 7fe5f0c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e4056580 con 0x7fe5e400a6c0 2024-05-10T04:22:45.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.244+0000 7fe9df600700 1 -- 172.21.15.80:0/1636758719 shutdown_connections 2024-05-10T04:22:45.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.245+0000 7fe9df600700 1 -- 172.21.15.80:0/1636758719 wait complete. 2024-05-10T04:22:45.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.246+0000 7fe5eb400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe5e4056830 0x7fe5e40e5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52858/0 (socket says 172.21.15.80:52858) 2024-05-10T04:22:45.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.246+0000 7f20de800700 1 -- start start 2024-05-10T04:22:45.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.247+0000 7fcd7b400700 1 --2- 172.21.15.80:0/865740890 >> [v2:172.21.15.80:6800/41469,v1:172.21.15.80:6801/41469] conn(0x7fcd5c072e80 0x7fcd5c0752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.246+0000 7fbe62400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbe5c072630 0x7fbe5c0ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.247+0000 7fbe62400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c0cd6f0 con 0x7fbe5c0cdeb0 2024-05-10T04:22:45.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.247+0000 7fe5eaa00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe5e40e1960 0x7fe5e4009fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41498/0 (socket says 172.21.15.80:41498) 2024-05-10T04:22:45.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.247+0000 7fe5eaa00700 1 -- 172.21.15.80:0/3252480250 learned_addr learned my addr 172.21.15.80:0/3252480250 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:45.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.247+0000 7fe5ebe00700 1 --2- 172.21.15.80:0/3252480250 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5e400a6c0 0x7fe5e4052690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.247+0000 7fbe62400700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c0cbbf0 con 0x7fbe5c15ee80 2024-05-10T04:22:45.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.247+0000 7fbe62400700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5c0cbed0 con 0x7fbe5c072630 2024-05-10T04:22:45.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.247+0000 7f2e32200700 1 --2- 172.21.15.80:0/1178751608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0d05a0 0x7f2e2c0cd650 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2e200098f0 tx=0x7f2e20009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d736b79735c8d12 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.247+0000 7fbe5be00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbe5c072630 0x7fbe5c0ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.247+0000 7fbe5be00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbe5c072630 0x7fbe5c0ce2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37186/0 (socket says 172.21.15.80:37186) 2024-05-10T04:22:45.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.247+0000 7fbe5be00700 1 -- 172.21.15.80:0/4160632397 learned_addr learned my addr 172.21.15.80:0/4160632397 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.247+0000 7f2e2be00700 1 -- 172.21.15.80:0/1178751608 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20011830 con 0x7f2e2c0d05a0 2024-05-10T04:22:45.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.247+0000 7f2e2be00700 1 -- 172.21.15.80:0/1178751608 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e20011990 con 0x7f2e2c0d05a0 2024-05-10T04:22:45.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.247+0000 7f2e2be00700 1 -- 172.21.15.80:0/1178751608 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20011d20 con 0x7f2e2c0d05a0 2024-05-10T04:22:45.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.248+0000 7fbe5be00700 1 -- 172.21.15.80:0/4160632397 >> v1:172.21.15.106:6789/0 conn(0x7fbe5c15ee80 legacy=0x7fbe5c15a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.248+0000 7fbe5be00700 1 -- 172.21.15.80:0/4160632397 >> v1:172.21.15.80:6789/0 conn(0x7fbe5c0cdeb0 legacy=0x7fbe5c071f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T04:22:45.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.248+0000 7fe5ebe00700 1 -- 172.21.15.80:0/3252480250 >> v2:172.21.15.80:3300/0 conn(0x7fe5e4056830 msgr2=0x7fe5e40e5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.248+0000 7fe5ebe00700 1 --2- 172.21.15.80:0/3252480250 >> v2:172.21.15.80:3300/0 conn(0x7fe5e4056830 0x7fe5e40e5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.249+0000 7f2e34200700 1 -- 172.21.15.80:0/1178751608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0d05a0 msgr2=0x7f2e2c0cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.249+0000 7f2e34200700 1 --2- 172.21.15.80:0/1178751608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0d05a0 0x7f2e2c0cd650 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2e200098f0 tx=0x7f2e20009c00 comp rx=0 tx=0).stop 2024-05-10T04:22:45.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.249+0000 7fe5ebe00700 1 -- 172.21.15.80:0/3252480250 >> v1:172.21.15.80:6789/0 conn(0x7fe5e40e1960 legacy=0x7fe5e4009fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.249+0000 7fe5ea000700 1 -- 172.21.15.80:0/3252480250 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600052322 0 0) 0x7fe5e4055fc0 con 0x7fe5e40e1960 2024-05-10T04:22:45.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.249+0000 7fe5ebe00700 1 -- 172.21.15.80:0/3252480250 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e40e53e0 con 0x7fe5e400a6c0 2024-05-10T04:22:45.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.247+0000 7fcd7aa00700 1 --2- 172.21.15.80:0/865740890 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcd5c06ac90 0x7fcd5c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.248+0000 7fcd7aa00700 1 --2- 172.21.15.80:0/865740890 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcd5c06ac90 0x7fcd5c06d1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcd68000c00 tx=0x7fcd68008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.249+0000 7fe9df600700 1 Processor -- start 2024-05-10T04:22:45.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.250+0000 7fe9df600700 1 -- start start 2024-05-10T04:22:45.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.249+0000 7f2e34200700 1 -- 172.21.15.80:0/1178751608 shutdown_connections 2024-05-10T04:22:45.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.249+0000 7f2e34200700 1 --2- 172.21.15.80:0/1178751608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0d05a0 0x7f2e2c0cd650 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.249+0000 7f2e34200700 1 --2- 172.21.15.80:0/1178751608 >> v2:172.21.15.80:3300/0 conn(0x7f2e2c0cf080 0x7f2e2c13f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.249+0000 7f2e34200700 1 -- 172.21.15.80:0/1178751608 >> 172.21.15.80:0/1178751608 conn(0x7f2e2c0cfa80 msgr2=0x7f2e2c0cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.249+0000 7f2e34200700 1 -- 172.21.15.80:0/1178751608 shutdown_connections 2024-05-10T04:22:45.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.249+0000 7f2e34200700 1 -- 172.21.15.80:0/1178751608 wait complete. 2024-05-10T04:22:45.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.250+0000 7fcd7b400700 1 --2- 172.21.15.80:0/865740890 >> [v2:172.21.15.80:6800/41469,v1:172.21.15.80:6801/41469] conn(0x7fcd5c072e80 0x7fcd5c0752d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.250+0000 7fe5ebe00700 1 --2- 172.21.15.80:0/3252480250 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5e400a6c0 0x7fe5e4052690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec069bf0 tx=0x7fe5ec062770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d1cbe119f9493e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.250+0000 7fe5ea000700 1 -- 172.21.15.80:0/3252480250 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec068880 con 0x7fe5e400a6c0 2024-05-10T04:22:45.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.250+0000 7fe5ea000700 1 -- 172.21.15.80:0/3252480250 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec073280 con 0x7fe5e400a6c0 2024-05-10T04:22:45.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.250+0000 7fe5ea000700 1 -- 172.21.15.80:0/3252480250 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec092620 con 0x7fe5e400a6c0 2024-05-10T04:22:45.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.250+0000 7f20de800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20bc004ae0 0x7f20d81f85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.250+0000 7f20de800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20d8155230 0x7f20d8153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.250+0000 7f20de800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20d813dba0 0x7f20d81fc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.250+0000 7f20de800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d8155090 con 0x7f20d813dba0 2024-05-10T04:22:45.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.250+0000 7f20de800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d81fbbf0 con 0x7f20bc004ae0 2024-05-10T04:22:45.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.250+0000 7f20de800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d8154170 con 0x7f20d8155230 2024-05-10T04:22:45.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.251+0000 7f20d6a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20d8155230 0x7f20d8153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.251+0000 7f20d6a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20d8155230 0x7f20d8153760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43102/0 (socket says 172.21.15.80:43102) 2024-05-10T04:22:45.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.251+0000 7f20d6a00700 1 -- 172.21.15.80:0/3525603026 learned_addr learned my addr 172.21.15.80:0/3525603026 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.248+0000 7f03b4200700 1 -- 172.21.15.80:0/752139422 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0388000fc0 con 0x7f03ac161070 2024-05-10T04:22:45.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.249+0000 7fbe5be00700 1 -- 172.21.15.80:0/4160632397 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c0cd990 con 0x7fbe5c072630 2024-05-10T04:22:45.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.250+0000 7fbe5be00700 1 --2- 172.21.15.80:0/4160632397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe5c072630 0x7fbe5c0ce2c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe440098f0 tx=0x7fbe44009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1e0096dafa007 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.250+0000 7fbe5a000700 1 -- 172.21.15.80:0/4160632397 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44004230 con 0x7fbe5c072630 2024-05-10T04:22:45.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.250+0000 7fbe5a000700 1 -- 172.21.15.80:0/4160632397 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe44004390 con 0x7fbe5c072630 2024-05-10T04:22:45.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.250+0000 7fbe5a000700 1 -- 172.21.15.80:0/4160632397 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440036a0 con 0x7fbe5c072630 2024-05-10T04:22:45.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.251+0000 7f20d7e00700 1 --2- 172.21.15.80:0/3525603026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20d813dba0 0x7f20d81fc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.251+0000 7f20d6a00700 1 -- 172.21.15.80:0/3525603026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20bc004ae0 msgr2=0x7f20d81f85c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T04:22:45.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.251+0000 7f20d7400700 1 --2- 172.21.15.80:0/3525603026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20bc004ae0 0x7f20d81f85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.251+0000 7fbe62400700 1 -- 172.21.15.80:0/4160632397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe5c072630 msgr2=0x7fbe5c0ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.251+0000 7fe5f0c00700 1 -- 172.21.15.80:0/3252480250 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5e400a6c0 msgr2=0x7fe5e4052690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.251+0000 7fbe62400700 1 --2- 172.21.15.80:0/4160632397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe5c072630 0x7fbe5c0ce2c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe440098f0 tx=0x7fbe44009c00 comp rx=0 tx=0).stop 2024-05-10T04:22:45.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.252+0000 7fcd72a00700 1 -- 172.21.15.80:0/865740890 <== osd.0 v2:172.21.15.80:6800/41469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fcd5c0759a0 con 0x7fcd5c072e80 2024-05-10T04:22:45.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.251+0000 7fe5f0c00700 1 --2- 172.21.15.80:0/3252480250 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5e400a6c0 0x7fe5e4052690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec069bf0 tx=0x7fe5ec062770 comp rx=0 tx=0).stop 2024-05-10T04:22:45.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.251+0000 7f20d6a00700 1 --2- 172.21.15.80:0/3525603026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20bc004ae0 0x7f20d81f85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.251+0000 7f20d6a00700 1 -- 172.21.15.80:0/3525603026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20d813dba0 msgr2=0x7f20d81fc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.251+0000 7f20d6a00700 1 --2- 172.21.15.80:0/3525603026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20d813dba0 0x7f20d81fc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.251+0000 7f20d6a00700 1 -- 172.21.15.80:0/3525603026 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d81f8b70 con 0x7f20d8155230 2024-05-10T04:22:45.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.252+0000 7f20d7e00700 1 --2- 172.21.15.80:0/3525603026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20d813dba0 0x7f20d81fc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:45.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.252+0000 7fe5f0c00700 1 -- 172.21.15.80:0/3252480250 shutdown_connections 2024-05-10T04:22:45.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.252+0000 7fe5f0c00700 1 --2- 172.21.15.80:0/3252480250 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5e400a6c0 0x7fe5e4052690 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.252+0000 7f20d6a00700 1 --2- 172.21.15.80:0/3525603026 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20d8155230 0x7f20d8153760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f20c8003900 tx=0x7f20c8003cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.252+0000 7fe5f0c00700 1 --2- 172.21.15.80:0/3252480250 >> v2:172.21.15.80:3300/0 conn(0x7fe5e4056830 0x7fe5e40e5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.252+0000 7fe5f0c00700 1 -- 172.21.15.80:0/3252480250 >> 172.21.15.80:0/3252480250 conn(0x7fe5e400c450 msgr2=0x7fe5e400c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.252+0000 7fe5f0c00700 1 -- 172.21.15.80:0/3252480250 shutdown_connections 2024-05-10T04:22:45.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.252+0000 7fe5f0c00700 1 -- 172.21.15.80:0/3252480250 wait complete. 2024-05-10T04:22:45.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.252+0000 7f20cf400700 1 -- 172.21.15.80:0/3525603026 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8010960 con 0x7f20d8155230 2024-05-10T04:22:45.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.253+0000 7f20de800700 1 -- 172.21.15.80:0/3525603026 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d8153ca0 con 0x7f20d8155230 2024-05-10T04:22:45.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.253+0000 7f20de800700 1 -- 172.21.15.80:0/3525603026 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d81f90a0 con 0x7f20d8155230 2024-05-10T04:22:45.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.253+0000 7f20cf400700 1 -- 172.21.15.80:0/3525603026 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c8010ac0 con 0x7f20d8155230 2024-05-10T04:22:45.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.253+0000 7f20cf400700 1 -- 172.21.15.80:0/3525603026 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8010e50 con 0x7f20d8155230 2024-05-10T04:22:45.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.250+0000 7f03a9600700 1 -- 172.21.15.80:0/752139422 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f03a001d460 con 0x7f03ac161070 2024-05-10T04:22:45.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.252+0000 7f03a9600700 1 --2- 172.21.15.80:0/752139422 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f039006ad20 0x7f039006d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.252+0000 7f03a9600700 1 -- 172.21.15.80:0/752139422 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03a0089440 con 0x7f03ac161070 2024-05-10T04:22:45.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.253+0000 7f03a9600700 1 --2- 172.21.15.80:0/752139422 >> [v2:172.21.15.106:6800/41891,v1:172.21.15.106:6801/41891] conn(0x7f0390072f10 0x7f0390075360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.253+0000 7f03a9600700 1 -- 172.21.15.80:0/752139422 --> [v2:172.21.15.106:6800/41891,v1:172.21.15.106:6801/41891] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0390075a30 con 0x7f0390072f10 2024-05-10T04:22:45.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.253+0000 7f2e34200700 1 Processor -- start 2024-05-10T04:22:45.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.253+0000 7fbe62400700 1 -- 172.21.15.80:0/4160632397 shutdown_connections 2024-05-10T04:22:45.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.253+0000 7fbe62400700 1 --2- 172.21.15.80:0/4160632397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe5c072630 0x7fbe5c0ce2c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.254+0000 7fbe62400700 1 -- 172.21.15.80:0/4160632397 >> 172.21.15.80:0/4160632397 conn(0x7fbe5c0cfa80 msgr2=0x7fbe5c0cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.254+0000 7fe9df600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d808b720 0x7fe9d815fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.254+0000 7f2e34200700 1 -- start start 2024-05-10T04:22:45.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.254+0000 7fe9df600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d80b6f70 0x7fe9d81ecbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.254+0000 7fe9df600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9d8160e80 0x7fe9d80c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.254+0000 7fe9dcc00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d808b720 0x7fe9d815fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.254+0000 7fe9dcc00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d808b720 0x7fe9d815fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37214/0 (socket says 172.21.15.80:37214) 2024-05-10T04:22:45.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.255+0000 7f03b1800700 1 --2- 172.21.15.80:0/752139422 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f039006ad20 0x7f039006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.255+0000 7fe9d7e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d80b6f70 0x7fe9d81ecbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.255+0000 7fe9d7e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d80b6f70 0x7fe9d81ecbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43104/0 (socket says 172.21.15.80:43104) 2024-05-10T04:22:45.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.255+0000 7f03b2200700 1 --2- 172.21.15.80:0/752139422 >> [v2:172.21.15.106:6800/41891,v1:172.21.15.106:6801/41891] conn(0x7f0390072f10 0x7f0390075360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.255+0000 7f03a9600700 1 -- 172.21.15.80:0/752139422 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03a000fd70 con 0x7f03ac161070 2024-05-10T04:22:45.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.255+0000 7f20de800700 1 -- 172.21.15.80:0/3525603026 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f20b0000fc0 con 0x7f20d8155230 2024-05-10T04:22:45.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.256+0000 7f03b2200700 1 --2- 172.21.15.80:0/752139422 >> [v2:172.21.15.106:6800/41891,v1:172.21.15.106:6801/41891] conn(0x7f0390072f10 0x7f0390075360 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.256+0000 7f03b1800700 1 --2- 172.21.15.80:0/752139422 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f039006ad20 0x7f039006d230 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f03ac068410 tx=0x7f03a40094f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.256+0000 7f2e34200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e2c0cf080 0x7f2e2c153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.256+0000 7f2e34200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0d05a0 0x7f2e2c140ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7f2e34200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e2c140870 0x7f2e2c13e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7f2e34200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c141ae0 con 0x7f2e2c0cf080 2024-05-10T04:22:45.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7f2e34200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c13d6c0 con 0x7f2e2c140870 2024-05-10T04:22:45.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7f2e34200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c13d910 con 0x7f2e2c0d05a0 2024-05-10T04:22:45.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7f20cf400700 1 -- 172.21.15.80:0/3525603026 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f20c8013470 con 0x7f20d8155230 2024-05-10T04:22:45.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7fe5f0c00700 1 Processor -- start 2024-05-10T04:22:45.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7f2e30e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0d05a0 0x7f2e2c140ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7f2e30e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0d05a0 0x7f2e2c140ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43110/0 (socket says 172.21.15.80:43110) 2024-05-10T04:22:45.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7f2e30e00700 1 -- 172.21.15.80:0/3855051384 learned_addr learned my addr 172.21.15.80:0/3855051384 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7f2e32200700 1 --2- 172.21.15.80:0/3855051384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e2c140870 0x7f2e2c13e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7f2e31800700 1 --2- 172.21.15.80:0/3855051384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e2c0cf080 0x7f2e2c153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.258+0000 7f20cf400700 1 --2- 172.21.15.80:0/3525603026 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f20b806ac90 0x7f20b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.258+0000 7f2e32200700 1 -- 172.21.15.80:0/3855051384 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0d05a0 msgr2=0x7f2e2c140ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.258+0000 7f2e32200700 1 --2- 172.21.15.80:0/3855051384 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0d05a0 0x7f2e2c140ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.258+0000 7f2e32200700 1 -- 172.21.15.80:0/3855051384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e2c0cf080 msgr2=0x7f2e2c153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.258+0000 7f2e32200700 1 --2- 172.21.15.80:0/3855051384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e2c0cf080 0x7f2e2c153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.258+0000 7f2e32200700 1 -- 172.21.15.80:0/3855051384 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e20009550 con 0x7f2e2c140870 2024-05-10T04:22:45.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.258+0000 7f20cf400700 1 -- 172.21.15.80:0/3525603026 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20c80897b0 con 0x7f20d8155230 2024-05-10T04:22:45.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.258+0000 7f03a9600700 1 -- 172.21.15.80:0/752139422 <== osd.4 v2:172.21.15.106:6800/41891 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0390075a30 con 0x7f0390072f10 2024-05-10T04:22:45.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.256+0000 7fe9dcc00700 1 -- 172.21.15.80:0/3585163033 learned_addr learned my addr 172.21.15.80:0/3585163033 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.256+0000 7fe9df600700 1 -- 172.21.15.80:0/3585163033 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d80b48b0 con 0x7fe9d8160e80 2024-05-10T04:22:45.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.256+0000 7fe9df600700 1 -- 172.21.15.80:0/3585163033 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d80cb760 con 0x7fe9d808b720 2024-05-10T04:22:45.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.256+0000 7fe9df600700 1 -- 172.21.15.80:0/3585163033 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d81602d0 con 0x7fe9d80b6f70 2024-05-10T04:22:45.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.256+0000 7fe9dd600700 1 --2- 172.21.15.80:0/3585163033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9d8160e80 0x7fe9d80c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.256+0000 7fe9dcc00700 1 -- 172.21.15.80:0/3585163033 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d80b6f70 msgr2=0x7fe9d81ecbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.256+0000 7fe9dcc00700 1 --2- 172.21.15.80:0/3585163033 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d80b6f70 0x7fe9d81ecbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.256+0000 7fe9dcc00700 1 -- 172.21.15.80:0/3585163033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9d8160e80 msgr2=0x7fe9d80c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.256+0000 7fe9dcc00700 1 --2- 172.21.15.80:0/3585163033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9d8160e80 0x7fe9d80c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.256+0000 7fe9dcc00700 1 -- 172.21.15.80:0/3585163033 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc009550 con 0x7fe9d808b720 2024-05-10T04:22:45.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7fe9dcc00700 1 --2- 172.21.15.80:0/3585163033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d808b720 0x7fe9d815fd90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80cdf00 tx=0x7fe9cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7fe9d4c00700 1 -- 172.21.15.80:0/3585163033 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc003cf0 con 0x7fe9d808b720 2024-05-10T04:22:45.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7fe9d4c00700 1 -- 172.21.15.80:0/3585163033 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc003e50 con 0x7fe9d808b720 2024-05-10T04:22:45.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7fe9d4c00700 1 -- 172.21.15.80:0/3585163033 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc011850 con 0x7fe9d808b720 2024-05-10T04:22:45.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7fe9df600700 1 -- 172.21.15.80:0/3585163033 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d80b6d00 con 0x7fe9d808b720 2024-05-10T04:22:45.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7fe9df600700 1 -- 172.21.15.80:0/3585163033 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d80b6a20 con 0x7fe9d808b720 2024-05-10T04:22:45.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.259+0000 7f20cf400700 1 --2- 172.21.15.80:0/3525603026 >> [v2:172.21.15.80:6808/41473,v1:172.21.15.80:6809/41473] conn(0x7f20b8072f00 0x7f20b8075350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.259+0000 7f20cf400700 1 -- 172.21.15.80:0/3525603026 --> [v2:172.21.15.80:6808/41473,v1:172.21.15.80:6809/41473] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20b8075a20 con 0x7f20b8072f00 2024-05-10T04:22:45.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.259+0000 7f20cf400700 1 -- 172.21.15.80:0/3525603026 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20c808e2a0 con 0x7f20d8155230 2024-05-10T04:22:45.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.259+0000 7f20d7400700 1 --2- 172.21.15.80:0/3525603026 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f20b806ac90 0x7f20b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.259+0000 7f2e32200700 1 --2- 172.21.15.80:0/3855051384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e2c140870 0x7f2e2c13e9b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2e20016000 tx=0x7f2e20004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.255+0000 7fbe62400700 1 -- 172.21.15.80:0/4160632397 shutdown_connections 2024-05-10T04:22:45.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.255+0000 7fbe62400700 1 -- 172.21.15.80:0/4160632397 wait complete. 2024-05-10T04:22:45.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.259+0000 7f20d7e00700 1 --2- 172.21.15.80:0/3525603026 >> [v2:172.21.15.80:6808/41473,v1:172.21.15.80:6809/41473] conn(0x7f20b8072f00 0x7f20b8075350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.259+0000 7fe9df600700 1 -- 172.21.15.80:0/3585163033 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe9b4000fc0 con 0x7fe9d808b720 2024-05-10T04:22:45.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.259+0000 7f2e29600700 1 -- 172.21.15.80:0/3855051384 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20004450 con 0x7f2e2c140870 2024-05-10T04:22:45.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.259+0000 7f2e29600700 1 -- 172.21.15.80:0/3855051384 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2001f070 con 0x7f2e2c140870 2024-05-10T04:22:45.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.259+0000 7f2e29600700 1 -- 172.21.15.80:0/3855051384 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e200038a0 con 0x7f2e2c140870 2024-05-10T04:22:45.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.257+0000 7fe5f0c00700 1 -- start start 2024-05-10T04:22:45.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.260+0000 7fe5f0c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5e4056830 0x7fe5e40dd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.260+0000 7fbe62400700 1 Processor -- start 2024-05-10T04:22:45.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.260+0000 7fe5f0c00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5e40e1960 0x7fe5e404cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.260+0000 7fbe62400700 1 -- start start 2024-05-10T04:22:45.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.260+0000 7fe5f0c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5e4052060 0x7fe5e404d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.260+0000 7fe5f0c00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40e4c60 con 0x7fe5e4056830 2024-05-10T04:22:45.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.260+0000 7f20d7400700 1 --2- 172.21.15.80:0/3525603026 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f20b806ac90 0x7f20b806d1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f20c400d380 tx=0x7f20c400b000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.260+0000 7fe5f0c00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e4179b70 con 0x7fe5e40e1960 2024-05-10T04:22:45.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.260+0000 7fe5f0c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e4050d70 con 0x7fe5e4052060 2024-05-10T04:22:45.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.261+0000 7fe5ebe00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5e4052060 0x7fe5e404d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.261+0000 7fe5ebe00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5e4052060 0x7fe5e404d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43124/0 (socket says 172.21.15.80:43124) 2024-05-10T04:22:45.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.261+0000 7fe5ebe00700 1 -- 172.21.15.80:0/2077510597 learned_addr learned my addr 172.21.15.80:0/2077510597 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.261+0000 7fe5eaa00700 1 --2- 172.21.15.80:0/2077510597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5e40e1960 0x7fe5e404cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.261+0000 7f20d7e00700 1 --2- 172.21.15.80:0/3525603026 >> [v2:172.21.15.80:6808/41473,v1:172.21.15.80:6809/41473] conn(0x7f20b8072f00 0x7f20b8075350 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.261+0000 7fe5ebe00700 1 -- 172.21.15.80:0/2077510597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5e40e1960 msgr2=0x7fe5e404cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.261+0000 7fe5ebe00700 1 --2- 172.21.15.80:0/2077510597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5e40e1960 0x7fe5e404cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.261+0000 7fe5ebe00700 1 -- 172.21.15.80:0/2077510597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5e4056830 msgr2=0x7fe5e40dd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.261+0000 7fe5ebe00700 1 --2- 172.21.15.80:0/2077510597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5e4056830 0x7fe5e40dd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.261+0000 7fe5ebe00700 1 -- 172.21.15.80:0/2077510597 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec073ea0 con 0x7fe5e4052060 2024-05-10T04:22:45.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.262+0000 7fe5ebe00700 1 --2- 172.21.15.80:0/2077510597 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5e4052060 0x7fe5e404d110 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec04fb30 tx=0x7fe5ec073d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.262+0000 7fe9d4c00700 1 -- 172.21.15.80:0/3585163033 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe9cc0119b0 con 0x7fe9d808b720 2024-05-10T04:22:45.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.262+0000 7fe5df400700 1 -- 172.21.15.80:0/2077510597 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0a1070 con 0x7fe5e4052060 2024-05-10T04:22:45.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.262+0000 7fe5df400700 1 -- 172.21.15.80:0/2077510597 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec097040 con 0x7fe5e4052060 2024-05-10T04:22:45.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.262+0000 7fe5df400700 1 -- 172.21.15.80:0/2077510597 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec096050 con 0x7fe5e4052060 2024-05-10T04:22:45.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.262+0000 7f20cf400700 1 -- 172.21.15.80:0/3525603026 <== osd.3 v2:172.21.15.80:6808/41473 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f20b8075a20 con 0x7f20b8072f00 2024-05-10T04:22:45.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.262+0000 7fe5f0c00700 1 -- 172.21.15.80:0/2077510597 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e4051050 con 0x7fe5e4052060 2024-05-10T04:22:45.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.262+0000 7fe5f0c00700 1 -- 172.21.15.80:0/2077510597 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e4179990 con 0x7fe5e4052060 2024-05-10T04:22:45.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.263+0000 7fe9d4c00700 1 --2- 172.21.15.80:0/3585163033 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe9b806ace0 0x7fe9b806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.263+0000 7fe9d4c00700 1 -- 172.21.15.80:0/3585163033 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9cc08aef0 con 0x7fe9d808b720 2024-05-10T04:22:45.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.263+0000 7fe9d4c00700 1 --2- 172.21.15.80:0/3585163033 >> [v2:172.21.15.80:6817/41471,v1:172.21.15.80:6819/41471] conn(0x7fe9b8072f50 0x7fe9b80753a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.263+0000 7fe9d4c00700 1 -- 172.21.15.80:0/3585163033 --> [v2:172.21.15.80:6817/41471,v1:172.21.15.80:6819/41471] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe9b8075a70 con 0x7fe9b8072f50 2024-05-10T04:22:45.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.263+0000 7fe9d4c00700 1 -- 172.21.15.80:0/3585163033 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9cc08b260 con 0x7fe9d808b720 2024-05-10T04:22:45.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.264+0000 7fbe62400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe5c0cdeb0 0x7fbe5c157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.264+0000 7fbe62400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c15ee80 0x7fbe5c200b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.263+0000 7fe5f0c00700 1 -- 172.21.15.80:0/2077510597 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe5c8000fc0 con 0x7fe5e4052060 2024-05-10T04:22:45.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.265+0000 7fe9dd600700 1 --2- 172.21.15.80:0/3585163033 >> [v2:172.21.15.80:6817/41471,v1:172.21.15.80:6819/41471] conn(0x7fe9b8072f50 0x7fe9b80753a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.265+0000 7fe9d7e00700 1 --2- 172.21.15.80:0/3585163033 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe9b806ace0 0x7fe9b806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.263+0000 7f2e34200700 1 -- 172.21.15.80:0/3855051384 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e2c13dbf0 con 0x7f2e2c140870 2024-05-10T04:22:45.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.263+0000 7f2e34200700 1 -- 172.21.15.80:0/3855051384 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2c13e1b0 con 0x7f2e2c140870 2024-05-10T04:22:45.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.265+0000 7fbe5aa00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c15ee80 0x7fbe5c200b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.265+0000 7fbe5b400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe5c0cdeb0 0x7fbe5c157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.265+0000 7fbe5b400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe5c0cdeb0 0x7fbe5c157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43126/0 (socket says 172.21.15.80:43126) 2024-05-10T04:22:45.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.265+0000 7fbe5aa00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c15ee80 0x7fbe5c200b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52916/0 (socket says 172.21.15.80:52916) 2024-05-10T04:22:45.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.265+0000 7fbe62400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe5c1488b0 0x7fbe5c1517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.265+0000 7fe9dd600700 1 --2- 172.21.15.80:0/3585163033 >> [v2:172.21.15.80:6817/41471,v1:172.21.15.80:6819/41471] conn(0x7fe9b8072f50 0x7fe9b80753a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.266+0000 7fbe5aa00700 1 -- 172.21.15.80:0/1820759286 learned_addr learned my addr 172.21.15.80:0/1820759286 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.266+0000 7fe9d7e00700 1 --2- 172.21.15.80:0/3585163033 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe9b806ace0 0x7fe9b806d1f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80c9180 tx=0x7fe9c4007b90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.266+0000 7fbe62400700 1 -- 172.21.15.80:0/1820759286 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c152ce0 con 0x7fbe5c15ee80 2024-05-10T04:22:45.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.266+0000 7fbe62400700 1 -- 172.21.15.80:0/1820759286 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c15d150 con 0x7fbe5c1488b0 2024-05-10T04:22:45.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.266+0000 7fbe5be00700 1 --2- 172.21.15.80:0/1820759286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe5c1488b0 0x7fbe5c1517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.266+0000 7fbe62400700 1 -- 172.21.15.80:0/1820759286 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c15d3a0 con 0x7fbe5c0cdeb0 2024-05-10T04:22:45.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.267+0000 7fe5df400700 1 -- 172.21.15.80:0/2077510597 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe5ec0a6410 con 0x7fe5e4052060 2024-05-10T04:22:45.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.268+0000 7fe9d4c00700 1 -- 172.21.15.80:0/3585163033 <== osd.2 v2:172.21.15.80:6817/41471 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe9b8075a70 con 0x7fe9b8072f50 2024-05-10T04:22:45.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.266+0000 7f2e34200700 1 -- 172.21.15.80:0/3855051384 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2e08000fc0 con 0x7f2e2c140870 2024-05-10T04:22:45.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.267+0000 7fbe5aa00700 1 -- 172.21.15.80:0/1820759286 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe5c0cdeb0 msgr2=0x7fbe5c157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.267+0000 7fbe5aa00700 1 --2- 172.21.15.80:0/1820759286 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe5c0cdeb0 0x7fbe5c157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.267+0000 7fbe5aa00700 1 -- 172.21.15.80:0/1820759286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe5c1488b0 msgr2=0x7fbe5c1517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.267+0000 7fbe5aa00700 1 --2- 172.21.15.80:0/1820759286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe5c1488b0 0x7fbe5c1517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.267+0000 7fbe5aa00700 1 -- 172.21.15.80:0/1820759286 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe44009550 con 0x7fbe5c15ee80 2024-05-10T04:22:45.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.267+0000 7fbe5be00700 1 --2- 172.21.15.80:0/1820759286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe5c1488b0 0x7fbe5c1517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:45.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.268+0000 7fbe5aa00700 1 --2- 172.21.15.80:0/1820759286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c15ee80 0x7fbe5c200b70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00b9b0 tx=0x7fbe4c00bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.268+0000 7fe5df400700 1 --2- 172.21.15.80:0/2077510597 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe5cc06ad60 0x7fe5cc06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.268+0000 7fc1d8a00700 1 Processor -- start 2024-05-10T04:22:45.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.268+0000 7fe5df400700 1 -- 172.21.15.80:0/2077510597 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5ec105280 con 0x7fe5e4052060 2024-05-10T04:22:45.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.269+0000 7fbe53400700 1 -- 172.21.15.80:0/1820759286 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c00d8e0 con 0x7fbe5c15ee80 2024-05-10T04:22:45.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.269+0000 7fbe53400700 1 -- 172.21.15.80:0/1820759286 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c00da40 con 0x7fbe5c15ee80 2024-05-10T04:22:45.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.269+0000 7fbe53400700 1 -- 172.21.15.80:0/1820759286 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c00ddf0 con 0x7fbe5c15ee80 2024-05-10T04:22:45.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.269+0000 7fe5df400700 1 --2- 172.21.15.80:0/2077510597 >> [v2:172.21.15.80:6816/41472,v1:172.21.15.80:6818/41472] conn(0x7fe5cc072fd0 0x7fe5cc075420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.269+0000 7fe5eb400700 1 --2- 172.21.15.80:0/2077510597 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe5cc06ad60 0x7fe5cc06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.269+0000 7fe5df400700 1 -- 172.21.15.80:0/2077510597 --> [v2:172.21.15.80:6816/41472,v1:172.21.15.80:6818/41472] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe5cc075af0 con 0x7fe5cc072fd0 2024-05-10T04:22:45.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.269+0000 7fe5df400700 1 -- 172.21.15.80:0/2077510597 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5ec1078a0 con 0x7fe5e4052060 2024-05-10T04:22:45.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.269+0000 7fc1d8a00700 1 -- start start 2024-05-10T04:22:45.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.270+0000 7fe5eb400700 1 --2- 172.21.15.80:0/2077510597 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe5cc06ad60 0x7fe5cc06d270 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe5e404a700 tx=0x7fe5e00095a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.269+0000 7fbe62400700 1 -- 172.21.15.80:0/1820759286 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5c15d680 con 0x7fbe5c15ee80 2024-05-10T04:22:45.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.269+0000 7fbe62400700 1 -- 172.21.15.80:0/1820759286 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c15dc40 con 0x7fbe5c15ee80 2024-05-10T04:22:45.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.270+0000 7fbe62400700 1 -- 172.21.15.80:0/1820759286 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe34000fc0 con 0x7fbe5c15ee80 2024-05-10T04:22:45.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.271+0000 7fc1d8a00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc1d40cf7f0 0x7fc1d409ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.271+0000 7fc1d8a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc1d40d06f0 0x7fc1d40cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.271+0000 7fc1d8a00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d40d0e50 con 0x7fc1d40d02e0 2024-05-10T04:22:45.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.271+0000 7fc1d8a00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d40b6b20 con 0x7fc1d40d06f0 2024-05-10T04:22:45.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.271+0000 7fc1d8a00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d40b7750 con 0x7fc1d40cf7f0 2024-05-10T04:22:45.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.271+0000 7fc1d1e00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc1d40cf7f0 0x7fc1d409ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.271+0000 7fc1d1e00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc1d40cf7f0 0x7fc1d409ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37270/0 (socket says 172.21.15.80:37270) 2024-05-10T04:22:45.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.271+0000 7fc1d1e00700 1 -- 172.21.15.80:0/3794042623 learned_addr learned my addr 172.21.15.80:0/3794042623 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.272+0000 7fc1d1e00700 1 -- 172.21.15.80:0/3794042623 >> v2:172.21.15.80:3300/0 conn(0x7fc1d40d06f0 msgr2=0x7fc1d40cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.272+0000 7fc1d1e00700 1 --2- 172.21.15.80:0/3794042623 >> v2:172.21.15.80:3300/0 conn(0x7fc1d40d06f0 0x7fc1d40cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.272+0000 7fc1d1e00700 1 -- 172.21.15.80:0/3794042623 >> v1:172.21.15.106:6789/0 conn(0x7fc1d40d02e0 legacy=0x7fc1d40b5430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T04:22:45.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.272+0000 7fc1d1e00700 1 -- 172.21.15.80:0/3794042623 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d40cf1c0 con 0x7fc1d40cf7f0 2024-05-10T04:22:45.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.272+0000 7fc1d1e00700 1 --2- 172.21.15.80:0/3794042623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc1d40cf7f0 0x7fc1d409ae30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc1d404efb0 tx=0x7fc1c0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63020dc12ba36a97 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.272+0000 7fc1d0a00700 1 -- 172.21.15.80:0/3794042623 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0005e30 con 0x7fc1d40cf7f0 2024-05-10T04:22:45.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.272+0000 7fc1d0a00700 1 -- 172.21.15.80:0/3794042623 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c0006030 con 0x7fc1d40cf7f0 2024-05-10T04:22:45.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.272+0000 7fc1d0a00700 1 -- 172.21.15.80:0/3794042623 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c00063e0 con 0x7fc1d40cf7f0 2024-05-10T04:22:45.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.273+0000 7fe5eaa00700 1 --2- 172.21.15.80:0/2077510597 >> [v2:172.21.15.80:6816/41472,v1:172.21.15.80:6818/41472] conn(0x7fe5cc072fd0 0x7fe5cc075420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.273+0000 7fc1d8a00700 1 -- 172.21.15.80:0/3794042623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc1d40cf7f0 msgr2=0x7fc1d409ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.273+0000 7fc1d8a00700 1 --2- 172.21.15.80:0/3794042623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc1d40cf7f0 0x7fc1d409ae30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc1d404efb0 tx=0x7fc1c0009bd0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.273+0000 7fc1d8a00700 1 -- 172.21.15.80:0/3794042623 shutdown_connections 2024-05-10T04:22:45.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.273+0000 7fc1d8a00700 1 --2- 172.21.15.80:0/3794042623 >> v2:172.21.15.80:3300/0 conn(0x7fc1d40d06f0 0x7fc1d40cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.273+0000 7fc1d8a00700 1 --2- 172.21.15.80:0/3794042623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc1d40cf7f0 0x7fc1d409ae30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.273+0000 7fc1d8a00700 1 -- 172.21.15.80:0/3794042623 >> 172.21.15.80:0/3794042623 conn(0x7fc1d40ce6a0 msgr2=0x7fc1d40ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.273+0000 7fc1d8a00700 1 -- 172.21.15.80:0/3794042623 shutdown_connections 2024-05-10T04:22:45.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.274+0000 7f2e29600700 1 -- 172.21.15.80:0/3855051384 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2e20003a00 con 0x7f2e2c140870 2024-05-10T04:22:45.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.274+0000 7fc1d8a00700 1 -- 172.21.15.80:0/3794042623 wait complete. 2024-05-10T04:22:45.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.275+0000 7fe5eaa00700 1 --2- 172.21.15.80:0/2077510597 >> [v2:172.21.15.80:6816/41472,v1:172.21.15.80:6818/41472] conn(0x7fe5cc072fd0 0x7fe5cc075420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.275+0000 7f2e29600700 1 --2- 172.21.15.80:0/3855051384 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2e0c06ad60 0x7f2e0c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.275+0000 7f2e29600700 1 -- 172.21.15.80:0/3855051384 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e20021070 con 0x7f2e2c140870 2024-05-10T04:22:45.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.275+0000 7f2e29600700 1 --2- 172.21.15.80:0/3855051384 >> [v2:172.21.15.106:6816/41893,v1:172.21.15.106:6817/41893] conn(0x7f2e0c072fd0 0x7f2e0c075420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.275+0000 7f2e29600700 1 -- 172.21.15.80:0/3855051384 --> [v2:172.21.15.106:6816/41893,v1:172.21.15.106:6817/41893] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2e0c075af0 con 0x7f2e0c072fd0 2024-05-10T04:22:45.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.275+0000 7f2e29600700 1 -- 172.21.15.80:0/3855051384 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e2008cdf0 con 0x7f2e2c140870 2024-05-10T04:22:45.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.276+0000 7f2e30e00700 1 --2- 172.21.15.80:0/3855051384 >> [v2:172.21.15.106:6816/41893,v1:172.21.15.106:6817/41893] conn(0x7f2e0c072fd0 0x7f2e0c075420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.277+0000 7fc1d8a00700 1 Processor -- start 2024-05-10T04:22:45.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.276+0000 7f2e31800700 1 --2- 172.21.15.80:0/3855051384 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2e0c06ad60 0x7f2e0c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.277+0000 7f2e30e00700 1 --2- 172.21.15.80:0/3855051384 >> [v2:172.21.15.106:6816/41893,v1:172.21.15.106:6817/41893] conn(0x7f2e0c072fd0 0x7f2e0c075420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.277+0000 7fc1d8a00700 1 -- start start 2024-05-10T04:22:45.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.278+0000 7f2e29600700 1 -- 172.21.15.80:0/3855051384 <== osd.6 v2:172.21.15.106:6816/41893 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2e0c075af0 con 0x7f2e0c072fd0 2024-05-10T04:22:45.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.278+0000 7f2e31800700 1 --2- 172.21.15.80:0/3855051384 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2e0c06ad60 0x7f2e0c06d270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400f360 tx=0x7f2e24007710 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.279+0000 7fc1d8a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc1d40cf7f0 0x7fc1d40af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.279+0000 7fc1d8a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1d40d02e0 0x7fc1d409cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.279+0000 7fc1d8a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc1d40d06f0 0x7fc1d409e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.279+0000 7fc1d8a00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d409c6a0 con 0x7fc1d40d02e0 2024-05-10T04:22:45.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.279+0000 7fc1d8a00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d409ef70 con 0x7fc1d40cf7f0 2024-05-10T04:22:45.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.279+0000 7fc1d8a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d41de600 con 0x7fc1d40d06f0 2024-05-10T04:22:45.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.280+0000 7fc1d1e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc1d40cf7f0 0x7fc1d40af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.280+0000 7fc1d1e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc1d40cf7f0 0x7fc1d40af6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37282/0 (socket says 172.21.15.80:37282) 2024-05-10T04:22:45.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.280+0000 7fc1d1e00700 1 -- 172.21.15.80:0/2669871288 learned_addr learned my addr 172.21.15.80:0/2669871288 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.280+0000 7fc1d2800700 1 --2- 172.21.15.80:0/2669871288 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc1d40d06f0 0x7fc1d409e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.280+0000 7fc1d1400700 1 --2- 172.21.15.80:0/2669871288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1d40d02e0 0x7fc1d409cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.281+0000 7fc1d1e00700 1 -- 172.21.15.80:0/2669871288 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc1d40d06f0 msgr2=0x7fc1d409e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.281+0000 7fc1d1e00700 1 --2- 172.21.15.80:0/2669871288 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc1d40d06f0 0x7fc1d409e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.281+0000 7fc1d1e00700 1 -- 172.21.15.80:0/2669871288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1d40d02e0 msgr2=0x7fc1d409cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.281+0000 7fc1d1e00700 1 --2- 172.21.15.80:0/2669871288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1d40d02e0 0x7fc1d409cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.281+0000 7fc1d1e00700 1 -- 172.21.15.80:0/2669871288 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c0009500 con 0x7fc1d40cf7f0 2024-05-10T04:22:45.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.281+0000 7fe5df400700 1 -- 172.21.15.80:0/2077510597 <== osd.1 v2:172.21.15.80:6816/41472 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe5cc075af0 con 0x7fe5cc072fd0 2024-05-10T04:22:45.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.281+0000 7fc1d1e00700 1 --2- 172.21.15.80:0/2669871288 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc1d40cf7f0 0x7fc1d40af6d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0000c00 tx=0x7fc1c0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.282+0000 7fbe53400700 1 -- 172.21.15.80:0/1820759286 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbe4c015420 con 0x7fbe5c15ee80 2024-05-10T04:22:45.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.283+0000 7fc1ca000700 1 -- 172.21.15.80:0/2669871288 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0006920 con 0x7fc1d40cf7f0 2024-05-10T04:22:45.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.283+0000 7fc1ca000700 1 -- 172.21.15.80:0/2669871288 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c0020070 con 0x7fc1d40cf7f0 2024-05-10T04:22:45.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.283+0000 7fc1ca000700 1 -- 172.21.15.80:0/2669871288 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0025670 con 0x7fc1d40cf7f0 2024-05-10T04:22:45.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.283+0000 7fc1d8a00700 1 -- 172.21.15.80:0/2669871288 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d409f1c0 con 0x7fc1d40cf7f0 2024-05-10T04:22:45.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.283+0000 7fc1d8a00700 1 -- 172.21.15.80:0/2669871288 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d40aebf0 con 0x7fc1d40cf7f0 2024-05-10T04:22:45.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.283+0000 7fbe53400700 1 --2- 172.21.15.80:0/1820759286 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fbe3806ad60 0x7fbe3806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.283+0000 7fbe53400700 1 -- 172.21.15.80:0/1820759286 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe4c011070 con 0x7fbe5c15ee80 2024-05-10T04:22:45.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.284+0000 7fbe53400700 1 --2- 172.21.15.80:0/1820759286 >> [v2:172.21.15.106:6808/41892,v1:172.21.15.106:6809/41892] conn(0x7fbe38072fd0 0x7fbe38075420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.284+0000 7fbe53400700 1 -- 172.21.15.80:0/1820759286 --> [v2:172.21.15.106:6808/41892,v1:172.21.15.106:6809/41892] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe38075af0 con 0x7fbe38072fd0 2024-05-10T04:22:45.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.284+0000 7fbe53400700 1 -- 172.21.15.80:0/1820759286 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe4c089f00 con 0x7fbe5c15ee80 2024-05-10T04:22:45.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.284+0000 7fbe5be00700 1 --2- 172.21.15.80:0/1820759286 >> [v2:172.21.15.106:6808/41892,v1:172.21.15.106:6809/41892] conn(0x7fbe38072fd0 0x7fbe38075420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.284+0000 7fbe5b400700 1 --2- 172.21.15.80:0/1820759286 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fbe3806ad60 0x7fbe3806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.285+0000 7fc1bf400700 1 -- 172.21.15.80:0/2669871288 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc1d40cdbb0 con 0x7fc1d40cf7f0 2024-05-10T04:22:45.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.285+0000 7fbe5be00700 1 --2- 172.21.15.80:0/1820759286 >> [v2:172.21.15.106:6808/41892,v1:172.21.15.106:6809/41892] conn(0x7fbe38072fd0 0x7fbe38075420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.286+0000 7fbe5b400700 1 --2- 172.21.15.80:0/1820759286 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fbe3806ad60 0x7fbe3806d270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbe54000f60 tx=0x7fbe54007f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.286+0000 7fbe53400700 1 -- 172.21.15.80:0/1820759286 <== osd.7 v2:172.21.15.106:6808/41892 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbe38075af0 con 0x7fbe38072fd0 2024-05-10T04:22:45.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.286+0000 7fc1ca000700 1 -- 172.21.15.80:0/2669871288 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc1c0022030 con 0x7fc1d40cf7f0 2024-05-10T04:22:45.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.288+0000 7fc1ca000700 1 --2- 172.21.15.80:0/2669871288 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc1b406ad10 0x7fc1b406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.288+0000 7fc1ca000700 1 -- 172.21.15.80:0/2669871288 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1c008a7e0 con 0x7fc1d40cf7f0 2024-05-10T04:22:45.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.288+0000 7fc1ca000700 1 --2- 172.21.15.80:0/2669871288 >> [v2:172.21.15.106:6824/41894,v1:172.21.15.106:6825/41894] conn(0x7fc1b4072f00 0x7fc1b4075350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.288+0000 7fc1ca000700 1 -- 172.21.15.80:0/2669871288 --> [v2:172.21.15.106:6824/41894,v1:172.21.15.106:6825/41894] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1b4075a20 con 0x7fc1b4072f00 2024-05-10T04:22:45.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.288+0000 7fc1ca000700 1 -- 172.21.15.80:0/2669871288 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1c0055960 con 0x7fc1d40cf7f0 2024-05-10T04:22:45.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.289+0000 7f20de800700 1 -- 172.21.15.80:0/3525603026 --> [v2:172.21.15.80:6808/41473,v1:172.21.15.80:6809/41473] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f20b0002d40 con 0x7f20b8072f00 2024-05-10T04:22:45.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.290+0000 7fcd81c00700 1 -- 172.21.15.80:0/865740890 --> [v2:172.21.15.80:6800/41469,v1:172.21.15.80:6801/41469] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcd7c15ea50 con 0x7fcd5c072e80 2024-05-10T04:22:45.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.290+0000 7fc1d1400700 1 --2- 172.21.15.80:0/2669871288 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc1b406ad10 0x7fc1b406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.290+0000 7fc1d2800700 1 --2- 172.21.15.80:0/2669871288 >> [v2:172.21.15.106:6824/41894,v1:172.21.15.106:6825/41894] conn(0x7fc1b4072f00 0x7fc1b4075350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.290+0000 7f20cf400700 1 -- 172.21.15.80:0/3525603026 <== osd.3 v2:172.21.15.80:6808/41473 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f20b0002d40 con 0x7f20b8072f00 2024-05-10T04:22:45.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.291+0000 7fc1d1400700 1 --2- 172.21.15.80:0/2669871288 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc1b406ad10 0x7fc1b406d220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40b1770 tx=0x7fc1c40090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.291+0000 7f20de800700 1 -- 172.21.15.80:0/3525603026 >> [v2:172.21.15.80:6808/41473,v1:172.21.15.80:6809/41473] conn(0x7f20b8072f00 msgr2=0x7f20b8075350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.291+0000 7f20de800700 1 --2- 172.21.15.80:0/3525603026 >> [v2:172.21.15.80:6808/41473,v1:172.21.15.80:6809/41473] conn(0x7f20b8072f00 0x7f20b8075350 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.291+0000 7fc1d2800700 1 --2- 172.21.15.80:0/2669871288 >> [v2:172.21.15.106:6824/41894,v1:172.21.15.106:6825/41894] conn(0x7fc1b4072f00 0x7fc1b4075350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.292+0000 7f20de800700 1 -- 172.21.15.80:0/3525603026 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f20b806ac90 msgr2=0x7f20b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.292+0000 7f20de800700 1 --2- 172.21.15.80:0/3525603026 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f20b806ac90 0x7f20b806d1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f20c400d380 tx=0x7f20c400b000 comp rx=0 tx=0).stop 2024-05-10T04:22:45.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.292+0000 7f20de800700 1 -- 172.21.15.80:0/3525603026 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20d8155230 msgr2=0x7f20d8153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.292+0000 7f20de800700 1 --2- 172.21.15.80:0/3525603026 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20d8155230 0x7f20d8153760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f20c8003900 tx=0x7f20c8003cc0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.292+0000 7fcd72a00700 1 -- 172.21.15.80:0/865740890 <== osd.0 v2:172.21.15.80:6800/41469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcd74007b00 con 0x7fcd5c072e80 2024-05-10T04:22:45.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.292+0000 7f20d7e00700 1 -- 172.21.15.80:0/3525603026 reap_dead start 2024-05-10T04:22:45.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.292+0000 7f20de800700 1 -- 172.21.15.80:0/3525603026 shutdown_connections 2024-05-10T04:22:45.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.292+0000 7f20de800700 1 -- 172.21.15.80:0/3525603026 >> 172.21.15.80:0/3525603026 conn(0x7f20d80cfa80 msgr2=0x7f20d8157230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.293+0000 7f20de800700 1 -- 172.21.15.80:0/3525603026 shutdown_connections 2024-05-10T04:22:45.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.293+0000 7fc1ca000700 1 -- 172.21.15.80:0/2669871288 <== osd.5 v2:172.21.15.106:6824/41894 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc1b4075a20 con 0x7fc1b4072f00 2024-05-10T04:22:45.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.293+0000 7f20de800700 1 -- 172.21.15.80:0/3525603026 wait complete. 2024-05-10T04:22:45.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.293+0000 7fcd81c00700 1 -- 172.21.15.80:0/865740890 >> [v2:172.21.15.80:6800/41469,v1:172.21.15.80:6801/41469] conn(0x7fcd5c072e80 msgr2=0x7fcd5c0752d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.294+0000 7fcd81c00700 1 --2- 172.21.15.80:0/865740890 >> [v2:172.21.15.80:6800/41469,v1:172.21.15.80:6801/41469] conn(0x7fcd5c072e80 0x7fcd5c0752d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.294+0000 7fcd81c00700 1 -- 172.21.15.80:0/865740890 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcd5c06ac90 msgr2=0x7fcd5c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.294+0000 7fcd81c00700 1 --2- 172.21.15.80:0/865740890 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcd5c06ac90 0x7fcd5c06d1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcd68000c00 tx=0x7fcd68008070 comp rx=0 tx=0).stop 2024-05-10T04:22:45.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.294+0000 7fcd81c00700 1 -- 172.21.15.80:0/865740890 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd7c06f4a0 msgr2=0x7fcd7c0cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.294+0000 7fcd81c00700 1 --2- 172.21.15.80:0/865740890 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd7c06f4a0 0x7fcd7c0cec90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00c450 tx=0x7fcd6c00c810 comp rx=0 tx=0).stop 2024-05-10T04:22:45.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.294+0000 7fcd7b400700 1 -- 172.21.15.80:0/865740890 reap_dead start 2024-05-10T04:22:45.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.294+0000 7fcd81c00700 1 -- 172.21.15.80:0/865740890 shutdown_connections 2024-05-10T04:22:45.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.294+0000 7fcd81c00700 1 -- 172.21.15.80:0/865740890 >> 172.21.15.80:0/865740890 conn(0x7fcd7c0b1af0 msgr2=0x7fcd7c15d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.295+0000 7fcd81c00700 1 -- 172.21.15.80:0/865740890 shutdown_connections 2024-05-10T04:22:45.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.295+0000 7fcd81c00700 1 -- 172.21.15.80:0/865740890 wait complete. 2024-05-10T04:22:45.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.303+0000 7f03b4200700 1 -- 172.21.15.80:0/752139422 --> [v2:172.21.15.106:6800/41891,v1:172.21.15.106:6801/41891] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0388002d40 con 0x7f0390072f10 2024-05-10T04:22:45.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.304+0000 7f03a9600700 1 -- 172.21.15.80:0/752139422 <== osd.4 v2:172.21.15.106:6800/41891 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0388002d40 con 0x7f0390072f10 2024-05-10T04:22:45.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.307+0000 7fe9df600700 1 -- 172.21.15.80:0/3585163033 --> [v2:172.21.15.80:6817/41471,v1:172.21.15.80:6819/41471] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe9b4002d40 con 0x7fe9b8072f50 2024-05-10T04:22:45.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.307+0000 7f03b4200700 1 -- 172.21.15.80:0/752139422 >> [v2:172.21.15.106:6800/41891,v1:172.21.15.106:6801/41891] conn(0x7f0390072f10 msgr2=0x7f0390075360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.307+0000 7f03b4200700 1 --2- 172.21.15.80:0/752139422 >> [v2:172.21.15.106:6800/41891,v1:172.21.15.106:6801/41891] conn(0x7f0390072f10 0x7f0390075360 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.307+0000 7f03b4200700 1 -- 172.21.15.80:0/752139422 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f039006ad20 msgr2=0x7f039006d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.307+0000 7f03b4200700 1 --2- 172.21.15.80:0/752139422 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f039006ad20 0x7f039006d230 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f03ac068410 tx=0x7f03a40094f0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.307+0000 7f03b4200700 1 -- 172.21.15.80:0/752139422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03ac161070 msgr2=0x7f03ac0b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.307+0000 7f03b4200700 1 --2- 172.21.15.80:0/752139422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03ac161070 0x7f03ac0b3eb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f03a0001200 tx=0x7f03a0007640 comp rx=0 tx=0).stop 2024-05-10T04:22:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.307+0000 7f03b2200700 1 -- 172.21.15.80:0/752139422 reap_dead start 2024-05-10T04:22:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.307+0000 7f03b4200700 1 -- 172.21.15.80:0/752139422 shutdown_connections 2024-05-10T04:22:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.307+0000 7f03b4200700 1 -- 172.21.15.80:0/752139422 >> 172.21.15.80:0/752139422 conn(0x7f03ac0cfa80 msgr2=0x7f03ac165480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.308+0000 7f03b4200700 1 -- 172.21.15.80:0/752139422 shutdown_connections 2024-05-10T04:22:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.308+0000 7f03b4200700 1 -- 172.21.15.80:0/752139422 wait complete. 2024-05-10T04:22:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.309+0000 7fe9d4c00700 1 -- 172.21.15.80:0/3585163033 <== osd.2 v2:172.21.15.80:6817/41471 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe9b4002d40 con 0x7fe9b8072f50 2024-05-10T04:22:45.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.310+0000 7f2e34200700 1 -- 172.21.15.80:0/3855051384 --> [v2:172.21.15.106:6816/41893,v1:172.21.15.106:6817/41893] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2e08002d40 con 0x7f2e0c072fd0 2024-05-10T04:22:45.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.311+0000 7fe9df600700 1 -- 172.21.15.80:0/3585163033 >> [v2:172.21.15.80:6817/41471,v1:172.21.15.80:6819/41471] conn(0x7fe9b8072f50 msgr2=0x7fe9b80753a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.311+0000 7fe9df600700 1 --2- 172.21.15.80:0/3585163033 >> [v2:172.21.15.80:6817/41471,v1:172.21.15.80:6819/41471] conn(0x7fe9b8072f50 0x7fe9b80753a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.311+0000 7f2e29600700 1 -- 172.21.15.80:0/3855051384 <== osd.6 v2:172.21.15.106:6816/41893 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2e08002d40 con 0x7f2e0c072fd0 2024-05-10T04:22:45.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.311+0000 7fe9df600700 1 -- 172.21.15.80:0/3585163033 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe9b806ace0 msgr2=0x7fe9b806d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.311+0000 7fe9df600700 1 --2- 172.21.15.80:0/3585163033 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe9b806ace0 0x7fe9b806d1f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80c9180 tx=0x7fe9c4007b90 comp rx=0 tx=0).stop 2024-05-10T04:22:45.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.311+0000 7fe9df600700 1 -- 172.21.15.80:0/3585163033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d808b720 msgr2=0x7fe9d815fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.311+0000 7f2e34200700 1 -- 172.21.15.80:0/3855051384 >> [v2:172.21.15.106:6816/41893,v1:172.21.15.106:6817/41893] conn(0x7f2e0c072fd0 msgr2=0x7f2e0c075420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.311+0000 7f2e34200700 1 --2- 172.21.15.80:0/3855051384 >> [v2:172.21.15.106:6816/41893,v1:172.21.15.106:6817/41893] conn(0x7f2e0c072fd0 0x7f2e0c075420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.311+0000 7fe9df600700 1 --2- 172.21.15.80:0/3585163033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d808b720 0x7fe9d815fd90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80cdf00 tx=0x7fe9cc004750 comp rx=0 tx=0).stop 2024-05-10T04:22:45.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.311+0000 7fe9dd600700 1 -- 172.21.15.80:0/3585163033 reap_dead start 2024-05-10T04:22:45.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.312+0000 7fe9df600700 1 -- 172.21.15.80:0/3585163033 shutdown_connections 2024-05-10T04:22:45.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.312+0000 7fe9df600700 1 -- 172.21.15.80:0/3585163033 >> 172.21.15.80:0/3585163033 conn(0x7fe9d80b35c0 msgr2=0x7fe9d8070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.311+0000 7f2e34200700 1 -- 172.21.15.80:0/3855051384 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2e0c06ad60 msgr2=0x7f2e0c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.311+0000 7f2e34200700 1 --2- 172.21.15.80:0/3855051384 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2e0c06ad60 0x7f2e0c06d270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400f360 tx=0x7f2e24007710 comp rx=0 tx=0).stop 2024-05-10T04:22:45.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.311+0000 7f2e34200700 1 -- 172.21.15.80:0/3855051384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e2c140870 msgr2=0x7f2e2c13e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.311+0000 7f2e34200700 1 --2- 172.21.15.80:0/3855051384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e2c140870 0x7f2e2c13e9b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2e20016000 tx=0x7f2e20004750 comp rx=0 tx=0).stop 2024-05-10T04:22:45.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.312+0000 7f2e32200700 1 -- 172.21.15.80:0/3855051384 reap_dead start 2024-05-10T04:22:45.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.312+0000 7f2e34200700 1 -- 172.21.15.80:0/3855051384 shutdown_connections 2024-05-10T04:22:45.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.312+0000 7f2e34200700 1 -- 172.21.15.80:0/3855051384 >> 172.21.15.80:0/3855051384 conn(0x7f2e2c0cfa80 msgr2=0x7f2e2c06f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.314+0000 7fe9df600700 1 -- 172.21.15.80:0/3585163033 shutdown_connections 2024-05-10T04:22:45.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.314+0000 7fe9df600700 1 -- 172.21.15.80:0/3585163033 wait complete. 2024-05-10T04:22:45.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.314+0000 7f2e34200700 1 -- 172.21.15.80:0/3855051384 shutdown_connections 2024-05-10T04:22:45.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.314+0000 7f2e34200700 1 -- 172.21.15.80:0/3855051384 wait complete. 2024-05-10T04:22:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.319+0000 7fe5f0c00700 1 -- 172.21.15.80:0/2077510597 --> [v2:172.21.15.80:6816/41472,v1:172.21.15.80:6818/41472] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe5c8002d40 con 0x7fe5cc072fd0 2024-05-10T04:22:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.321+0000 7fe5df400700 1 -- 172.21.15.80:0/2077510597 <== osd.1 v2:172.21.15.80:6816/41472 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe5c8002d40 con 0x7fe5cc072fd0 2024-05-10T04:22:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.322+0000 7fe5f0c00700 1 -- 172.21.15.80:0/2077510597 >> [v2:172.21.15.80:6816/41472,v1:172.21.15.80:6818/41472] conn(0x7fe5cc072fd0 msgr2=0x7fe5cc075420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.322+0000 7fe5f0c00700 1 --2- 172.21.15.80:0/2077510597 >> [v2:172.21.15.80:6816/41472,v1:172.21.15.80:6818/41472] conn(0x7fe5cc072fd0 0x7fe5cc075420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.323+0000 7fe5f0c00700 1 -- 172.21.15.80:0/2077510597 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe5cc06ad60 msgr2=0x7fe5cc06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.323+0000 7fe5f0c00700 1 --2- 172.21.15.80:0/2077510597 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe5cc06ad60 0x7fe5cc06d270 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe5e404a700 tx=0x7fe5e00095a0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.324+0000 7fe5f0c00700 1 -- 172.21.15.80:0/2077510597 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5e4052060 msgr2=0x7fe5e404d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.324+0000 7fe5f0c00700 1 --2- 172.21.15.80:0/2077510597 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5e4052060 0x7fe5e404d110 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec04fb30 tx=0x7fe5ec073d90 comp rx=0 tx=0).stop 2024-05-10T04:22:45.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.324+0000 7fe5ebe00700 1 -- 172.21.15.80:0/2077510597 reap_dead start 2024-05-10T04:22:45.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.324+0000 7fe5f0c00700 1 -- 172.21.15.80:0/2077510597 shutdown_connections 2024-05-10T04:22:45.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.324+0000 7fe5f0c00700 1 -- 172.21.15.80:0/2077510597 >> 172.21.15.80:0/2077510597 conn(0x7fe5e400c450 msgr2=0x7fe5e40de590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.325+0000 7fe5f0c00700 1 -- 172.21.15.80:0/2077510597 shutdown_connections 2024-05-10T04:22:45.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.325+0000 7fe5f0c00700 1 -- 172.21.15.80:0/2077510597 wait complete. 2024-05-10T04:22:45.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.327+0000 7fc1bf400700 1 -- 172.21.15.80:0/2669871288 --> [v2:172.21.15.106:6824/41894,v1:172.21.15.106:6825/41894] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc1d40cf410 con 0x7fc1b4072f00 2024-05-10T04:22:45.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.327+0000 7fbe62400700 1 -- 172.21.15.80:0/1820759286 --> [v2:172.21.15.106:6808/41892,v1:172.21.15.106:6809/41892] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe34002d40 con 0x7fbe38072fd0 2024-05-10T04:22:45.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.328+0000 7fc1ca000700 1 -- 172.21.15.80:0/2669871288 <== osd.5 v2:172.21.15.106:6824/41894 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc1cc009bb0 con 0x7fc1b4072f00 2024-05-10T04:22:45.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.328+0000 7fc1bf400700 1 -- 172.21.15.80:0/2669871288 >> [v2:172.21.15.106:6824/41894,v1:172.21.15.106:6825/41894] conn(0x7fc1b4072f00 msgr2=0x7fc1b4075350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.328+0000 7fc1bf400700 1 --2- 172.21.15.80:0/2669871288 >> [v2:172.21.15.106:6824/41894,v1:172.21.15.106:6825/41894] conn(0x7fc1b4072f00 0x7fc1b4075350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.329+0000 7fbe53400700 1 -- 172.21.15.80:0/1820759286 <== osd.7 v2:172.21.15.106:6808/41892 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbe34002d40 con 0x7fbe38072fd0 2024-05-10T04:22:45.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.329+0000 7fc1bf400700 1 -- 172.21.15.80:0/2669871288 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc1b406ad10 msgr2=0x7fc1b406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.329+0000 7fc1bf400700 1 --2- 172.21.15.80:0/2669871288 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc1b406ad10 0x7fc1b406d220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40b1770 tx=0x7fc1c40090e0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.329+0000 7fc1bf400700 1 -- 172.21.15.80:0/2669871288 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc1d40cf7f0 msgr2=0x7fc1d40af6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.329+0000 7fc1bf400700 1 --2- 172.21.15.80:0/2669871288 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc1d40cf7f0 0x7fc1d40af6d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0000c00 tx=0x7fc1c0004750 comp rx=0 tx=0).stop 2024-05-10T04:22:45.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.329+0000 7fc1d2800700 1 -- 172.21.15.80:0/2669871288 reap_dead start 2024-05-10T04:22:45.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.329+0000 7fc1bf400700 1 -- 172.21.15.80:0/2669871288 shutdown_connections 2024-05-10T04:22:45.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.329+0000 7fc1bf400700 1 -- 172.21.15.80:0/2669871288 >> 172.21.15.80:0/2669871288 conn(0x7fc1d40ce6a0 msgr2=0x7fc1d40b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.330+0000 7fbe62400700 1 -- 172.21.15.80:0/1820759286 >> [v2:172.21.15.106:6808/41892,v1:172.21.15.106:6809/41892] conn(0x7fbe38072fd0 msgr2=0x7fbe38075420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.330+0000 7fbe62400700 1 --2- 172.21.15.80:0/1820759286 >> [v2:172.21.15.106:6808/41892,v1:172.21.15.106:6809/41892] conn(0x7fbe38072fd0 0x7fbe38075420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.330+0000 7fbe62400700 1 -- 172.21.15.80:0/1820759286 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fbe3806ad60 msgr2=0x7fbe3806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.330+0000 7fbe62400700 1 --2- 172.21.15.80:0/1820759286 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fbe3806ad60 0x7fbe3806d270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbe54000f60 tx=0x7fbe54007f10 comp rx=0 tx=0).stop 2024-05-10T04:22:45.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.330+0000 7fbe62400700 1 -- 172.21.15.80:0/1820759286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c15ee80 msgr2=0x7fbe5c200b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.330+0000 7fbe62400700 1 --2- 172.21.15.80:0/1820759286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c15ee80 0x7fbe5c200b70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00b9b0 tx=0x7fbe4c00bcc0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.330+0000 7fbe5be00700 1 -- 172.21.15.80:0/1820759286 reap_dead start 2024-05-10T04:22:45.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.330+0000 7fbe62400700 1 -- 172.21.15.80:0/1820759286 shutdown_connections 2024-05-10T04:22:45.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.330+0000 7fbe62400700 1 -- 172.21.15.80:0/1820759286 >> 172.21.15.80:0/1820759286 conn(0x7fbe5c0cfa80 msgr2=0x7fbe5c0afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.331+0000 7fc1bf400700 1 -- 172.21.15.80:0/2669871288 shutdown_connections 2024-05-10T04:22:45.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.331+0000 7fbe62400700 1 -- 172.21.15.80:0/1820759286 shutdown_connections 2024-05-10T04:22:45.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.331+0000 7fbe62400700 1 -- 172.21.15.80:0/1820759286 wait complete. 2024-05-10T04:22:45.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.331+0000 7fc1bf400700 1 -- 172.21.15.80:0/2669871288 wait complete. 2024-05-10T04:22:45.351 INFO:teuthology.orchestra.run.smithi080.stdout:55834574855 2024-05-10T04:22:45.352 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T04:22:45.352 INFO:teuthology.orchestra.run.smithi080.stdout:55834574854 2024-05-10T04:22:45.353 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T04:22:45.354 INFO:teuthology.orchestra.run.smithi080.stdout:55834574856 2024-05-10T04:22:45.354 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T04:22:45.364 INFO:teuthology.orchestra.run.smithi080.stdout:55834574856 2024-05-10T04:22:45.364 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T04:22:45.372 INFO:teuthology.orchestra.run.smithi080.stdout:55834574854 2024-05-10T04:22:45.372 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T04:22:45.373 INFO:teuthology.orchestra.run.smithi080.stdout:55834574854 2024-05-10T04:22:45.374 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T04:22:45.374 INFO:teuthology.orchestra.run.smithi080.stdout:55834574857 2024-05-10T04:22:45.375 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T04:22:45.380 INFO:teuthology.orchestra.run.smithi080.stdout:55834574856 2024-05-10T04:22:45.386 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T04:22:45.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.820+0000 7fddc3200700 1 Processor -- start 2024-05-10T04:22:45.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.819+0000 7efeb2400700 1 Processor -- start 2024-05-10T04:22:45.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.819+0000 7efeb2400700 1 -- start start 2024-05-10T04:22:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.821+0000 7fddc3200700 1 -- start start 2024-05-10T04:22:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.822+0000 7efeb2400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efea404f4a0 0x7efea40e7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.822+0000 7efeb2400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea40060f0 0x7efea404feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.822+0000 7efeb2400700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea4006a60 con 0x7efea4006500 2024-05-10T04:22:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.822+0000 7efeb2400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea4048710 con 0x7efea404f4a0 2024-05-10T04:22:45.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.822+0000 7efeb2400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea4006d40 con 0x7efea40060f0 2024-05-10T04:22:45.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.823+0000 7efeb1000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efea404f4a0 0x7efea40e7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.824+0000 7efeabe00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea40060f0 0x7efea404feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.824+0000 7efeb1a00700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7efea4006500 0x7efea40539e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:47162/0 (socket says 172.21.15.80:47162) 2024-05-10T04:22:45.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.824+0000 7efeb1a00700 1 -- 172.21.15.80:0/474245885 learned_addr learned my addr 172.21.15.80:0/474245885 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:45.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.824+0000 7efeab400700 1 -- 172.21.15.80:0/474245885 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155572038 0 0) 0x7efea4006a60 con 0x7efea4006500 2024-05-10T04:22:45.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.824+0000 7efeab400700 1 -- 172.21.15.80:0/474245885 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe940035b0 con 0x7efea4006500 2024-05-10T04:22:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.825+0000 7fddc3200700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fddbc006b00 0x7fddbc0e0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.824+0000 7efeabe00700 1 -- 172.21.15.80:0/474245885 >> v2:172.21.15.80:3300/0 conn(0x7efea404f4a0 msgr2=0x7efea40e7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.825+0000 7efeab400700 1 -- 172.21.15.80:0/474245885 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1279670187 0 0) 0x7efe940035b0 con 0x7efea4006500 2024-05-10T04:22:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.825+0000 7efeabe00700 1 --2- 172.21.15.80:0/474245885 >> v2:172.21.15.80:3300/0 conn(0x7efea404f4a0 0x7efea40e7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.825+0000 7fddc3200700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddbc007230 con 0x7fddbc0e0a40 2024-05-10T04:22:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.825+0000 7fddc3200700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddbc007510 con 0x7fddbc034120 2024-05-10T04:22:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.825+0000 7efeabe00700 1 -- 172.21.15.80:0/474245885 >> v1:172.21.15.106:6789/0 conn(0x7efea4006500 legacy=0x7efea40539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.825+0000 7efeabe00700 1 -- 172.21.15.80:0/474245885 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea4007020 con 0x7efea40060f0 2024-05-10T04:22:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.825+0000 7efeb1000700 1 --2- 172.21.15.80:0/474245885 >> v2:172.21.15.80:3300/0 conn(0x7efea404f4a0 0x7efea40e7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.825+0000 7efeabe00700 1 --2- 172.21.15.80:0/474245885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea40060f0 0x7efea404feb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efea0009840 tx=0x7efea0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23457fd4c2815867 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.825+0000 7fddc3200700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddbc04f640 con 0x7fddbc006b00 2024-05-10T04:22:45.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.826+0000 7fddc1e00700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fddbc034120 0x7fddbc0dfdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:47168/0 (socket says 172.21.15.80:47168) 2024-05-10T04:22:45.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.826+0000 7efeab400700 1 -- 172.21.15.80:0/474245885 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98001670 con 0x7efea40060f0 2024-05-10T04:22:45.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.826+0000 7fddc1e00700 1 -- 172.21.15.80:0/2891873209 learned_addr learned my addr 172.21.15.80:0/2891873209 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:45.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.826+0000 7fddc0a00700 1 -- 172.21.15.80:0/2891873209 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737309612 0 0) 0x7fddbc007510 con 0x7fddbc034120 2024-05-10T04:22:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.826+0000 7fddc0a00700 1 -- 172.21.15.80:0/2891873209 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdda80035b0 con 0x7fddbc034120 2024-05-10T04:22:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.827+0000 7fddc0a00700 1 -- 172.21.15.80:0/2891873209 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 612282831 0 0) 0x7fdda80035b0 con 0x7fddbc034120 2024-05-10T04:22:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.827+0000 7fddc0a00700 1 -- 172.21.15.80:0/2891873209 >> v2:172.21.15.106:3300/0 conn(0x7fddbc006b00 msgr2=0x7fddbc0e0500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T04:22:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.827+0000 7fddc0a00700 1 --2- 172.21.15.80:0/2891873209 >> v2:172.21.15.106:3300/0 conn(0x7fddbc006b00 0x7fddbc0e0500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.827+0000 7fddc0a00700 1 -- 172.21.15.80:0/2891873209 >> v1:172.21.15.80:6789/0 conn(0x7fddbc0e0a40 legacy=0x7fddbc04fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.827+0000 7fddc0a00700 1 -- 172.21.15.80:0/2891873209 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc0077f0 con 0x7fddbc034120 2024-05-10T04:22:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.827+0000 7fddc0a00700 1 -- 172.21.15.80:0/2891873209 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7fddb0001670 con 0x7fddbc034120 2024-05-10T04:22:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.827+0000 7fddc0a00700 1 -- 172.21.15.80:0/2891873209 >> v1:172.21.15.106:6789/0 conn(0x7fddbc034120 legacy=0x7fddbc0dfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.827+0000 7fddc0a00700 1 --2- 172.21.15.80:0/2891873209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdda8003a00 0x7fdda8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.827+0000 7fddc0a00700 1 --2- 172.21.15.80:0/2891873209 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdda8004850 0x7fdda8004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.827+0000 7fddc0a00700 1 --2- 172.21.15.80:0/2891873209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdda8005440 0x7fdda800bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.827+0000 7fddc0a00700 1 -- 172.21.15.80:0/2891873209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc04f640 con 0x7fdda8003a00 2024-05-10T04:22:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.827+0000 7fddc0a00700 1 -- 172.21.15.80:0/2891873209 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda800c3e0 con 0x7fdda8005440 2024-05-10T04:22:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.827+0000 7fddc0a00700 1 -- 172.21.15.80:0/2891873209 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda800c5a0 con 0x7fdda8004850 2024-05-10T04:22:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.828+0000 7efeab400700 1 -- 172.21.15.80:0/474245885 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea0004030 con 0x7efea40060f0 2024-05-10T04:22:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.828+0000 7efeab400700 1 -- 172.21.15.80:0/474245885 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea00043a0 con 0x7efea40060f0 2024-05-10T04:22:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.828+0000 7fddc2800700 1 --2- 172.21.15.80:0/2891873209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdda8005440 0x7fdda800bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.828+0000 7fddc1400700 1 --2- 172.21.15.80:0/2891873209 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdda8004850 0x7fdda8004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.828+0000 7fddc1e00700 1 --2- 172.21.15.80:0/2891873209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdda8003a00 0x7fdda8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.828+0000 7fddc2800700 1 -- 172.21.15.80:0/2891873209 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdda8004850 msgr2=0x7fdda8004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.828+0000 7fddc2800700 1 --2- 172.21.15.80:0/2891873209 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdda8004850 0x7fdda8004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.828+0000 7fddc2800700 1 -- 172.21.15.80:0/2891873209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdda8003a00 msgr2=0x7fdda8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.828+0000 7fddc2800700 1 --2- 172.21.15.80:0/2891873209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdda8003a00 0x7fdda8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.828+0000 7fddc2800700 1 -- 172.21.15.80:0/2891873209 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda80035b0 con 0x7fdda8005440 2024-05-10T04:22:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.829+0000 7fddc2800700 1 -- 172.21.15.80:0/2891873209 reap_dead start 2024-05-10T04:22:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.829+0000 7efeb2400700 1 -- 172.21.15.80:0/474245885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea40060f0 msgr2=0x7efea404feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.829+0000 7efeb2400700 1 --2- 172.21.15.80:0/474245885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea40060f0 0x7efea404feb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efea0009840 tx=0x7efea0009b50 comp rx=0 tx=0).stop 2024-05-10T04:22:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.830+0000 7efeb2400700 1 -- 172.21.15.80:0/474245885 shutdown_connections 2024-05-10T04:22:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.830+0000 7efeb2400700 1 --2- 172.21.15.80:0/474245885 >> v2:172.21.15.80:3300/0 conn(0x7efea404f4a0 0x7efea40e7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.830+0000 7efeb2400700 1 --2- 172.21.15.80:0/474245885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea40060f0 0x7efea404feb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.830+0000 7efeb2400700 1 -- 172.21.15.80:0/474245885 >> 172.21.15.80:0/474245885 conn(0x7efea4054d50 msgr2=0x7efea4055160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.830+0000 7fddc2800700 1 --2- 172.21.15.80:0/2891873209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdda8005440 0x7fdda800bb00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fddc4068ae0 tx=0x7fdda8005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4f2110bccb52a54 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.830+0000 7fddc0a00700 1 -- 172.21.15.80:0/2891873209 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4068470 con 0x7fdda8005440 2024-05-10T04:22:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.830+0000 7fddc0a00700 1 -- 172.21.15.80:0/2891873209 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc40685f0 con 0x7fdda8005440 2024-05-10T04:22:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.831+0000 7fddc3200700 1 -- 172.21.15.80:0/2891873209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdda8005440 msgr2=0x7fdda800bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.831+0000 7fddc3200700 1 --2- 172.21.15.80:0/2891873209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdda8005440 0x7fdda800bb00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fddc4068ae0 tx=0x7fdda8005880 comp rx=0 tx=0).stop 2024-05-10T04:22:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.831+0000 7fddc3200700 1 -- 172.21.15.80:0/2891873209 shutdown_connections 2024-05-10T04:22:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.831+0000 7fddc3200700 1 --2- 172.21.15.80:0/2891873209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdda8005440 0x7fdda800bb00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.831+0000 7fddc3200700 1 -- 172.21.15.80:0/2891873209 >> 172.21.15.80:0/2891873209 conn(0x7fddbc054d50 msgr2=0x7fddbc055160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.832+0000 7fddc3200700 1 -- 172.21.15.80:0/2891873209 shutdown_connections 2024-05-10T04:22:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.832+0000 7fddc3200700 1 -- 172.21.15.80:0/2891873209 wait complete. 2024-05-10T04:22:45.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.833+0000 7efeb2400700 1 -- 172.21.15.80:0/474245885 shutdown_connections 2024-05-10T04:22:45.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.833+0000 7efeb2400700 1 -- 172.21.15.80:0/474245885 wait complete. 2024-05-10T04:22:45.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.836+0000 7fddc3200700 1 Processor -- start 2024-05-10T04:22:45.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.836+0000 7fddc3200700 1 -- start start 2024-05-10T04:22:45.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.836+0000 7efeb2400700 1 Processor -- start 2024-05-10T04:22:45.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.837+0000 7efeb2400700 1 -- start start 2024-05-10T04:22:45.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.838+0000 7f7782e00700 1 Processor -- start 2024-05-10T04:22:45.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.838+0000 7fddc3200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddbc1748c0 0x7fddbc0da7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.839+0000 7fddc3200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fddbc174cd0 0x7fddbc0dace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.839+0000 7fddc3200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddbc168740 0x7fddbc168b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.838+0000 7f7782e00700 1 -- start start 2024-05-10T04:22:45.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.839+0000 7fddc3200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc04a340 con 0x7fddbc1748c0 2024-05-10T04:22:45.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.840+0000 7fddc3200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc04a620 con 0x7fddbc168740 2024-05-10T04:22:45.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.840+0000 7fddc3200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc04a900 con 0x7fddbc174cd0 2024-05-10T04:22:45.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.840+0000 7fddc1e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddbc1748c0 0x7fddbc0da7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.840+0000 7efeb2400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea40060f0 0x7efea4043910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.840+0000 7efeb2400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efea4006500 0x7efea40e47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.840+0000 7fddc1e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddbc1748c0 0x7fddbc0da7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52950/0 (socket says 172.21.15.80:52950) 2024-05-10T04:22:45.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.840+0000 7fddc1e00700 1 -- 172.21.15.80:0/2791723877 learned_addr learned my addr 172.21.15.80:0/2791723877 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.840+0000 7efeb2400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efea404f4a0 0x7efea40e4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.840+0000 7efeb2400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea4043e50 con 0x7efea404f4a0 2024-05-10T04:22:45.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.840+0000 7efeb2400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea40e4020 con 0x7efea4006500 2024-05-10T04:22:45.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.840+0000 7efeb2400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea4046570 con 0x7efea40060f0 2024-05-10T04:22:45.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.841+0000 7efeb1000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea40060f0 0x7efea4043910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.841+0000 7efeabe00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efea4006500 0x7efea40e47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.841+0000 7efeabe00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efea4006500 0x7efea40e47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37320/0 (socket says 172.21.15.80:37320) 2024-05-10T04:22:45.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.841+0000 7efeabe00700 1 -- 172.21.15.80:0/2007136522 learned_addr learned my addr 172.21.15.80:0/2007136522 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.841+0000 7fddc1400700 1 --2- 172.21.15.80:0/2791723877 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fddbc174cd0 0x7fddbc0dace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.841+0000 7fddc2800700 1 --2- 172.21.15.80:0/2791723877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddbc168740 0x7fddbc168b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.841+0000 7efeabe00700 1 -- 172.21.15.80:0/2007136522 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea40060f0 msgr2=0x7efea4043910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.841+0000 7fddc2800700 1 -- 172.21.15.80:0/2791723877 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fddbc174cd0 msgr2=0x7fddbc0dace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.841+0000 7fddc2800700 1 --2- 172.21.15.80:0/2791723877 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fddbc174cd0 0x7fddbc0dace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7efeb1a00700 1 --2- 172.21.15.80:0/2007136522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efea404f4a0 0x7efea40e4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7f7782e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f77740e1320 0x7f777404fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7f7782e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f777404ff40 0x7f7774053b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7efeabe00700 1 --2- 172.21.15.80:0/2007136522 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea40060f0 0x7efea4043910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7efeabe00700 1 -- 172.21.15.80:0/2007136522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efea404f4a0 msgr2=0x7efea40e4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7f7782e00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7774053090 con 0x7f77740060f0 2024-05-10T04:22:45.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7f7782e00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7774006500 con 0x7f77740e1320 2024-05-10T04:22:45.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7f7782e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777404f720 con 0x7f777404ff40 2024-05-10T04:22:45.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7efeabe00700 1 --2- 172.21.15.80:0/2007136522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efea404f4a0 0x7efea40e4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.841+0000 7fddc2800700 1 -- 172.21.15.80:0/2791723877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddbc1748c0 msgr2=0x7fddbc0da7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7efeabe00700 1 -- 172.21.15.80:0/2007136522 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea00094a0 con 0x7efea4006500 2024-05-10T04:22:45.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7efeb1000700 1 --2- 172.21.15.80:0/2007136522 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea40060f0 0x7efea4043910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:45.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7efeb1a00700 1 --2- 172.21.15.80:0/2007136522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efea404f4a0 0x7efea40e4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:22:45.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.841+0000 7fddc2800700 1 --2- 172.21.15.80:0/2791723877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddbc1748c0 0x7fddbc0da7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.841+0000 7fddc2800700 1 -- 172.21.15.80:0/2791723877 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc168220 con 0x7fddbc168740 2024-05-10T04:22:45.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7fddc2800700 1 --2- 172.21.15.80:0/2791723877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddbc168740 0x7fddbc168b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fddc402d440 tx=0x7fddc4073d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7fddba000700 1 -- 172.21.15.80:0/2791723877 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4092d90 con 0x7fddbc168740 2024-05-10T04:22:45.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7fddba000700 1 -- 172.21.15.80:0/2791723877 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc4097050 con 0x7fddbc168740 2024-05-10T04:22:45.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7fddc3200700 1 -- 172.21.15.80:0/2791723877 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddbc0e2050 con 0x7fddbc168740 2024-05-10T04:22:45.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.843+0000 7efeabe00700 1 --2- 172.21.15.80:0/2007136522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efea4006500 0x7efea40e47e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efea00090b0 tx=0x7efea0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.843+0000 7fddba000700 1 -- 172.21.15.80:0/2791723877 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4067280 con 0x7fddbc168740 2024-05-10T04:22:45.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.843+0000 7fddc3200700 1 -- 172.21.15.80:0/2791723877 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddbc169270 con 0x7fddbc168740 2024-05-10T04:22:45.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7f7782400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f777404ff40 0x7f7774053b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.842+0000 7f7781a00700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f77740060f0 0x7f77740e4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:47184/0 (socket says 172.21.15.80:47184) 2024-05-10T04:22:45.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.844+0000 7f7781a00700 1 -- 172.21.15.80:0/2781913272 learned_addr learned my addr 172.21.15.80:0/2781913272 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:45.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.844+0000 7efea8c00700 1 -- 172.21.15.80:0/2007136522 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0003d40 con 0x7efea4006500 2024-05-10T04:22:45.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.844+0000 7efea8c00700 1 -- 172.21.15.80:0/2007136522 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea001f070 con 0x7efea4006500 2024-05-10T04:22:45.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.844+0000 7efea8c00700 1 -- 172.21.15.80:0/2007136522 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0003ea0 con 0x7efea4006500 2024-05-10T04:22:45.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.844+0000 7efeb2400700 1 -- 172.21.15.80:0/2007136522 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea40467c0 con 0x7efea4006500 2024-05-10T04:22:45.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.844+0000 7efeb2400700 1 -- 172.21.15.80:0/2007136522 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea4046d80 con 0x7efea4006500 2024-05-10T04:22:45.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.844+0000 7f7782400700 1 -- 172.21.15.80:0/2781913272 >> v2:172.21.15.80:3300/0 conn(0x7f77740e1320 msgr2=0x7f777404fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.844+0000 7f7782400700 1 --2- 172.21.15.80:0/2781913272 >> v2:172.21.15.80:3300/0 conn(0x7f77740e1320 0x7f777404fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.844+0000 7f7782400700 1 -- 172.21.15.80:0/2781913272 >> v1:172.21.15.106:6789/0 conn(0x7f77740060f0 legacy=0x7f77740e4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.844+0000 7f7782400700 1 -- 172.21.15.80:0/2781913272 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7774053330 con 0x7f777404ff40 2024-05-10T04:22:45.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.844+0000 7f7782400700 1 --2- 172.21.15.80:0/2781913272 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f777404ff40 0x7f7774053b30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f777c069bf0 tx=0x7f777c062770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8626e50aaeb2755 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.845+0000 7f777be00700 1 -- 172.21.15.80:0/2781913272 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c068880 con 0x7f777404ff40 2024-05-10T04:22:45.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.845+0000 7f777be00700 1 -- 172.21.15.80:0/2781913272 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777c092400 con 0x7f777404ff40 2024-05-10T04:22:45.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.846+0000 7fddba000700 1 -- 172.21.15.80:0/2791723877 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fddc40673e0 con 0x7fddbc168740 2024-05-10T04:22:45.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.846+0000 7efeb2400700 1 -- 172.21.15.80:0/2007136522 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea4037d30 con 0x7efea4006500 2024-05-10T04:22:45.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.847+0000 7f7782e00700 1 -- 172.21.15.80:0/2781913272 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f777404ff40 msgr2=0x7f7774053b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.847+0000 7f777be00700 1 -- 172.21.15.80:0/2781913272 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c092790 con 0x7f777404ff40 2024-05-10T04:22:45.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.847+0000 7fddc3200700 1 -- 172.21.15.80:0/2791723877 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddbc168080 con 0x7fddbc168740 2024-05-10T04:22:45.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.847+0000 7f7782e00700 1 --2- 172.21.15.80:0/2781913272 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f777404ff40 0x7f7774053b30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f777c069bf0 tx=0x7f777c062770 comp rx=0 tx=0).stop 2024-05-10T04:22:45.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.847+0000 7f7782e00700 1 -- 172.21.15.80:0/2781913272 shutdown_connections 2024-05-10T04:22:45.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.847+0000 7f7782e00700 1 --2- 172.21.15.80:0/2781913272 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f777404ff40 0x7f7774053b30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.848+0000 7f7782e00700 1 --2- 172.21.15.80:0/2781913272 >> v2:172.21.15.80:3300/0 conn(0x7f77740e1320 0x7f777404fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.848+0000 7f7782e00700 1 -- 172.21.15.80:0/2781913272 >> 172.21.15.80:0/2781913272 conn(0x7f7774054d50 msgr2=0x7f7774055160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.847+0000 7efea8c00700 1 -- 172.21.15.80:0/2007136522 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efea0021030 con 0x7efea4006500 2024-05-10T04:22:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.848+0000 7fddba000700 1 --2- 172.21.15.80:0/2791723877 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdda406ac90 0x7fdda406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.848+0000 7f7782e00700 1 -- 172.21.15.80:0/2781913272 shutdown_connections 2024-05-10T04:22:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.848+0000 7fddba000700 1 -- 172.21.15.80:0/2791723877 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddc4104a40 con 0x7fddbc168740 2024-05-10T04:22:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.849+0000 7fddc1e00700 1 --2- 172.21.15.80:0/2791723877 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdda406ac90 0x7fdda406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.848+0000 7f7782e00700 1 -- 172.21.15.80:0/2781913272 wait complete. 2024-05-10T04:22:45.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.849+0000 7efea8c00700 1 --2- 172.21.15.80:0/2007136522 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efe8c06ad60 0x7efe8c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.849+0000 7efea8c00700 1 -- 172.21.15.80:0/2007136522 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efea0089f10 con 0x7efea4006500 2024-05-10T04:22:45.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.849+0000 7efeb1000700 1 --2- 172.21.15.80:0/2007136522 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efe8c06ad60 0x7efe8c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.851+0000 7efeb1000700 1 --2- 172.21.15.80:0/2007136522 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efe8c06ad60 0x7efe8c06d270 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efeac073b50 tx=0x7efeac08c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.851+0000 7f7782e00700 1 Processor -- start 2024-05-10T04:22:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.851+0000 7fddc1e00700 1 --2- 172.21.15.80:0/2791723877 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdda406ac90 0x7fdda406d1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0365a0 tx=0x7fddb0001430 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.851+0000 7f7782e00700 1 -- start start 2024-05-10T04:22:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.853+0000 7f7782e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77740060f0 0x7f77740d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.853+0000 7f7782e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f777404ff40 0x7f777404c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.853+0000 7f7782e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77740e1320 0x7f777404ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.853+0000 7f7782e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77740d0d40 con 0x7f77740060f0 2024-05-10T04:22:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.853+0000 7f7782e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777404eb30 con 0x7f77740e1320 2024-05-10T04:22:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.853+0000 7f7782e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77740389b0 con 0x7f777404ff40 2024-05-10T04:22:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.853+0000 7f7781a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77740060f0 0x7f77740d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.853+0000 7f7781a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77740060f0 0x7f77740d00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52980/0 (socket says 172.21.15.80:52980) 2024-05-10T04:22:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.853+0000 7f7781a00700 1 -- 172.21.15.80:0/1241576296 learned_addr learned my addr 172.21.15.80:0/1241576296 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.853+0000 7f7782400700 1 --2- 172.21.15.80:0/1241576296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77740e1320 0x7f777404ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.854+0000 7f7781000700 1 --2- 172.21.15.80:0/1241576296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f777404ff40 0x7f777404c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.854+0000 7f7781a00700 1 -- 172.21.15.80:0/1241576296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f777404ff40 msgr2=0x7f777404c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.854+0000 7f7781a00700 1 --2- 172.21.15.80:0/1241576296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f777404ff40 0x7f777404c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.854+0000 7f7781a00700 1 -- 172.21.15.80:0/1241576296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77740e1320 msgr2=0x7f777404ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.854+0000 7f7781a00700 1 --2- 172.21.15.80:0/1241576296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77740e1320 0x7f777404ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.854+0000 7f7781a00700 1 -- 172.21.15.80:0/1241576296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777c073ea0 con 0x7f77740060f0 2024-05-10T04:22:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.854+0000 7f7781a00700 1 --2- 172.21.15.80:0/1241576296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77740060f0 0x7f77740d00f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f777000b550 tx=0x7f777000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.855+0000 7f7779600700 1 -- 172.21.15.80:0/1241576296 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7770011830 con 0x7f77740060f0 2024-05-10T04:22:45.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.855+0000 7fddba000700 1 -- 172.21.15.80:0/2791723877 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fddbc168080 con 0x7fddbc168740 2024-05-10T04:22:45.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.855+0000 7f7779600700 1 -- 172.21.15.80:0/1241576296 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77700119b0 con 0x7f77740060f0 2024-05-10T04:22:45.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.855+0000 7f7779600700 1 -- 172.21.15.80:0/1241576296 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7770011d60 con 0x7f77740060f0 2024-05-10T04:22:45.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.855+0000 7f7782e00700 1 -- 172.21.15.80:0/1241576296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7774038c00 con 0x7f77740060f0 2024-05-10T04:22:45.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.855+0000 7f7782e00700 1 -- 172.21.15.80:0/1241576296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77740391c0 con 0x7f77740060f0 2024-05-10T04:22:45.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.858+0000 7f7779600700 1 -- 172.21.15.80:0/1241576296 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f777001a400 con 0x7f77740060f0 2024-05-10T04:22:45.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.858+0000 7f7782e00700 1 -- 172.21.15.80:0/1241576296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77580052f0 con 0x7f77740060f0 2024-05-10T04:22:45.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.859+0000 7f7779600700 1 --2- 172.21.15.80:0/1241576296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f775c06ac90 0x7f775c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.859+0000 7f7779600700 1 -- 172.21.15.80:0/1241576296 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7770089410 con 0x7f77740060f0 2024-05-10T04:22:45.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.859+0000 7f7781000700 1 --2- 172.21.15.80:0/1241576296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f775c06ac90 0x7f775c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.860+0000 7efea8c00700 1 -- 172.21.15.80:0/2007136522 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7efea0055040 con 0x7efea4006500 2024-05-10T04:22:45.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.860+0000 7fa259600700 1 Processor -- start 2024-05-10T04:22:45.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.861+0000 7fa259600700 1 -- start start 2024-05-10T04:22:45.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.864+0000 7f7781000700 1 --2- 172.21.15.80:0/1241576296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f775c06ac90 0x7f775c06d1a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7768006fd0 tx=0x7f7768008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.864+0000 7fa259600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa254148e50 0x7fa2540ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.864+0000 7fa259600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa2541663b0 0x7fa2541667c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.864+0000 7fa259600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa254071690 0x7fa254071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.864+0000 7fa259600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa254149260 con 0x7fa2541663b0 2024-05-10T04:22:45.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.864+0000 7fa259600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25406e790 con 0x7fa254148e50 2024-05-10T04:22:45.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.864+0000 7fa259600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25406e1a0 con 0x7fa254071690 2024-05-10T04:22:45.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.865+0000 7fa253400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa254071690 0x7fa254071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.865+0000 7fa253400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa254071690 0x7fa254071aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43204/0 (socket says 172.21.15.80:43204) 2024-05-10T04:22:45.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.865+0000 7fa253400700 1 -- 172.21.15.80:0/579307679 learned_addr learned my addr 172.21.15.80:0/579307679 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.865+0000 7f580aa00700 1 Processor -- start 2024-05-10T04:22:45.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.866+0000 7fa253400700 1 -- 172.21.15.80:0/579307679 >> v2:172.21.15.106:3300/0 conn(0x7fa254148e50 msgr2=0x7fa2540ca0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T04:22:45.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.866+0000 7fa253400700 1 --2- 172.21.15.80:0/579307679 >> v2:172.21.15.106:3300/0 conn(0x7fa254148e50 0x7fa2540ca0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.866+0000 7fa253400700 1 -- 172.21.15.80:0/579307679 >> v2:172.21.15.80:3300/0 conn(0x7fa2541663b0 msgr2=0x7fa2541667c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.866+0000 7fa253400700 1 --2- 172.21.15.80:0/579307679 >> v2:172.21.15.80:3300/0 conn(0x7fa2541663b0 0x7fa2541667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.867+0000 7f7779600700 1 -- 172.21.15.80:0/1241576296 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f77700544c0 con 0x7f77740060f0 2024-05-10T04:22:45.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.866+0000 7fa253400700 1 -- 172.21.15.80:0/579307679 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa254071fe0 con 0x7fa254071690 2024-05-10T04:22:45.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.866+0000 7fa253400700 1 --2- 172.21.15.80:0/579307679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa254071690 0x7fa254071aa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa2540b27a0 tx=0x7fa240009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a055cb0a3fb6873 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.867+0000 7fa251600700 1 -- 172.21.15.80:0/579307679 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24000b870 con 0x7fa254071690 2024-05-10T04:22:45.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.866+0000 7f580aa00700 1 -- start start 2024-05-10T04:22:45.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.867+0000 7fa251600700 1 -- 172.21.15.80:0/579307679 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24000b9d0 con 0x7fa254071690 2024-05-10T04:22:45.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.867+0000 7fa251600700 1 -- 172.21.15.80:0/579307679 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24000bd60 con 0x7fa254071690 2024-05-10T04:22:45.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.868+0000 7fa259600700 1 -- 172.21.15.80:0/579307679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa254071690 msgr2=0x7fa254071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.868+0000 7fa259600700 1 --2- 172.21.15.80:0/579307679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa254071690 0x7fa254071aa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa2540b27a0 tx=0x7fa240009bd0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.869+0000 7f7e49000700 1 Processor -- start 2024-05-10T04:22:45.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.869+0000 7f580aa00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58041663b0 0x7f58041667c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.869+0000 7f580aa00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5804071690 0x7f5804071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.869+0000 7f580aa00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580406e790 con 0x7f5804148e50 2024-05-10T04:22:45.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.869+0000 7f580aa00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5804149260 con 0x7f58041663b0 2024-05-10T04:22:45.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.869+0000 7f580aa00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58040ca7e0 con 0x7f5804071690 2024-05-10T04:22:45.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.870+0000 7f5808a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5804071690 0x7f5804071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.870+0000 7f5808a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5804071690 0x7f5804071aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43218/0 (socket says 172.21.15.80:43218) 2024-05-10T04:22:45.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.870+0000 7f5808a00700 1 -- 172.21.15.80:0/2129229951 learned_addr learned my addr 172.21.15.80:0/2129229951 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.870+0000 7f5803400700 1 --2- 172.21.15.80:0/2129229951 >> v2:172.21.15.80:3300/0 conn(0x7f58041663b0 0x7f58041667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.870+0000 7f5808a00700 1 -- 172.21.15.80:0/2129229951 >> v2:172.21.15.80:3300/0 conn(0x7f58041663b0 msgr2=0x7f58041667c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.870+0000 7f5808a00700 1 --2- 172.21.15.80:0/2129229951 >> v2:172.21.15.80:3300/0 conn(0x7f58041663b0 0x7f58041667c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.870+0000 7f5808a00700 1 -- 172.21.15.80:0/2129229951 >> v1:172.21.15.80:6789/0 conn(0x7f5804148e50 legacy=0x7f58040ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.869+0000 7f7e49000700 1 -- start start 2024-05-10T04:22:45.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.870+0000 7f5808a00700 1 -- 172.21.15.80:0/2129229951 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580406e1a0 con 0x7f5804071690 2024-05-10T04:22:45.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.871+0000 7fa259600700 1 -- 172.21.15.80:0/579307679 shutdown_connections 2024-05-10T04:22:45.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.871+0000 7fa259600700 1 --2- 172.21.15.80:0/579307679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa254071690 0x7fa254071aa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.871+0000 7fa259600700 1 --2- 172.21.15.80:0/579307679 >> v2:172.21.15.106:3300/0 conn(0x7fa254148e50 0x7fa2540ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.871+0000 7fa259600700 1 --2- 172.21.15.80:0/579307679 >> v2:172.21.15.80:3300/0 conn(0x7fa2541663b0 0x7fa2541667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.871+0000 7fa259600700 1 -- 172.21.15.80:0/579307679 >> 172.21.15.80:0/579307679 conn(0x7fa2540cfa80 msgr2=0x7fa2540cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.871+0000 7f5808a00700 1 --2- 172.21.15.80:0/2129229951 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5804071690 0x7f5804071aa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009e50 tx=0x7f57fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dff70d6b294b59cc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.871+0000 7fa259600700 1 -- 172.21.15.80:0/579307679 shutdown_connections 2024-05-10T04:22:45.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.873+0000 7f7e49000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e3c050780 0x7f7e3c047d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.873+0000 7f7e49000700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7e3c0e8020 0x7f7e3c048280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.871+0000 7fa259600700 1 -- 172.21.15.80:0/579307679 wait complete. 2024-05-10T04:22:45.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.871+0000 7f5802a00700 1 -- 172.21.15.80:0/2129229951 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc00e070 con 0x7f5804071690 2024-05-10T04:22:45.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.871+0000 7f5802a00700 1 -- 172.21.15.80:0/2129229951 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc003a20 con 0x7f5804071690 2024-05-10T04:22:45.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.871+0000 7f5802a00700 1 -- 172.21.15.80:0/2129229951 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc003dd0 con 0x7f5804071690 2024-05-10T04:22:45.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.873+0000 7f7e43200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e3c050780 0x7f7e3c047d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.873+0000 7f7e43200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e3c050780 0x7f7e3c047d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43220/0 (socket says 172.21.15.80:43220) 2024-05-10T04:22:45.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.874+0000 7f7e41400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7e3c0e8020 0x7f7e3c048280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.874+0000 7f7e41400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7e3c0e8020 0x7f7e3c048280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37350/0 (socket says 172.21.15.80:37350) 2024-05-10T04:22:45.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.874+0000 7f7e49000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e3c053810 0x7f7e3c0eb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.874+0000 7f7e49000700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3c054970 con 0x7f7e3c053810 2024-05-10T04:22:45.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.874+0000 7f7e49000700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3c053d60 con 0x7f7e3c0e8020 2024-05-10T04:22:45.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.874+0000 7f7e49000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c054040 con 0x7f7e3c050780 2024-05-10T04:22:45.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.874+0000 7f7e43200700 1 -- 172.21.15.80:0/3433600669 learned_addr learned my addr 172.21.15.80:0/3433600669 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.875+0000 7f7e41400700 1 -- 172.21.15.80:0/3433600669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e3c050780 msgr2=0x7f7e3c047d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.875+0000 7f7e41400700 1 --2- 172.21.15.80:0/3433600669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e3c050780 0x7f7e3c047d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.875+0000 7f7e41400700 1 -- 172.21.15.80:0/3433600669 >> v2:172.21.15.80:3300/0 conn(0x7f7e3c053810 msgr2=0x7f7e3c0eb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.875+0000 7f7e41400700 1 --2- 172.21.15.80:0/3433600669 >> v2:172.21.15.80:3300/0 conn(0x7f7e3c053810 0x7f7e3c0eb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.875+0000 7f7e41400700 1 -- 172.21.15.80:0/3433600669 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c054320 con 0x7f7e3c0e8020 2024-05-10T04:22:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.876+0000 7f580aa00700 1 -- 172.21.15.80:0/2129229951 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5804071690 msgr2=0x7f5804071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.876+0000 7f580aa00700 1 --2- 172.21.15.80:0/2129229951 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5804071690 0x7f5804071aa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009e50 tx=0x7f57fc00b330 comp rx=0 tx=0).stop 2024-05-10T04:22:45.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.876+0000 7f7e41400700 1 --2- 172.21.15.80:0/3433600669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e3c0e8020 0x7f7e3c048280 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00c510 tx=0x7f7e30009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb56d24a74b8ac92 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.876+0000 7f7e40a00700 1 -- 172.21.15.80:0/3433600669 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30011830 con 0x7f7e3c0e8020 2024-05-10T04:22:45.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.878+0000 7f9667e00700 1 Processor -- start 2024-05-10T04:22:45.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.876+0000 7f7e40a00700 1 -- 172.21.15.80:0/3433600669 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e30011990 con 0x7f7e3c0e8020 2024-05-10T04:22:45.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.876+0000 7f7e40a00700 1 -- 172.21.15.80:0/3433600669 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30011d20 con 0x7f7e3c0e8020 2024-05-10T04:22:45.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.877+0000 7f7e49000700 1 -- 172.21.15.80:0/3433600669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e3c0e8020 msgr2=0x7f7e3c048280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.877+0000 7f7e49000700 1 --2- 172.21.15.80:0/3433600669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e3c0e8020 0x7f7e3c048280 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00c510 tx=0x7f7e30009b20 comp rx=0 tx=0).stop 2024-05-10T04:22:45.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.878+0000 7f9667e00700 1 -- start start 2024-05-10T04:22:45.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.876+0000 7fa259600700 1 Processor -- start 2024-05-10T04:22:45.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.877+0000 7fa259600700 1 -- start start 2024-05-10T04:22:45.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.879+0000 7f7e49000700 1 -- 172.21.15.80:0/3433600669 shutdown_connections 2024-05-10T04:22:45.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.879+0000 7fa259600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa254071690 0x7fa2541f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.879+0000 7fa259600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa254148e50 0x7fa2541597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.879+0000 7fa259600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2541663b0 0x7fa254159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.879+0000 7f580aa00700 1 -- 172.21.15.80:0/2129229951 shutdown_connections 2024-05-10T04:22:45.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.879+0000 7f580aa00700 1 --2- 172.21.15.80:0/2129229951 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5804071690 0x7f5804071aa0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.879+0000 7f580aa00700 1 --2- 172.21.15.80:0/2129229951 >> v2:172.21.15.80:3300/0 conn(0x7f58041663b0 0x7f58041667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.879+0000 7f580aa00700 1 -- 172.21.15.80:0/2129229951 >> 172.21.15.80:0/2129229951 conn(0x7f58040cfa80 msgr2=0x7f58040cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.879+0000 7f7e49000700 1 --2- 172.21.15.80:0/3433600669 >> v2:172.21.15.80:3300/0 conn(0x7f7e3c053810 0x7f7e3c0eb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.879+0000 7f7e49000700 1 --2- 172.21.15.80:0/3433600669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e3c050780 0x7f7e3c047d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.880+0000 7f7e49000700 1 --2- 172.21.15.80:0/3433600669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e3c0e8020 0x7f7e3c048280 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.880+0000 7f7e49000700 1 -- 172.21.15.80:0/3433600669 >> 172.21.15.80:0/3433600669 conn(0x7f7e3c00a420 msgr2=0x7f7e3c00a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.880+0000 7fa252000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa254148e50 0x7fa2541597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.880+0000 7fa252000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa254148e50 0x7fa2541597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37352/0 (socket says 172.21.15.80:37352) 2024-05-10T04:22:45.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.880+0000 7fa252a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa254071690 0x7fa2541f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.880+0000 7fa252a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa254071690 0x7fa2541f85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43228/0 (socket says 172.21.15.80:43228) 2024-05-10T04:22:45.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.880+0000 7f7e49000700 1 -- 172.21.15.80:0/3433600669 shutdown_connections 2024-05-10T04:22:45.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.880+0000 7fa253400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2541663b0 0x7fa254159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.880+0000 7fa253400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2541663b0 0x7fa254159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53010/0 (socket says 172.21.15.80:53010) 2024-05-10T04:22:45.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.880+0000 7f7e49000700 1 -- 172.21.15.80:0/3433600669 wait complete. 2024-05-10T04:22:45.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.880+0000 7fa252000700 1 -- 172.21.15.80:0/190373418 learned_addr learned my addr 172.21.15.80:0/190373418 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.881+0000 7fa259600700 1 -- 172.21.15.80:0/190373418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25413e630 con 0x7fa2541663b0 2024-05-10T04:22:45.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.881+0000 7fa259600700 1 -- 172.21.15.80:0/190373418 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa254160880 con 0x7fa254148e50 2024-05-10T04:22:45.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.881+0000 7fa259600700 1 -- 172.21.15.80:0/190373418 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25415cdd0 con 0x7fa254071690 2024-05-10T04:22:45.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.882+0000 7f9667e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f96681548c0 0x7f96680713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.881+0000 7fa252a00700 1 -- 172.21.15.80:0/190373418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa254148e50 msgr2=0x7fa2541597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.881+0000 7fa252a00700 1 --2- 172.21.15.80:0/190373418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa254148e50 0x7fa2541597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.881+0000 7fa252a00700 1 -- 172.21.15.80:0/190373418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2541663b0 msgr2=0x7fa254159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.881+0000 7fa252a00700 1 --2- 172.21.15.80:0/190373418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2541663b0 0x7fa254159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.881+0000 7fa252a00700 1 -- 172.21.15.80:0/190373418 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240009550 con 0x7fa254071690 2024-05-10T04:22:45.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.882+0000 7f9667e00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96680aefe0 con 0x7f966806ed50 2024-05-10T04:22:45.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.882+0000 7f9667e00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966815b1f0 con 0x7f9668071920 2024-05-10T04:22:45.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.882+0000 7fa252a00700 1 --2- 172.21.15.80:0/190373418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa254071690 0x7fa2541f85a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa24400b440 tx=0x7fa244009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.880+0000 7f580aa00700 1 -- 172.21.15.80:0/2129229951 shutdown_connections 2024-05-10T04:22:45.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.880+0000 7f580aa00700 1 -- 172.21.15.80:0/2129229951 wait complete. 2024-05-10T04:22:45.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.883+0000 7f9667e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9668154cd0 con 0x7f96681548c0 2024-05-10T04:22:45.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.883+0000 7f9666a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f96681548c0 0x7f96680713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.883+0000 7f9666a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f96681548c0 0x7f96680713e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43232/0 (socket says 172.21.15.80:43232) 2024-05-10T04:22:45.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.883+0000 7f9666a00700 1 -- 172.21.15.80:0/3066843658 learned_addr learned my addr 172.21.15.80:0/3066843658 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.883+0000 7f9666a00700 1 -- 172.21.15.80:0/3066843658 >> v1:172.21.15.106:6789/0 conn(0x7f9668071920 legacy=0x7f966806e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.883+0000 7f9666a00700 1 -- 172.21.15.80:0/3066843658 >> v1:172.21.15.80:6789/0 conn(0x7f966806ed50 legacy=0x7f96680b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.883+0000 7f9666a00700 1 -- 172.21.15.80:0/3066843658 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9668071d30 con 0x7f96681548c0 2024-05-10T04:22:45.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.884+0000 7fa24aa00700 1 -- 172.21.15.80:0/190373418 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244011620 con 0x7fa254071690 2024-05-10T04:22:45.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.884+0000 7fa24aa00700 1 -- 172.21.15.80:0/190373418 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2440117a0 con 0x7fa254071690 2024-05-10T04:22:45.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.884+0000 7fa259600700 1 -- 172.21.15.80:0/190373418 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25415f0b0 con 0x7fa254071690 2024-05-10T04:22:45.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.884+0000 7fa259600700 1 -- 172.21.15.80:0/190373418 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25413e080 con 0x7fa254071690 2024-05-10T04:22:45.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.884+0000 7fa24aa00700 1 -- 172.21.15.80:0/190373418 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244011b50 con 0x7fa254071690 2024-05-10T04:22:45.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.884+0000 7f580aa00700 1 Processor -- start 2024-05-10T04:22:45.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.884+0000 7f7e49000700 1 Processor -- start 2024-05-10T04:22:45.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.884+0000 7f7e49000700 1 -- start start 2024-05-10T04:22:45.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.885+0000 7f9666a00700 1 --2- 172.21.15.80:0/3066843658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f96681548c0 0x7f96680713e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9650009310 tx=0x7f9650009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ef4c334f2a55032 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.887+0000 7f7e49000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e3c050780 0x7f7e3c0e26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.885+0000 7f580aa00700 1 -- start start 2024-05-10T04:22:45.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.887+0000 7f580aa00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5804071690 0x7f58040b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.887+0000 7f580aa00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5804148e50 0x7f580415e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.888+0000 7f580aa00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58041663b0 0x7f580414a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.888+0000 7f580aa00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5804160280 con 0x7f5804148e50 2024-05-10T04:22:45.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.888+0000 7f580aa00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58040b4d70 con 0x7f58041663b0 2024-05-10T04:22:45.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.888+0000 7f580aa00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580415eab0 con 0x7f5804071690 2024-05-10T04:22:45.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.885+0000 7f9666000700 1 -- 172.21.15.80:0/3066843658 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9650004230 con 0x7f96681548c0 2024-05-10T04:22:45.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.886+0000 7f9666000700 1 -- 172.21.15.80:0/3066843658 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9650004390 con 0x7f96681548c0 2024-05-10T04:22:45.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.886+0000 7f9666000700 1 -- 172.21.15.80:0/3066843658 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9650009860 con 0x7f96681548c0 2024-05-10T04:22:45.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.888+0000 7f7e49000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e3c053810 0x7f7e3c0e5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.888+0000 7f5803400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5804148e50 0x7f580415e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.888+0000 7f5803e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5804071690 0x7f58040b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.888+0000 7f5803e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5804071690 0x7f58040b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43234/0 (socket says 172.21.15.80:43234) 2024-05-10T04:22:45.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.888+0000 7f5803e00700 1 -- 172.21.15.80:0/3428708027 learned_addr learned my addr 172.21.15.80:0/3428708027 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.888+0000 7f5808a00700 1 --2- 172.21.15.80:0/3428708027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58041663b0 0x7f580414a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.888+0000 7f7e49000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e3c0e8020 0x7f7e3c049b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.888+0000 7f7e49000700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c0e43b0 con 0x7f7e3c050780 2024-05-10T04:22:45.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.889+0000 7f7e41400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e3c053810 0x7f7e3c0e5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.889+0000 7f7e41400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e3c053810 0x7f7e3c0e5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37368/0 (socket says 172.21.15.80:37368) 2024-05-10T04:22:45.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.889+0000 7f7e43200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e3c050780 0x7f7e3c0e26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.889+0000 7f7e41400700 1 -- 172.21.15.80:0/3697027905 learned_addr learned my addr 172.21.15.80:0/3697027905 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.889+0000 7f7e49000700 1 -- 172.21.15.80:0/3697027905 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c04ae40 con 0x7f7e3c053810 2024-05-10T04:22:45.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.889+0000 7f7e49000700 1 -- 172.21.15.80:0/3697027905 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c0e6150 con 0x7f7e3c0e8020 2024-05-10T04:22:45.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.889+0000 7f7e41e00700 1 --2- 172.21.15.80:0/3697027905 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e3c0e8020 0x7f7e3c049b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.890+0000 7f9667e00700 1 -- 172.21.15.80:0/3066843658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f96681548c0 msgr2=0x7f96680713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.890+0000 7f9667e00700 1 --2- 172.21.15.80:0/3066843658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f96681548c0 0x7f96680713e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9650009310 tx=0x7f9650009620 comp rx=0 tx=0).stop 2024-05-10T04:22:45.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.890+0000 7f7e41400700 1 -- 172.21.15.80:0/3697027905 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e3c0e8020 msgr2=0x7f7e3c049b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.890+0000 7f5808a00700 1 -- 172.21.15.80:0/3428708027 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5804071690 msgr2=0x7f58040b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.890+0000 7f5808a00700 1 --2- 172.21.15.80:0/3428708027 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5804071690 0x7f58040b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.890+0000 7f7e41400700 1 --2- 172.21.15.80:0/3697027905 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e3c0e8020 0x7f7e3c049b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.890+0000 7f5808a00700 1 -- 172.21.15.80:0/3428708027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5804148e50 msgr2=0x7f580415e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.890+0000 7f5808a00700 1 --2- 172.21.15.80:0/3428708027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5804148e50 0x7f580415e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.890+0000 7f5808a00700 1 -- 172.21.15.80:0/3428708027 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc009b30 con 0x7f58041663b0 2024-05-10T04:22:45.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.891+0000 7f5803400700 1 --2- 172.21.15.80:0/3428708027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5804148e50 0x7f580415e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:45.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.891+0000 7f7e41400700 1 -- 172.21.15.80:0/3697027905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e3c050780 msgr2=0x7f7e3c0e26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.891+0000 7f7e41400700 1 --2- 172.21.15.80:0/3697027905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e3c050780 0x7f7e3c0e26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.891+0000 7f5803e00700 1 --2- 172.21.15.80:0/3428708027 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5804071690 0x7f58040b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:45.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.891+0000 7f7e41400700 1 -- 172.21.15.80:0/3697027905 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e300094a0 con 0x7f7e3c053810 2024-05-10T04:22:45.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.891+0000 7f7e41e00700 1 --2- 172.21.15.80:0/3697027905 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e3c0e8020 0x7f7e3c049b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:45.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.890+0000 7fa24aa00700 1 -- 172.21.15.80:0/190373418 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa244011cb0 con 0x7fa254071690 2024-05-10T04:22:45.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.890+0000 7fa259600700 1 -- 172.21.15.80:0/190373418 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22c0052f0 con 0x7fa254071690 2024-05-10T04:22:45.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.891+0000 7fa24aa00700 1 --2- 172.21.15.80:0/190373418 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa23406ad60 0x7fa23406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.891+0000 7f5808a00700 1 --2- 172.21.15.80:0/3428708027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58041663b0 0x7f580414a990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f58040af690 tx=0x7f57fc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.891+0000 7f7e41400700 1 --2- 172.21.15.80:0/3697027905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e3c053810 0x7f7e3c0e5880 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7e300090b0 tx=0x7f7e30004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.891+0000 7f9667e00700 1 -- 172.21.15.80:0/3066843658 shutdown_connections 2024-05-10T04:22:45.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.891+0000 7f9667e00700 1 --2- 172.21.15.80:0/3066843658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f96681548c0 0x7f96680713e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.891+0000 7f9667e00700 1 -- 172.21.15.80:0/3066843658 >> 172.21.15.80:0/3066843658 conn(0x7f96680cf800 msgr2=0x7f96680cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.891+0000 7fa24aa00700 1 -- 172.21.15.80:0/190373418 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2440890e0 con 0x7fa254071690 2024-05-10T04:22:45.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.891+0000 7fa252000700 1 --2- 172.21.15.80:0/190373418 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa23406ad60 0x7fa23406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.892+0000 7f57fbe00700 1 -- 172.21.15.80:0/3428708027 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc004440 con 0x7f58041663b0 2024-05-10T04:22:45.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.892+0000 7f57fbe00700 1 -- 172.21.15.80:0/3428708027 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc0092e0 con 0x7f58041663b0 2024-05-10T04:22:45.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.892+0000 7f57fbe00700 1 -- 172.21.15.80:0/3428708027 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc004800 con 0x7f58041663b0 2024-05-10T04:22:45.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.892+0000 7f9667e00700 1 -- 172.21.15.80:0/3066843658 shutdown_connections 2024-05-10T04:22:45.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.892+0000 7f9667e00700 1 -- 172.21.15.80:0/3066843658 wait complete. 2024-05-10T04:22:45.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.892+0000 7f580aa00700 1 -- 172.21.15.80:0/3428708027 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58040b4ab0 con 0x7f58041663b0 2024-05-10T04:22:45.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.892+0000 7f580aa00700 1 -- 172.21.15.80:0/3428708027 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58040b52a0 con 0x7f58041663b0 2024-05-10T04:22:45.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.892+0000 7f7e3a000700 1 -- 172.21.15.80:0/3697027905 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30004590 con 0x7f7e3c053810 2024-05-10T04:22:45.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.892+0000 7f7e3a000700 1 -- 172.21.15.80:0/3697027905 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3001e070 con 0x7f7e3c053810 2024-05-10T04:22:45.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.892+0000 7f7e3a000700 1 -- 172.21.15.80:0/3697027905 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e300038e0 con 0x7f7e3c053810 2024-05-10T04:22:45.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.892+0000 7f7e49000700 1 -- 172.21.15.80:0/3697027905 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3c049670 con 0x7f7e3c053810 2024-05-10T04:22:45.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.892+0000 7f7e49000700 1 -- 172.21.15.80:0/3697027905 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3c049020 con 0x7f7e3c053810 2024-05-10T04:22:45.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.894+0000 7f7e49000700 1 -- 172.21.15.80:0/3697027905 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3c008430 con 0x7f7e3c053810 2024-05-10T04:22:45.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.895+0000 7fa252000700 1 --2- 172.21.15.80:0/190373418 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa23406ad60 0x7fa23406d270 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa254161fb0 tx=0x7fa24c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.896+0000 7f7e3a000700 1 -- 172.21.15.80:0/3697027905 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7e30003a40 con 0x7f7e3c053810 2024-05-10T04:22:45.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.897+0000 7f9667e00700 1 Processor -- start 2024-05-10T04:22:45.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.897+0000 7f9667e00700 1 -- start start 2024-05-10T04:22:45.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.897+0000 7f57fbe00700 1 -- 172.21.15.80:0/3428708027 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f57fc012430 con 0x7f58041663b0 2024-05-10T04:22:45.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.897+0000 7f7e3a000700 1 --2- 172.21.15.80:0/3697027905 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7e2406ace0 0x7f7e2406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.898+0000 7f7e3a000700 1 -- 172.21.15.80:0/3697027905 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e3008a460 con 0x7f7e3c053810 2024-05-10T04:22:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.899+0000 7fa24aa00700 1 -- 172.21.15.80:0/190373418 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa2440542a0 con 0x7fa254071690 2024-05-10T04:22:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.897+0000 7f580aa00700 1 -- 172.21.15.80:0/3428708027 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc0052f0 con 0x7f58041663b0 2024-05-10T04:22:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.898+0000 7f57fbe00700 1 --2- 172.21.15.80:0/3428708027 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f57e406acc0 0x7f57e406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.898+0000 7f57fbe00700 1 -- 172.21.15.80:0/3428708027 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57fc08a470 con 0x7f58041663b0 2024-05-10T04:22:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.899+0000 7f5803e00700 1 --2- 172.21.15.80:0/3428708027 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f57e406acc0 0x7f57e406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.900+0000 7f9667e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f966806ed50 0x7f9668157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.900+0000 7f9667e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9668071920 0x7f96681f8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.900+0000 7f9667e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96681548c0 0x7f966814b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.900+0000 7f9667e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9668149520 con 0x7f96681548c0 2024-05-10T04:22:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.900+0000 7f9667e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9668149ce0 con 0x7f9668071920 2024-05-10T04:22:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.900+0000 7f9667e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9668157f20 con 0x7f966806ed50 2024-05-10T04:22:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.900+0000 7f5803e00700 1 --2- 172.21.15.80:0/3428708027 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f57e406acc0 0x7f57e406d1d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009e20 tx=0x7f57f4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.900+0000 7f9666a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f966806ed50 0x7f9668157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.900+0000 7f9666a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f966806ed50 0x7f9668157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43254/0 (socket says 172.21.15.80:43254) 2024-05-10T04:22:45.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.900+0000 7f9666a00700 1 -- 172.21.15.80:0/2697632342 learned_addr learned my addr 172.21.15.80:0/2697632342 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.900+0000 7f9667400700 1 --2- 172.21.15.80:0/2697632342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96681548c0 0x7f966814b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.900+0000 7f7e43200700 1 --2- 172.21.15.80:0/3697027905 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7e2406ace0 0x7f7e2406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.901+0000 7f965fe00700 1 --2- 172.21.15.80:0/2697632342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9668071920 0x7f96681f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.901+0000 7f7e3a000700 1 -- 172.21.15.80:0/3697027905 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7e30059240 con 0x7f7e3c053810 2024-05-10T04:22:45.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.901+0000 7f9666a00700 1 -- 172.21.15.80:0/2697632342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9668071920 msgr2=0x7f96681f8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.901+0000 7f9666a00700 1 --2- 172.21.15.80:0/2697632342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9668071920 0x7f96681f8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.901+0000 7f9666a00700 1 -- 172.21.15.80:0/2697632342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96681548c0 msgr2=0x7f966814b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.901+0000 7f9666a00700 1 --2- 172.21.15.80:0/2697632342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96681548c0 0x7f966814b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.901+0000 7f9666a00700 1 -- 172.21.15.80:0/2697632342 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9650009de0 con 0x7f966806ed50 2024-05-10T04:22:45.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.902+0000 7f9667400700 1 --2- 172.21.15.80:0/2697632342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96681548c0 0x7f966814b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:45.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.901+0000 7f7e43200700 1 --2- 172.21.15.80:0/3697027905 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7e2406ace0 0x7f7e2406d1f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009b30 tx=0x7f7e340092c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.902+0000 7f9666a00700 1 --2- 172.21.15.80:0/2697632342 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f966806ed50 0x7f9668157910 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9650009260 tx=0x7f9650004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.906+0000 7f57fbe00700 1 -- 172.21.15.80:0/3428708027 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f57fc055680 con 0x7f58041663b0 2024-05-10T04:22:45.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.908+0000 7f965ea00700 1 -- 172.21.15.80:0/2697632342 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965001e070 con 0x7f966806ed50 2024-05-10T04:22:45.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.908+0000 7f965ea00700 1 -- 172.21.15.80:0/2697632342 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965000c050 con 0x7f966806ed50 2024-05-10T04:22:45.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.908+0000 7f965ea00700 1 -- 172.21.15.80:0/2697632342 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9650003af0 con 0x7f966806ed50 2024-05-10T04:22:45.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.908+0000 7f9667e00700 1 -- 172.21.15.80:0/2697632342 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96680cd330 con 0x7f966806ed50 2024-05-10T04:22:45.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.908+0000 7f9667e00700 1 -- 172.21.15.80:0/2697632342 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96680cd8f0 con 0x7f966806ed50 2024-05-10T04:22:45.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.909+0000 7f9667e00700 1 -- 172.21.15.80:0/2697632342 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96680cdf40 con 0x7f966806ed50 2024-05-10T04:22:45.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.913+0000 7f965ea00700 1 -- 172.21.15.80:0/2697632342 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9650003c50 con 0x7f966806ed50 2024-05-10T04:22:45.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.914+0000 7f965ea00700 1 --2- 172.21.15.80:0/2697632342 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f964406ac90 0x7f964406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.914+0000 7f965ea00700 1 -- 172.21.15.80:0/2697632342 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f965005a130 con 0x7f966806ed50 2024-05-10T04:22:45.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.915+0000 7f965fe00700 1 --2- 172.21.15.80:0/2697632342 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f964406ac90 0x7f964406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.917+0000 7f965ea00700 1 -- 172.21.15.80:0/2697632342 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9650056500 con 0x7f966806ed50 2024-05-10T04:22:45.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.917+0000 7f965fe00700 1 --2- 172.21.15.80:0/2697632342 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f964406ac90 0x7f964406d1a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f966806e8d0 tx=0x7f9658008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.927+0000 7f6e13000700 1 Processor -- start 2024-05-10T04:22:45.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.927+0000 7f6e13000700 1 -- start start 2024-05-10T04:22:45.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.930+0000 7f6e13000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e040e38f0 0x7f6e04054100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.930+0000 7f6e13000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e04054640 0x7f6e04006db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.931+0000 7f6e11c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e040e38f0 0x7f6e04054100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.931+0000 7f6e11c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e040e38f0 0x7f6e04054100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43264/0 (socket says 172.21.15.80:43264) 2024-05-10T04:22:45.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.931+0000 7f6e11c00700 1 -- 172.21.15.80:0/340160139 learned_addr learned my addr 172.21.15.80:0/340160139 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.931+0000 7f6e13000700 1 -- 172.21.15.80:0/340160139 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e04054a50 con 0x7f6e040072f0 2024-05-10T04:22:45.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.931+0000 7f6e13000700 1 -- 172.21.15.80:0/340160139 --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e040577a0 con 0x7f6e04054640 2024-05-10T04:22:45.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.931+0000 7f6e13000700 1 -- 172.21.15.80:0/340160139 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e040e3d00 con 0x7f6e040e38f0 2024-05-10T04:22:45.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.932+0000 7f6e11200700 1 --2- 172.21.15.80:0/340160139 >> v2:172.21.15.80:3300/0 conn(0x7f6e04054640 0x7f6e04006db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.932+0000 7f6e11c00700 1 -- 172.21.15.80:0/340160139 >> v2:172.21.15.80:3300/0 conn(0x7f6e04054640 msgr2=0x7f6e04006db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:45.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.932+0000 7f6e11c00700 1 --2- 172.21.15.80:0/340160139 >> v2:172.21.15.80:3300/0 conn(0x7f6e04054640 0x7f6e04006db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.932+0000 7f6e11c00700 1 -- 172.21.15.80:0/340160139 >> v1:172.21.15.106:6789/0 conn(0x7f6e040072f0 legacy=0x7f6e04057e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.932+0000 7f6e0be00700 1 -- 172.21.15.80:0/340160139 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999265440 0 0) 0x7f6e04054a50 con 0x7f6e040072f0 2024-05-10T04:22:45.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.932+0000 7f6e11c00700 1 -- 172.21.15.80:0/340160139 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e040079f0 con 0x7f6e040e38f0 2024-05-10T04:22:45.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.932+0000 7f6e11200700 1 --2- 172.21.15.80:0/340160139 >> v2:172.21.15.80:3300/0 conn(0x7f6e04054640 0x7f6e04006db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:22:45.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.933+0000 7f6e11c00700 1 --2- 172.21.15.80:0/340160139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e040e38f0 0x7f6e04054100 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6df80098f0 tx=0x7f6df8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb72eedfff787a37 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.933+0000 7f6e0be00700 1 -- 172.21.15.80:0/340160139 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df800b8a0 con 0x7f6e040e38f0 2024-05-10T04:22:45.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.933+0000 7f6e0be00700 1 -- 172.21.15.80:0/340160139 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df800ba00 con 0x7f6e040e38f0 2024-05-10T04:22:45.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.933+0000 7f6e0be00700 1 -- 172.21.15.80:0/340160139 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df800bd90 con 0x7f6e040e38f0 2024-05-10T04:22:45.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.935+0000 7f6e13000700 1 -- 172.21.15.80:0/340160139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e040e38f0 msgr2=0x7f6e04054100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.935+0000 7f6e13000700 1 --2- 172.21.15.80:0/340160139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e040e38f0 0x7f6e04054100 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6df80098f0 tx=0x7f6df8009c00 comp rx=0 tx=0).stop 2024-05-10T04:22:45.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.935+0000 7f6e13000700 1 -- 172.21.15.80:0/340160139 shutdown_connections 2024-05-10T04:22:45.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.935+0000 7f6e13000700 1 --2- 172.21.15.80:0/340160139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e040e38f0 0x7f6e04054100 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.935+0000 7f6e13000700 1 --2- 172.21.15.80:0/340160139 >> v2:172.21.15.80:3300/0 conn(0x7f6e04054640 0x7f6e04006db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.935+0000 7f6e13000700 1 -- 172.21.15.80:0/340160139 >> 172.21.15.80:0/340160139 conn(0x7f6e0403acb0 msgr2=0x7f6e0403b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:45.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.937+0000 7f6e13000700 1 -- 172.21.15.80:0/340160139 shutdown_connections 2024-05-10T04:22:45.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.937+0000 7f6e13000700 1 -- 172.21.15.80:0/340160139 wait complete. 2024-05-10T04:22:45.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.941+0000 7f6e13000700 1 Processor -- start 2024-05-10T04:22:45.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.941+0000 7f6e13000700 1 -- start start 2024-05-10T04:22:45.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.944+0000 7f6e13000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e040072f0 0x7f6e0404e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.944+0000 7f6e13000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e04054640 0x7f6e040d87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.945+0000 7f6e13000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e040e38f0 0x7f6e0404cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.945+0000 7f6e11c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e040072f0 0x7f6e0404e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.945+0000 7f6e11c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e040072f0 0x7f6e0404e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43268/0 (socket says 172.21.15.80:43268) 2024-05-10T04:22:45.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.945+0000 7f6e11c00700 1 -- 172.21.15.80:0/1966647585 learned_addr learned my addr 172.21.15.80:0/1966647585 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:45.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.945+0000 7f6e13000700 1 -- 172.21.15.80:0/1966647585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0417ab40 con 0x7f6e04054640 2024-05-10T04:22:45.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.945+0000 7f6e12600700 1 --2- 172.21.15.80:0/1966647585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e040e38f0 0x7f6e0404cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.946+0000 7f6e13000700 1 -- 172.21.15.80:0/1966647585 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0404e840 con 0x7f6e040e38f0 2024-05-10T04:22:45.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.946+0000 7f6e13000700 1 -- 172.21.15.80:0/1966647585 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e040de540 con 0x7f6e040072f0 2024-05-10T04:22:45.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.946+0000 7f6e12600700 1 -- 172.21.15.80:0/1966647585 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e040072f0 msgr2=0x7f6e0404e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.946+0000 7f6e12600700 1 --2- 172.21.15.80:0/1966647585 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e040072f0 0x7f6e0404e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.946+0000 7f6e12600700 1 -- 172.21.15.80:0/1966647585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e04054640 msgr2=0x7f6e040d87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:45.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.946+0000 7f6e12600700 1 --2- 172.21.15.80:0/1966647585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e04054640 0x7f6e040d87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:45.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.946+0000 7f6e12600700 1 -- 172.21.15.80:0/1966647585 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df8009550 con 0x7f6e040e38f0 2024-05-10T04:22:45.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.946+0000 7f6e11c00700 1 --2- 172.21.15.80:0/1966647585 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e040072f0 0x7f6e0404e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:45.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.947+0000 7f6e12600700 1 --2- 172.21.15.80:0/1966647585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e040e38f0 0x7f6e0404cb90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c069950 tx=0x7f6e0c068a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.947+0000 7f6e09600700 1 -- 172.21.15.80:0/1966647585 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c0747c0 con 0x7f6e040e38f0 2024-05-10T04:22:45.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.947+0000 7f6e09600700 1 -- 172.21.15.80:0/1966647585 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0c074920 con 0x7f6e040e38f0 2024-05-10T04:22:45.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.947+0000 7f6e09600700 1 -- 172.21.15.80:0/1966647585 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c092400 con 0x7f6e040e38f0 2024-05-10T04:22:45.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.948+0000 7f6e13000700 1 -- 172.21.15.80:0/1966647585 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e040ddc10 con 0x7f6e040e38f0 2024-05-10T04:22:45.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.948+0000 7f6e13000700 1 -- 172.21.15.80:0/1966647585 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e040de1d0 con 0x7f6e040e38f0 2024-05-10T04:22:45.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.952+0000 7f6e09600700 1 -- 172.21.15.80:0/1966647585 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6e0c092560 con 0x7f6e040e38f0 2024-05-10T04:22:45.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.953+0000 7f6e09600700 1 --2- 172.21.15.80:0/1966647585 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6dec06ac90 0x7f6dec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:45.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.954+0000 7f6e11c00700 1 --2- 172.21.15.80:0/1966647585 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6dec06ac90 0x7f6dec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:45.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.954+0000 7f6e09600700 1 -- 172.21.15.80:0/1966647585 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e0c0d2cc0 con 0x7f6e040e38f0 2024-05-10T04:22:45.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.955+0000 7f6e13000700 1 -- 172.21.15.80:0/1966647585 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e04008670 con 0x7f6e040e38f0 2024-05-10T04:22:45.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.955+0000 7f6e11c00700 1 --2- 172.21.15.80:0/1966647585 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6dec06ac90 0x7f6dec06d1a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6df80091e0 tx=0x7f6df8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:45.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:45.963+0000 7f6e09600700 1 -- 172.21.15.80:0/1966647585 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6e0c0cf090 con 0x7f6e040e38f0 2024-05-10T04:22:46.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.314+0000 7fddc3200700 1 -- 172.21.15.80:0/2791723877 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fddbc168080 con 0x7fddbc168740 2024-05-10T04:22:46.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.315+0000 7fddba000700 1 -- 172.21.15.80:0/2791723877 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fddbc168080 con 0x7fddbc168740 2024-05-10T04:22:46.321 INFO:teuthology.orchestra.run.smithi080.stdout:55834574854 2024-05-10T04:22:46.322 INFO:teuthology.orchestra.run.smithi080.stdout:55834574855 2024-05-10T04:22:46.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.317+0000 7f7782e00700 1 -- 172.21.15.80:0/1241576296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f77580055a0 con 0x7f77740060f0 2024-05-10T04:22:46.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.318+0000 7f7779600700 1 -- 172.21.15.80:0/1241576296 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7770057ae0 con 0x7f77740060f0 2024-05-10T04:22:46.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.319+0000 7fddc3200700 1 -- 172.21.15.80:0/2791723877 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdda406ac90 msgr2=0x7fdda406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:46.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.319+0000 7fddc3200700 1 --2- 172.21.15.80:0/2791723877 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdda406ac90 0x7fdda406d1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0365a0 tx=0x7fddb0001430 comp rx=0 tx=0).stop 2024-05-10T04:22:46.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.319+0000 7fddc3200700 1 -- 172.21.15.80:0/2791723877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddbc168740 msgr2=0x7fddbc168b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:46.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.319+0000 7fddc3200700 1 --2- 172.21.15.80:0/2791723877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddbc168740 0x7fddbc168b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fddc402d440 tx=0x7fddc4073d90 comp rx=0 tx=0).stop 2024-05-10T04:22:46.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.320+0000 7fddc3200700 1 -- 172.21.15.80:0/2791723877 shutdown_connections 2024-05-10T04:22:46.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.320+0000 7fddc3200700 1 --2- 172.21.15.80:0/2791723877 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdda406ac90 0x7fdda406d1a0 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0365a0 tx=0x7fddb0001430 comp rx=0 tx=0).stop 2024-05-10T04:22:46.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.320+0000 7fddc3200700 1 --2- 172.21.15.80:0/2791723877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddbc1748c0 0x7fddbc0da7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.320+0000 7fddc3200700 1 --2- 172.21.15.80:0/2791723877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddbc168740 0x7fddbc168b50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.320+0000 7fddc3200700 1 --2- 172.21.15.80:0/2791723877 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fddbc174cd0 0x7fddbc0dace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.320+0000 7fddc3200700 1 -- 172.21.15.80:0/2791723877 >> 172.21.15.80:0/2791723877 conn(0x7fddbc054d50 msgr2=0x7fddbc0debb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:46.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.321+0000 7fddc3200700 1 -- 172.21.15.80:0/2791723877 shutdown_connections 2024-05-10T04:22:46.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.321+0000 7fddc3200700 1 -- 172.21.15.80:0/2791723877 wait complete. 2024-05-10T04:22:46.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.322+0000 7f7782e00700 1 -- 172.21.15.80:0/1241576296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f775c06ac90 msgr2=0x7f775c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:46.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.322+0000 7f7782e00700 1 --2- 172.21.15.80:0/1241576296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f775c06ac90 0x7f775c06d1a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7768006fd0 tx=0x7f7768008040 comp rx=0 tx=0).stop 2024-05-10T04:22:46.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.322+0000 7f7782e00700 1 -- 172.21.15.80:0/1241576296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77740060f0 msgr2=0x7f77740d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:46.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.322+0000 7f7782e00700 1 --2- 172.21.15.80:0/1241576296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77740060f0 0x7f77740d00f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f777000b550 tx=0x7f777000b860 comp rx=0 tx=0).stop 2024-05-10T04:22:46.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.323+0000 7f7782e00700 1 -- 172.21.15.80:0/1241576296 shutdown_connections 2024-05-10T04:22:46.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.323+0000 7f7782e00700 1 --2- 172.21.15.80:0/1241576296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f775c06ac90 0x7f775c06d1a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.323+0000 7f7782e00700 1 --2- 172.21.15.80:0/1241576296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77740060f0 0x7f77740d00f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.323+0000 7f7782e00700 1 --2- 172.21.15.80:0/1241576296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77740e1320 0x7f777404ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.324+0000 7f7782e00700 1 --2- 172.21.15.80:0/1241576296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f777404ff40 0x7f777404c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.324+0000 7f7782e00700 1 -- 172.21.15.80:0/1241576296 >> 172.21.15.80:0/1241576296 conn(0x7f7774054d50 msgr2=0x7f77740e2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:46.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.324+0000 7f7782e00700 1 -- 172.21.15.80:0/1241576296 shutdown_connections 2024-05-10T04:22:46.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.324+0000 7f7782e00700 1 -- 172.21.15.80:0/1241576296 wait complete. 2024-05-10T04:22:46.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-05-10T04:22:46.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.367+0000 7fa259600700 1 -- 172.21.15.80:0/190373418 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa22c0055a0 con 0x7fa254071690 2024-05-10T04:22:46.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.369+0000 7fa24aa00700 1 -- 172.21.15.80:0/190373418 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa2440578c0 con 0x7fa254071690 2024-05-10T04:22:46.373 INFO:teuthology.orchestra.run.smithi080.stdout:55834574855 2024-05-10T04:22:46.373 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2024-05-10T04:22:46.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.369+0000 7efeb2400700 1 -- 172.21.15.80:0/2007136522 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efea40055d0 con 0x7efea4006500 2024-05-10T04:22:46.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.370+0000 7efea8c00700 1 -- 172.21.15.80:0/2007136522 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efea0058660 con 0x7efea4006500 2024-05-10T04:22:46.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2024-05-10T04:22:46.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.372+0000 7fa259600700 1 -- 172.21.15.80:0/190373418 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa23406ad60 msgr2=0x7fa23406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:46.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.372+0000 7fa259600700 1 --2- 172.21.15.80:0/190373418 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa23406ad60 0x7fa23406d270 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa254161fb0 tx=0x7fa24c00b040 comp rx=0 tx=0).stop 2024-05-10T04:22:46.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.372+0000 7fa259600700 1 -- 172.21.15.80:0/190373418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa254071690 msgr2=0x7fa2541f85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:46.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.372+0000 7fa259600700 1 --2- 172.21.15.80:0/190373418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa254071690 0x7fa2541f85a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa24400b440 tx=0x7fa244009f90 comp rx=0 tx=0).stop 2024-05-10T04:22:46.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.372+0000 7fa259600700 1 -- 172.21.15.80:0/190373418 shutdown_connections 2024-05-10T04:22:46.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.372+0000 7fa259600700 1 --2- 172.21.15.80:0/190373418 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa23406ad60 0x7fa23406d270 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.372+0000 7fa259600700 1 --2- 172.21.15.80:0/190373418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2541663b0 0x7fa254159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.372+0000 7fa259600700 1 --2- 172.21.15.80:0/190373418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa254071690 0x7fa2541f85a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.372+0000 7fa259600700 1 --2- 172.21.15.80:0/190373418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa254148e50 0x7fa2541597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.373+0000 7fa259600700 1 -- 172.21.15.80:0/190373418 >> 172.21.15.80:0/190373418 conn(0x7fa2540cfa80 msgr2=0x7fa25415aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:46.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.373+0000 7fa259600700 1 -- 172.21.15.80:0/190373418 shutdown_connections 2024-05-10T04:22:46.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.373+0000 7fa259600700 1 -- 172.21.15.80:0/190373418 wait complete. 2024-05-10T04:22:46.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.374+0000 7efeb2400700 1 -- 172.21.15.80:0/2007136522 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efe8c06ad60 msgr2=0x7efe8c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:46.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.374+0000 7efeb2400700 1 --2- 172.21.15.80:0/2007136522 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efe8c06ad60 0x7efe8c06d270 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efeac073b50 tx=0x7efeac08c040 comp rx=0 tx=0).stop 2024-05-10T04:22:46.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.375+0000 7efeb2400700 1 -- 172.21.15.80:0/2007136522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efea4006500 msgr2=0x7efea40e47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:46.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.375+0000 7efeb2400700 1 --2- 172.21.15.80:0/2007136522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efea4006500 0x7efea40e47e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efea00090b0 tx=0x7efea0004750 comp rx=0 tx=0).stop 2024-05-10T04:22:46.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.375+0000 7efeb2400700 1 -- 172.21.15.80:0/2007136522 shutdown_connections 2024-05-10T04:22:46.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.375+0000 7efeb2400700 1 --2- 172.21.15.80:0/2007136522 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efe8c06ad60 0x7efe8c06d270 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.375+0000 7efeb2400700 1 --2- 172.21.15.80:0/2007136522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efea404f4a0 0x7efea40e4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.375+0000 7efeb2400700 1 --2- 172.21.15.80:0/2007136522 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea40060f0 0x7efea4043910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.375+0000 7efeb2400700 1 --2- 172.21.15.80:0/2007136522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efea4006500 0x7efea40e47e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.375+0000 7efeb2400700 1 -- 172.21.15.80:0/2007136522 >> 172.21.15.80:0/2007136522 conn(0x7efea4054d50 msgr2=0x7efea40383a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:46.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.375+0000 7efeb2400700 1 -- 172.21.15.80:0/2007136522 shutdown_connections 2024-05-10T04:22:46.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.375+0000 7efeb2400700 1 -- 172.21.15.80:0/2007136522 wait complete. 2024-05-10T04:22:46.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.377+0000 7f9667e00700 1 -- 172.21.15.80:0/2697632342 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9668071710 con 0x7f966806ed50 2024-05-10T04:22:46.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.377+0000 7f965ea00700 1 -- 172.21.15.80:0/2697632342 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9650027020 con 0x7f966806ed50 2024-05-10T04:22:46.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.377+0000 7f580aa00700 1 -- 172.21.15.80:0/3428708027 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f57dc0055a0 con 0x7f58041663b0 2024-05-10T04:22:46.379 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2024-05-10T04:22:46.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.378+0000 7f57fbe00700 1 -- 172.21.15.80:0/3428708027 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f57fc058c60 con 0x7f58041663b0 2024-05-10T04:22:46.380 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2024-05-10T04:22:46.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.380+0000 7f580aa00700 1 -- 172.21.15.80:0/3428708027 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f57e406acc0 msgr2=0x7f57e406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:46.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.381+0000 7f580aa00700 1 --2- 172.21.15.80:0/3428708027 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f57e406acc0 0x7f57e406d1d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009e20 tx=0x7f57f4009190 comp rx=0 tx=0).stop 2024-05-10T04:22:46.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.381+0000 7f580aa00700 1 -- 172.21.15.80:0/3428708027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58041663b0 msgr2=0x7f580414a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:46.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.381+0000 7f580aa00700 1 --2- 172.21.15.80:0/3428708027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58041663b0 0x7f580414a990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f58040af690 tx=0x7f57fc004ad0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.381+0000 7f580aa00700 1 -- 172.21.15.80:0/3428708027 shutdown_connections 2024-05-10T04:22:46.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.381+0000 7f580aa00700 1 --2- 172.21.15.80:0/3428708027 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f57e406acc0 0x7f57e406d1d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.381+0000 7f580aa00700 1 --2- 172.21.15.80:0/3428708027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58041663b0 0x7f580414a990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.381+0000 7f580aa00700 1 --2- 172.21.15.80:0/3428708027 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5804071690 0x7f58040b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.381+0000 7f580aa00700 1 --2- 172.21.15.80:0/3428708027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5804148e50 0x7f580415e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.381+0000 7f580aa00700 1 -- 172.21.15.80:0/3428708027 >> 172.21.15.80:0/3428708027 conn(0x7f58040cfa80 msgr2=0x7f580414b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:46.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.381+0000 7f580aa00700 1 -- 172.21.15.80:0/3428708027 shutdown_connections 2024-05-10T04:22:46.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.381+0000 7f580aa00700 1 -- 172.21.15.80:0/3428708027 wait complete. 2024-05-10T04:22:46.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.382+0000 7f9667e00700 1 -- 172.21.15.80:0/2697632342 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f964406ac90 msgr2=0x7f964406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:46.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.382+0000 7f9667e00700 1 --2- 172.21.15.80:0/2697632342 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f964406ac90 0x7f964406d1a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f966806e8d0 tx=0x7f9658008040 comp rx=0 tx=0).stop 2024-05-10T04:22:46.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.382+0000 7f9667e00700 1 -- 172.21.15.80:0/2697632342 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f966806ed50 msgr2=0x7f9668157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:46.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.382+0000 7f9667e00700 1 --2- 172.21.15.80:0/2697632342 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f966806ed50 0x7f9668157910 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9650009260 tx=0x7f9650004750 comp rx=0 tx=0).stop 2024-05-10T04:22:46.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.382+0000 7f9667e00700 1 -- 172.21.15.80:0/2697632342 shutdown_connections 2024-05-10T04:22:46.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.382+0000 7f9667e00700 1 --2- 172.21.15.80:0/2697632342 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f964406ac90 0x7f964406d1a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.382+0000 7f9667e00700 1 --2- 172.21.15.80:0/2697632342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96681548c0 0x7f966814b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.382+0000 7f9667e00700 1 --2- 172.21.15.80:0/2697632342 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f966806ed50 0x7f9668157910 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.382+0000 7f9667e00700 1 --2- 172.21.15.80:0/2697632342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9668071920 0x7f96681f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.382+0000 7f9667e00700 1 -- 172.21.15.80:0/2697632342 >> 172.21.15.80:0/2697632342 conn(0x7f96680cf800 msgr2=0x7f966806dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:46.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.382+0000 7f9667e00700 1 -- 172.21.15.80:0/2697632342 shutdown_connections 2024-05-10T04:22:46.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.382+0000 7f9667e00700 1 -- 172.21.15.80:0/2697632342 wait complete. 2024-05-10T04:22:46.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.384+0000 7f7e49000700 1 -- 172.21.15.80:0/3697027905 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7e3c0057b0 con 0x7f7e3c053810 2024-05-10T04:22:46.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.385+0000 7f7e3a000700 1 -- 172.21.15.80:0/3697027905 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7e30015020 con 0x7f7e3c053810 2024-05-10T04:22:46.387 INFO:teuthology.orchestra.run.smithi080.stdout:55834574856 2024-05-10T04:22:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.388+0000 7f7e49000700 1 -- 172.21.15.80:0/3697027905 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7e2406ace0 msgr2=0x7f7e2406d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.388+0000 7f7e49000700 1 --2- 172.21.15.80:0/3697027905 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7e2406ace0 0x7f7e2406d1f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009b30 tx=0x7f7e340092c0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.388+0000 7f7e49000700 1 -- 172.21.15.80:0/3697027905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e3c053810 msgr2=0x7f7e3c0e5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.388+0000 7f7e49000700 1 --2- 172.21.15.80:0/3697027905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e3c053810 0x7f7e3c0e5880 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7e300090b0 tx=0x7f7e30004750 comp rx=0 tx=0).stop 2024-05-10T04:22:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.388+0000 7f7e49000700 1 -- 172.21.15.80:0/3697027905 shutdown_connections 2024-05-10T04:22:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.388+0000 7f7e49000700 1 --2- 172.21.15.80:0/3697027905 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7e2406ace0 0x7f7e2406d1f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.388+0000 7f7e49000700 1 --2- 172.21.15.80:0/3697027905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e3c050780 0x7f7e3c0e26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.388+0000 7f7e49000700 1 --2- 172.21.15.80:0/3697027905 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e3c0e8020 0x7f7e3c049b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.388+0000 7f7e49000700 1 --2- 172.21.15.80:0/3697027905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e3c053810 0x7f7e3c0e5880 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.388+0000 7f7e49000700 1 -- 172.21.15.80:0/3697027905 >> 172.21.15.80:0/3697027905 conn(0x7f7e3c00a420 msgr2=0x7f7e3c006f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.389+0000 7f7e49000700 1 -- 172.21.15.80:0/3697027905 shutdown_connections 2024-05-10T04:22:46.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.389+0000 7f7e49000700 1 -- 172.21.15.80:0/3697027905 wait complete. 2024-05-10T04:22:46.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-05-10T04:22:46.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2024-05-10T04:22:46.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-05-10T04:22:46.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2024-05-10T04:22:46.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.424+0000 7f6e13000700 1 -- 172.21.15.80:0/1966647585 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6e04005a20 con 0x7f6e040e38f0 2024-05-10T04:22:46.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-05-10T04:22:46.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.424+0000 7f6e09600700 1 -- 172.21.15.80:0/1966647585 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e0c097090 con 0x7f6e040e38f0 2024-05-10T04:22:46.426 INFO:teuthology.orchestra.run.smithi080.stdout:55834574855 2024-05-10T04:22:46.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.427+0000 7f6e13000700 1 -- 172.21.15.80:0/1966647585 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6dec06ac90 msgr2=0x7f6dec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.427+0000 7f6e13000700 1 --2- 172.21.15.80:0/1966647585 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6dec06ac90 0x7f6dec06d1a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6df80091e0 tx=0x7f6df8008030 comp rx=0 tx=0).stop 2024-05-10T04:22:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.427+0000 7f6e13000700 1 -- 172.21.15.80:0/1966647585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e040e38f0 msgr2=0x7f6e0404cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.427+0000 7f6e13000700 1 --2- 172.21.15.80:0/1966647585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e040e38f0 0x7f6e0404cb90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c069950 tx=0x7f6e0c068a00 comp rx=0 tx=0).stop 2024-05-10T04:22:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.427+0000 7f6e13000700 1 -- 172.21.15.80:0/1966647585 shutdown_connections 2024-05-10T04:22:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.427+0000 7f6e13000700 1 --2- 172.21.15.80:0/1966647585 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6dec06ac90 0x7f6dec06d1a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.427+0000 7f6e13000700 1 --2- 172.21.15.80:0/1966647585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e040e38f0 0x7f6e0404cb90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.427+0000 7f6e13000700 1 --2- 172.21.15.80:0/1966647585 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e040072f0 0x7f6e0404e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.427+0000 7f6e13000700 1 --2- 172.21.15.80:0/1966647585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e04054640 0x7f6e040d87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.427+0000 7f6e13000700 1 -- 172.21.15.80:0/1966647585 >> 172.21.15.80:0/1966647585 conn(0x7f6e0403acb0 msgr2=0x7f6e040e4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.427+0000 7f6e13000700 1 -- 172.21.15.80:0/1966647585 shutdown_connections 2024-05-10T04:22:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:46.427+0000 7f6e13000700 1 -- 172.21.15.80:0/1966647585 wait complete. 2024-05-10T04:22:46.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2024-05-10T04:22:47.369 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T04:22:47.375 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T04:22:47.415 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T04:22:47.422 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T04:22:47.423 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T04:22:47.424 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T04:22:47.426 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T04:22:47.462 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T04:22:47.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.769+0000 7fe81a400700 1 Processor -- start 2024-05-10T04:22:47.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.770+0000 7fe81a400700 1 -- start start 2024-05-10T04:22:47.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.774+0000 7fe81a400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe80c0339b0 0x7fe80c033dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.775+0000 7fe81a400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe80c0e03b0 0x7fe80c0e07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.775+0000 7fe81a400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c0e38b0 con 0x7fe80c053e40 2024-05-10T04:22:47.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.775+0000 7fe81a400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c034300 con 0x7fe80c0339b0 2024-05-10T04:22:47.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.775+0000 7fe81a400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0504c0 con 0x7fe80c0e03b0 2024-05-10T04:22:47.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.775+0000 7fe813e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe80c0e03b0 0x7fe80c0e07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.776+0000 7fe813e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe80c0e03b0 0x7fe80c0e07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43270/0 (socket says 172.21.15.80:43270) 2024-05-10T04:22:47.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.776+0000 7fe813e00700 1 -- 172.21.15.80:0/2716070623 learned_addr learned my addr 172.21.15.80:0/2716070623 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:47.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.776+0000 7fe812a00700 1 --2- 172.21.15.80:0/2716070623 >> v2:172.21.15.80:3300/0 conn(0x7fe80c0339b0 0x7fe80c033dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.777+0000 7fe812000700 1 -- 172.21.15.80:0/2716070623 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849095016 0 0) 0x7fe80c0e38b0 con 0x7fe80c053e40 2024-05-10T04:22:47.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.777+0000 7fe812000700 1 -- 172.21.15.80:0/2716070623 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7fc0035b0 con 0x7fe80c053e40 2024-05-10T04:22:47.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.777+0000 7fe812a00700 1 -- 172.21.15.80:0/2716070623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe80c0e03b0 msgr2=0x7fe80c0e07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:47.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.777+0000 7fe812a00700 1 --2- 172.21.15.80:0/2716070623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe80c0e03b0 0x7fe80c0e07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.777+0000 7fe812a00700 1 -- 172.21.15.80:0/2716070623 >> v1:172.21.15.80:6789/0 conn(0x7fe80c053e40 legacy=0x7fe80c0e3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.777+0000 7fe812a00700 1 -- 172.21.15.80:0/2716070623 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c0e3580 con 0x7fe80c0339b0 2024-05-10T04:22:47.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.778+0000 7fe812a00700 1 --2- 172.21.15.80:0/2716070623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe80c0339b0 0x7fe80c033dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe800009840 tx=0x7fe800009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42bb810fbd3f8807 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.778+0000 7fe812000700 1 -- 172.21.15.80:0/2716070623 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800011830 con 0x7fe80c0339b0 2024-05-10T04:22:47.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.779+0000 7fe812000700 1 -- 172.21.15.80:0/2716070623 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe800011990 con 0x7fe80c0339b0 2024-05-10T04:22:47.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.780+0000 7fe81a400700 1 -- 172.21.15.80:0/2716070623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe80c0339b0 msgr2=0x7fe80c033dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.780+0000 7fe81a400700 1 --2- 172.21.15.80:0/2716070623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe80c0339b0 0x7fe80c033dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe800009840 tx=0x7fe800009b50 comp rx=0 tx=0).stop 2024-05-10T04:22:47.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.781+0000 7fe81a400700 1 -- 172.21.15.80:0/2716070623 shutdown_connections 2024-05-10T04:22:47.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.781+0000 7fe81a400700 1 --2- 172.21.15.80:0/2716070623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe80c0e03b0 0x7fe80c0e07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.781+0000 7fe81a400700 1 --2- 172.21.15.80:0/2716070623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe80c0339b0 0x7fe80c033dc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.781+0000 7fe81a400700 1 -- 172.21.15.80:0/2716070623 >> 172.21.15.80:0/2716070623 conn(0x7fe80c054d50 msgr2=0x7fe80c055160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:47.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.781+0000 7fe81a400700 1 -- 172.21.15.80:0/2716070623 shutdown_connections 2024-05-10T04:22:47.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.781+0000 7fe81a400700 1 -- 172.21.15.80:0/2716070623 wait complete. 2024-05-10T04:22:47.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.786+0000 7fe81a400700 1 Processor -- start 2024-05-10T04:22:47.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.786+0000 7fe81a400700 1 -- start start 2024-05-10T04:22:47.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.789+0000 7fe81a400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe80c0339b0 0x7fe80c04ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.789+0000 7fe81a400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe80c053e40 0x7fe80c0eddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.790+0000 7fe81a400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe80c0e03b0 0x7fe80c0ee300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.790+0000 7fe81a400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c04d9e0 con 0x7fe80c0339b0 2024-05-10T04:22:47.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.790+0000 7fe81a400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c04a880 con 0x7fe80c053e40 2024-05-10T04:22:47.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.790+0000 7fe81a400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c049240 con 0x7fe80c0e03b0 2024-05-10T04:22:47.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.790+0000 7fe812a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe80c053e40 0x7fe80c0eddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.790+0000 7fe812a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe80c053e40 0x7fe80c0eddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37390/0 (socket says 172.21.15.80:37390) 2024-05-10T04:22:47.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.790+0000 7fe812a00700 1 -- 172.21.15.80:0/277273990 learned_addr learned my addr 172.21.15.80:0/277273990 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:47.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.790+0000 7fe813e00700 1 --2- 172.21.15.80:0/277273990 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe80c0e03b0 0x7fe80c0ee300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.791+0000 7fe813400700 1 --2- 172.21.15.80:0/277273990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe80c0339b0 0x7fe80c04ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.791+0000 7fe813e00700 1 -- 172.21.15.80:0/277273990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe80c053e40 msgr2=0x7fe80c0eddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.791+0000 7fe813e00700 1 --2- 172.21.15.80:0/277273990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe80c053e40 0x7fe80c0eddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.791+0000 7fe813e00700 1 -- 172.21.15.80:0/277273990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe80c0339b0 msgr2=0x7fe80c04ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.791+0000 7fe813e00700 1 --2- 172.21.15.80:0/277273990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe80c0339b0 0x7fe80c04ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.791+0000 7fe813e00700 1 -- 172.21.15.80:0/277273990 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8000094a0 con 0x7fe80c0e03b0 2024-05-10T04:22:47.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.791+0000 7fe813400700 1 --2- 172.21.15.80:0/277273990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe80c0339b0 0x7fe80c04ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:22:47.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.791+0000 7fe812a00700 1 --2- 172.21.15.80:0/277273990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe80c053e40 0x7fe80c0eddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:47.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.792+0000 7fe813e00700 1 --2- 172.21.15.80:0/277273990 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe80c0e03b0 0x7fe80c0ee300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe814050680 tx=0x7fe814068750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.792+0000 7fe807400700 1 -- 172.21.15.80:0/277273990 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814068930 con 0x7fe80c0e03b0 2024-05-10T04:22:47.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.792+0000 7fe807400700 1 -- 172.21.15.80:0/277273990 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe814062440 con 0x7fe80c0e03b0 2024-05-10T04:22:47.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.792+0000 7fe807400700 1 -- 172.21.15.80:0/277273990 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814068930 con 0x7fe80c0e03b0 2024-05-10T04:22:47.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.793+0000 7fe81a400700 1 -- 172.21.15.80:0/277273990 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c0494e0 con 0x7fe80c0e03b0 2024-05-10T04:22:47.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.793+0000 7fe81a400700 1 -- 172.21.15.80:0/277273990 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c04bea0 con 0x7fe80c0e03b0 2024-05-10T04:22:47.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.795+0000 7fe81a400700 1 -- 172.21.15.80:0/277273990 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c0055d0 con 0x7fe80c0e03b0 2024-05-10T04:22:47.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.797+0000 7fe807400700 1 -- 172.21.15.80:0/277273990 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe814074500 con 0x7fe80c0e03b0 2024-05-10T04:22:47.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.798+0000 7fe807400700 1 --2- 172.21.15.80:0/277273990 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe7f406ad50 0x7fe7f406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.799+0000 7fe807400700 1 -- 172.21.15.80:0/277273990 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8140d2a70 con 0x7fe80c0e03b0 2024-05-10T04:22:47.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.800+0000 7fe813400700 1 --2- 172.21.15.80:0/277273990 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe7f406ad50 0x7fe7f406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.801+0000 7fe813400700 1 --2- 172.21.15.80:0/277273990 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe7f406ad50 0x7fe7f406d260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe8080011e0 tx=0x7fe808009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.806+0000 7fe807400700 1 -- 172.21.15.80:0/277273990 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe8140cee40 con 0x7fe80c0e03b0 2024-05-10T04:22:47.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.843+0000 7fa698000700 1 Processor -- start 2024-05-10T04:22:47.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.843+0000 7fa698000700 1 -- start start 2024-05-10T04:22:47.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.847+0000 7fa698000700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa690071da0 0x7fa69013f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.847+0000 7fa694c00700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa690140870 0x7fa690071690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:47220/0 (socket says 172.21.15.80:47220) 2024-05-10T04:22:47.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.848+0000 7fa696000700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa690071da0 0x7fa69013f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.848+0000 7fa696000700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa690071da0 0x7fa69013f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37400/0 (socket says 172.21.15.80:37400) 2024-05-10T04:22:47.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.848+0000 7fa698000700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69013fdb0 con 0x7fa6900cf080 2024-05-10T04:22:47.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.848+0000 7fa698000700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6900cf5b0 con 0x7fa690140870 2024-05-10T04:22:47.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.848+0000 7fa698000700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6900cf890 con 0x7fa690071da0 2024-05-10T04:22:47.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.848+0000 7fa694c00700 1 -- 172.21.15.80:0/1191867192 learned_addr learned my addr 172.21.15.80:0/1191867192 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:47.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.849+0000 7fa696000700 1 -- 172.21.15.80:0/1191867192 >> v1:172.21.15.106:6789/0 conn(0x7fa690140870 legacy=0x7fa690071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.849+0000 7fa696000700 1 -- 172.21.15.80:0/1191867192 >> v1:172.21.15.80:6789/0 conn(0x7fa6900cf080 legacy=0x7fa6900cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:47.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.849+0000 7fa696000700 1 -- 172.21.15.80:0/1191867192 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa690140070 con 0x7fa690071da0 2024-05-10T04:22:47.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.850+0000 7fa696000700 1 --2- 172.21.15.80:0/1191867192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa690071da0 0x7fa69013f730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa678006280 tx=0x7fa678007af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95e5933dceb7af39 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.850+0000 7fa68fe00700 1 -- 172.21.15.80:0/1191867192 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678010070 con 0x7fa690071da0 2024-05-10T04:22:47.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.850+0000 7fa68fe00700 1 -- 172.21.15.80:0/1191867192 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67800b2e0 con 0x7fa690071da0 2024-05-10T04:22:47.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.850+0000 7fa68fe00700 1 -- 172.21.15.80:0/1191867192 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678004250 con 0x7fa690071da0 2024-05-10T04:22:47.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.851+0000 7fa698000700 1 -- 172.21.15.80:0/1191867192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa690071da0 msgr2=0x7fa69013f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.851+0000 7fa698000700 1 --2- 172.21.15.80:0/1191867192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa690071da0 0x7fa69013f730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa678006280 tx=0x7fa678007af0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.852+0000 7fa698000700 1 -- 172.21.15.80:0/1191867192 shutdown_connections 2024-05-10T04:22:47.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.852+0000 7fa698000700 1 --2- 172.21.15.80:0/1191867192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa690071da0 0x7fa69013f730 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.852+0000 7fa698000700 1 -- 172.21.15.80:0/1191867192 >> 172.21.15.80:0/1191867192 conn(0x7fa6900cfa80 msgr2=0x7fa6900cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:47.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.852+0000 7fa698000700 1 -- 172.21.15.80:0/1191867192 shutdown_connections 2024-05-10T04:22:47.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.852+0000 7fa698000700 1 -- 172.21.15.80:0/1191867192 wait complete. 2024-05-10T04:22:47.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.855+0000 7fa698000700 1 Processor -- start 2024-05-10T04:22:47.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.856+0000 7fa698000700 1 -- start start 2024-05-10T04:22:47.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.858+0000 7fa698000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6900cf080 0x7fa690156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.858+0000 7fa698000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa690140870 0x7fa690154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.858+0000 7fa698000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa69015d070 0x7fa6900c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.858+0000 7fa698000700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6900b0900 con 0x7fa6900cf080 2024-05-10T04:22:47.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.858+0000 7fa698000700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6901567b0 con 0x7fa69015d070 2024-05-10T04:22:47.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.858+0000 7fa698000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa690154cd0 con 0x7fa690140870 2024-05-10T04:22:47.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.859+0000 7fa695600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6900cf080 0x7fa690156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.859+0000 7fa696000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa69015d070 0x7fa6900c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.859+0000 7fa696000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa69015d070 0x7fa6900c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37414/0 (socket says 172.21.15.80:37414) 2024-05-10T04:22:47.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.859+0000 7fa695600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6900cf080 0x7fa690156090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53068/0 (socket says 172.21.15.80:53068) 2024-05-10T04:22:47.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.859+0000 7fa696000700 1 -- 172.21.15.80:0/1770389023 learned_addr learned my addr 172.21.15.80:0/1770389023 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:47.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.859+0000 7fa694c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa690140870 0x7fa690154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.860+0000 7fa695600700 1 -- 172.21.15.80:0/1770389023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa690140870 msgr2=0x7fa690154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.860+0000 7fa695600700 1 --2- 172.21.15.80:0/1770389023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa690140870 0x7fa690154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.860+0000 7fa695600700 1 -- 172.21.15.80:0/1770389023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa69015d070 msgr2=0x7fa6900c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.860+0000 7fa695600700 1 --2- 172.21.15.80:0/1770389023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa69015d070 0x7fa6900c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.860+0000 7fa695600700 1 -- 172.21.15.80:0/1770389023 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6780074f0 con 0x7fa6900cf080 2024-05-10T04:22:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.860+0000 7fa695600700 1 --2- 172.21.15.80:0/1770389023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6900cf080 0x7fa690156090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa68000b410 tx=0x7fa680009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.861+0000 7fa68d600700 1 -- 172.21.15.80:0/1770389023 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa680011830 con 0x7fa6900cf080 2024-05-10T04:22:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.861+0000 7fa68d600700 1 -- 172.21.15.80:0/1770389023 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6800119b0 con 0x7fa6900cf080 2024-05-10T04:22:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.861+0000 7fa68d600700 1 -- 172.21.15.80:0/1770389023 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa680011d60 con 0x7fa6900cf080 2024-05-10T04:22:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.861+0000 7fa698000700 1 -- 172.21.15.80:0/1770389023 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6901f7e90 con 0x7fa6900cf080 2024-05-10T04:22:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.861+0000 7fa698000700 1 -- 172.21.15.80:0/1770389023 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6901f8450 con 0x7fa6900cf080 2024-05-10T04:22:47.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.863+0000 7f5454a00700 1 Processor -- start 2024-05-10T04:22:47.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.863+0000 7fa698000700 1 -- 172.21.15.80:0/1770389023 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa690158020 con 0x7fa6900cf080 2024-05-10T04:22:47.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.866+0000 7fa68d600700 1 -- 172.21.15.80:0/1770389023 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa68001a400 con 0x7fa6900cf080 2024-05-10T04:22:47.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.867+0000 7fa68d600700 1 --2- 172.21.15.80:0/1770389023 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa66c06ace0 0x7fa66c06d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.867+0000 7fa68d600700 1 -- 172.21.15.80:0/1770389023 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6800891c0 con 0x7fa6900cf080 2024-05-10T04:22:47.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.863+0000 7f5454a00700 1 -- start start 2024-05-10T04:22:47.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.868+0000 7f5454a00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f54500d02e0 0x7f54500d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.869+0000 7f544de00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f54500cf7f0 0x7f545009ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41538/0 (socket says 172.21.15.80:41538) 2024-05-10T04:22:47.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.869+0000 7f5445400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f54500d02e0 0x7f54500d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.869+0000 7f544de00700 1 -- 172.21.15.80:0/414849154 learned_addr learned my addr 172.21.15.80:0/414849154 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:47.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.869+0000 7f5454a00700 1 -- 172.21.15.80:0/414849154 --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54500d0e50 con 0x7f54500cf7f0 2024-05-10T04:22:47.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.869+0000 7f5454a00700 1 -- 172.21.15.80:0/414849154 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54500cf1c0 con 0x7f54500b5430 2024-05-10T04:22:47.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.869+0000 7f5454a00700 1 -- 172.21.15.80:0/414849154 --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54500b6b20 con 0x7f54500d02e0 2024-05-10T04:22:47.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.870+0000 7fa694c00700 1 --2- 172.21.15.80:0/1770389023 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa66c06ace0 0x7fa66c06d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.870+0000 7f544d400700 1 -- 172.21.15.80:0/414849154 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219908008 0 0) 0x7f54500cf1c0 con 0x7f54500b5430 2024-05-10T04:22:47.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.870+0000 7f544d400700 1 -- 172.21.15.80:0/414849154 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54340035b0 con 0x7f54500b5430 2024-05-10T04:22:47.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.870+0000 7f5445400700 1 -- 172.21.15.80:0/414849154 >> v1:172.21.15.106:6789/0 conn(0x7f54500b5430 legacy=0x7f54500cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.870+0000 7f5445400700 1 -- 172.21.15.80:0/414849154 >> v1:172.21.15.80:6789/0 conn(0x7f54500cf7f0 legacy=0x7f545009ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.870+0000 7f5445400700 1 -- 172.21.15.80:0/414849154 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545009b540 con 0x7f54500d02e0 2024-05-10T04:22:47.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.870+0000 7f5445400700 1 --2- 172.21.15.80:0/414849154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54500d02e0 0x7f54500d06f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5438009840 tx=0x7f5438009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11833ee2b91e6896 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.870+0000 7fa694c00700 1 --2- 172.21.15.80:0/1770389023 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa66c06ace0 0x7fa66c06d1f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa690155f50 tx=0x7fa688009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.871+0000 7f544d400700 1 -- 172.21.15.80:0/414849154 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5438004230 con 0x7f54500d02e0 2024-05-10T04:22:47.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.871+0000 7f544d400700 1 -- 172.21.15.80:0/414849154 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5438004390 con 0x7f54500d02e0 2024-05-10T04:22:47.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.871+0000 7f544d400700 1 -- 172.21.15.80:0/414849154 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54380036c0 con 0x7f54500d02e0 2024-05-10T04:22:47.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.872+0000 7f5454a00700 1 -- 172.21.15.80:0/414849154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54500d02e0 msgr2=0x7f54500d06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.872+0000 7f5454a00700 1 --2- 172.21.15.80:0/414849154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54500d02e0 0x7f54500d06f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5438009840 tx=0x7f5438009b50 comp rx=0 tx=0).stop 2024-05-10T04:22:47.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.873+0000 7f5454a00700 1 -- 172.21.15.80:0/414849154 shutdown_connections 2024-05-10T04:22:47.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.873+0000 7f5454a00700 1 --2- 172.21.15.80:0/414849154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54500d02e0 0x7f54500d06f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.873+0000 7f5454a00700 1 -- 172.21.15.80:0/414849154 >> 172.21.15.80:0/414849154 conn(0x7f54500ce6a0 msgr2=0x7f54500ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:47.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.873+0000 7f5454a00700 1 -- 172.21.15.80:0/414849154 shutdown_connections 2024-05-10T04:22:47.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.873+0000 7f5454a00700 1 -- 172.21.15.80:0/414849154 wait complete. 2024-05-10T04:22:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.878+0000 7fa68d600700 1 -- 172.21.15.80:0/1770389023 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa680054380 con 0x7fa6900cf080 2024-05-10T04:22:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.878+0000 7f5454a00700 1 Processor -- start 2024-05-10T04:22:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.879+0000 7f5454a00700 1 -- start start 2024-05-10T04:22:47.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.883+0000 7f5454a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54500b5430 0x7f54500c06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.883+0000 7f5454a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54500cf7f0 0x7f54500b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.884+0000 7f5454a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54500d02e0 0x7f54501da870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.884+0000 7f5445400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54500cf7f0 0x7f54500b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.884+0000 7f5445400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54500cf7f0 0x7f54500b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43298/0 (socket says 172.21.15.80:43298) 2024-05-10T04:22:47.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.884+0000 7f544de00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54500b5430 0x7f54500c06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.884+0000 7f544de00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54500b5430 0x7f54500c06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37444/0 (socket says 172.21.15.80:37444) 2024-05-10T04:22:47.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.884+0000 7f544e800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54500d02e0 0x7f54501da870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.885+0000 7f544e800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54500d02e0 0x7f54501da870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53082/0 (socket says 172.21.15.80:53082) 2024-05-10T04:22:47.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.885+0000 7f5454a00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54501f9420 con 0x7f54500d02e0 2024-05-10T04:22:47.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.885+0000 7f5454a00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54501fac30 con 0x7f54500b5430 2024-05-10T04:22:47.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.885+0000 7f5454a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54501f84e0 con 0x7f54500cf7f0 2024-05-10T04:22:47.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.886+0000 7f5445400700 1 -- 172.21.15.80:0/2345121823 learned_addr learned my addr 172.21.15.80:0/2345121823 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:47.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.886+0000 7f5445400700 1 -- 172.21.15.80:0/2345121823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54500b5430 msgr2=0x7f54500c06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.886+0000 7f5445400700 1 --2- 172.21.15.80:0/2345121823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54500b5430 0x7f54500c06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.886+0000 7f5445400700 1 -- 172.21.15.80:0/2345121823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54500d02e0 msgr2=0x7f54501da870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.886+0000 7f5445400700 1 --2- 172.21.15.80:0/2345121823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54500d02e0 0x7f54501da870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.886+0000 7f5445400700 1 -- 172.21.15.80:0/2345121823 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54380094a0 con 0x7f54500cf7f0 2024-05-10T04:22:47.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.887+0000 7f5445400700 1 --2- 172.21.15.80:0/2345121823 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54500cf7f0 0x7f54500b1ba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5438004000 tx=0x7f5438004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.887+0000 7f544de00700 1 --2- 172.21.15.80:0/2345121823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54500b5430 0x7f54500c06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-05-10T04:22:47.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.888+0000 7f5446a00700 1 -- 172.21.15.80:0/2345121823 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5438011630 con 0x7f54500cf7f0 2024-05-10T04:22:47.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.888+0000 7f5446a00700 1 -- 172.21.15.80:0/2345121823 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5438011790 con 0x7f54500cf7f0 2024-05-10T04:22:47.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.888+0000 7f5446a00700 1 -- 172.21.15.80:0/2345121823 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5438011b00 con 0x7f54500cf7f0 2024-05-10T04:22:47.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.888+0000 7f5454a00700 1 -- 172.21.15.80:0/2345121823 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54501f87a0 con 0x7f54500cf7f0 2024-05-10T04:22:47.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.888+0000 7f5454a00700 1 -- 172.21.15.80:0/2345121823 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54501f8d60 con 0x7f54500cf7f0 2024-05-10T04:22:47.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.890+0000 7f5454a00700 1 -- 172.21.15.80:0/2345121823 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5450074af0 con 0x7f54500cf7f0 2024-05-10T04:22:47.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.891+0000 7f5446a00700 1 -- 172.21.15.80:0/2345121823 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5438018050 con 0x7f54500cf7f0 2024-05-10T04:22:47.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.892+0000 7f5446a00700 1 --2- 172.21.15.80:0/2345121823 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f542c06ace0 0x7f542c06d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.893+0000 7f5446a00700 1 -- 172.21.15.80:0/2345121823 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5438089f60 con 0x7f54500cf7f0 2024-05-10T04:22:47.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.895+0000 7f544de00700 1 --2- 172.21.15.80:0/2345121823 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f542c06ace0 0x7f542c06d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.896+0000 7f544de00700 1 --2- 172.21.15.80:0/2345121823 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f542c06ace0 0x7f542c06d1f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5440000fb0 tx=0x7f5440009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.900+0000 7f5446a00700 1 -- 172.21.15.80:0/2345121823 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5438055350 con 0x7f54500cf7f0 2024-05-10T04:22:47.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.938+0000 7f6f4d400700 1 Processor -- start 2024-05-10T04:22:47.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.938+0000 7f6f4d400700 1 -- start start 2024-05-10T04:22:47.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.942+0000 7f6f4d400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f4815cdd0 0x7f6f4806dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.942+0000 7f6f4d400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f480ae8f0 0x7f6f480aed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.942+0000 7f6f4d400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6f480b2900 0x7f6f480b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.942+0000 7f6f4d400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4806db30 con 0x7f6f480ae8f0 2024-05-10T04:22:47.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.942+0000 7f6f4d400700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f480af240 con 0x7f6f480b2900 2024-05-10T04:22:47.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.943+0000 7f6f47e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f4815cdd0 0x7f6f4806dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.943+0000 7f6f4ca00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6f480b2900 0x7f6f480b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.943+0000 7f6f47e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f4815cdd0 0x7f6f4806dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43302/0 (socket says 172.21.15.80:43302) 2024-05-10T04:22:47.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.943+0000 7f6f4ca00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6f480b2900 0x7f6f480b2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37448/0 (socket says 172.21.15.80:37448) 2024-05-10T04:22:47.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.943+0000 7f6f47e00700 1 -- 172.21.15.80:0/1965322534 learned_addr learned my addr 172.21.15.80:0/1965322534 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:47.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.943+0000 7f6f4d400700 1 -- 172.21.15.80:0/1965322534 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f481637b0 con 0x7f6f4815cdd0 2024-05-10T04:22:47.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.943+0000 7f6f47400700 1 --2- 172.21.15.80:0/1965322534 >> v2:172.21.15.80:3300/0 conn(0x7f6f480ae8f0 0x7f6f480aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.944+0000 7f6f47e00700 1 -- 172.21.15.80:0/1965322534 >> v2:172.21.15.106:3300/0 conn(0x7f6f480b2900 msgr2=0x7f6f480b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:47.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.944+0000 7f6f47e00700 1 --2- 172.21.15.80:0/1965322534 >> v2:172.21.15.106:3300/0 conn(0x7f6f480b2900 0x7f6f480b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.944+0000 7f6f47e00700 1 -- 172.21.15.80:0/1965322534 >> v2:172.21.15.80:3300/0 conn(0x7f6f480ae8f0 msgr2=0x7f6f480aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:47.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.944+0000 7f6f47e00700 1 --2- 172.21.15.80:0/1965322534 >> v2:172.21.15.80:3300/0 conn(0x7f6f480ae8f0 0x7f6f480aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.944+0000 7f6f47e00700 1 -- 172.21.15.80:0/1965322534 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4806d4e0 con 0x7f6f4815cdd0 2024-05-10T04:22:47.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.944+0000 7f6f4ca00700 1 --2- 172.21.15.80:0/1965322534 >> v2:172.21.15.106:3300/0 conn(0x7f6f480b2900 0x7f6f480b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:47.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.945+0000 7f4247e00700 1 Processor -- start 2024-05-10T04:22:47.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.945+0000 7f4247e00700 1 -- start start 2024-05-10T04:22:47.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.945+0000 7f6f47e00700 1 --2- 172.21.15.80:0/1965322534 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f4815cdd0 0x7f6f4806dfc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f48072220 tx=0x7f6f38009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a370ff2a113ef4fb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.946+0000 7f6f46a00700 1 -- 172.21.15.80:0/1965322534 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38011830 con 0x7f6f4815cdd0 2024-05-10T04:22:47.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.946+0000 7f6f46a00700 1 -- 172.21.15.80:0/1965322534 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f38011990 con 0x7f6f4815cdd0 2024-05-10T04:22:47.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.946+0000 7f6f46a00700 1 -- 172.21.15.80:0/1965322534 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38011d20 con 0x7f6f4815cdd0 2024-05-10T04:22:47.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.948+0000 7f6f4d400700 1 -- 172.21.15.80:0/1965322534 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f4815cdd0 msgr2=0x7f6f4806dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.948+0000 7f6f4d400700 1 --2- 172.21.15.80:0/1965322534 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f4815cdd0 0x7f6f4806dfc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f48072220 tx=0x7f6f38009bd0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.948+0000 7f6f4d400700 1 -- 172.21.15.80:0/1965322534 shutdown_connections 2024-05-10T04:22:47.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.948+0000 7f6f4d400700 1 --2- 172.21.15.80:0/1965322534 >> v2:172.21.15.106:3300/0 conn(0x7f6f480b2900 0x7f6f480b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.948+0000 7f6f4d400700 1 --2- 172.21.15.80:0/1965322534 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f4815cdd0 0x7f6f4806dfc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.948+0000 7f6f4d400700 1 --2- 172.21.15.80:0/1965322534 >> v2:172.21.15.80:3300/0 conn(0x7f6f480ae8f0 0x7f6f480aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.948+0000 7f6f4d400700 1 -- 172.21.15.80:0/1965322534 >> 172.21.15.80:0/1965322534 conn(0x7f6f480cf850 msgr2=0x7f6f480cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:47.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.949+0000 7f4247e00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f424806b0b0 0x7f424806b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.949+0000 7f4247e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f424806ac30 0x7f42480cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.949+0000 7f4247e00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42480af3a0 con 0x7f424815a2e0 2024-05-10T04:22:47.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.949+0000 7f4247e00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42480b3720 con 0x7f424806ac30 2024-05-10T04:22:47.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.949+0000 7f4247e00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f424815a6f0 con 0x7f424806b0b0 2024-05-10T04:22:47.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.949+0000 7f6f4d400700 1 -- 172.21.15.80:0/1965322534 shutdown_connections 2024-05-10T04:22:47.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.949+0000 7f6f4d400700 1 -- 172.21.15.80:0/1965322534 wait complete. 2024-05-10T04:22:47.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.949+0000 7fdcd0c00700 1 Processor -- start 2024-05-10T04:22:47.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.950+0000 7f4246000700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f424806b0b0 0x7f424806b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.950+0000 7f4247400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f424806ac30 0x7f42480cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.950+0000 7f4246000700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f424806b0b0 0x7f424806b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37454/0 (socket says 172.21.15.80:37454) 2024-05-10T04:22:47.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.950+0000 7f4246000700 1 -- 172.21.15.80:0/1252358101 learned_addr learned my addr 172.21.15.80:0/1252358101 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:47.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.950+0000 7f4246000700 1 -- 172.21.15.80:0/1252358101 >> v2:172.21.15.80:3300/0 conn(0x7f424806ac30 msgr2=0x7f42480cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:47.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.950+0000 7f4246000700 1 --2- 172.21.15.80:0/1252358101 >> v2:172.21.15.80:3300/0 conn(0x7f424806ac30 0x7f42480cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.950+0000 7f4246000700 1 -- 172.21.15.80:0/1252358101 >> v1:172.21.15.106:6789/0 conn(0x7f424815a2e0 legacy=0x7f42480aec90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T04:22:47.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.950+0000 7f4246000700 1 -- 172.21.15.80:0/1252358101 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424806ba00 con 0x7f424806b0b0 2024-05-10T04:22:47.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.951+0000 7f4246000700 1 --2- 172.21.15.80:0/1252358101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f424806b0b0 0x7f424806b4c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f42480b4dd0 tx=0x7f4234009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb57baa9ebe4f86 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.952+0000 7f4245600700 1 -- 172.21.15.80:0/1252358101 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234004230 con 0x7f424806b0b0 2024-05-10T04:22:47.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.952+0000 7f4245600700 1 -- 172.21.15.80:0/1252358101 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4234004390 con 0x7f424806b0b0 2024-05-10T04:22:47.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.952+0000 7f4245600700 1 -- 172.21.15.80:0/1252358101 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42340036a0 con 0x7f424806b0b0 2024-05-10T04:22:47.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.950+0000 7fdcd0c00700 1 -- start start 2024-05-10T04:22:47.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.953+0000 7fdcd0c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdccc0b9930 0x7fdccc0d2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.953+0000 7fdcd0c00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdccc0b5650 0x7fdccc0d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.953+0000 7fdcd0c00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdccc0b7190 con 0x7fdccc0d0ea0 2024-05-10T04:22:47.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.953+0000 7fdcd0c00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdccc0d3640 con 0x7fdccc0b5650 2024-05-10T04:22:47.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.953+0000 7fdcd0c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0b7450 con 0x7fdccc0b9930 2024-05-10T04:22:47.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.953+0000 7fdcc9400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdccc0b5650 0x7fdccc0d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.953+0000 7fdcca800700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdccc0d0ea0 0x7fdccc15d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:47260/0 (socket says 172.21.15.80:47260) 2024-05-10T04:22:47.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.953+0000 7fdcca800700 1 -- 172.21.15.80:0/1818524619 learned_addr learned my addr 172.21.15.80:0/1818524619 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:47.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.953+0000 7fdcc9e00700 1 --2- 172.21.15.80:0/1818524619 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdccc0b9930 0x7fdccc0d2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.954+0000 7f78dfe00700 1 Processor -- start 2024-05-10T04:22:47.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.954+0000 7fdcc8a00700 1 -- 172.21.15.80:0/1818524619 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228402643 0 0) 0x7fdccc0b7190 con 0x7fdccc0d0ea0 2024-05-10T04:22:47.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.954+0000 7fdcc8a00700 1 -- 172.21.15.80:0/1818524619 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcb00035b0 con 0x7fdccc0d0ea0 2024-05-10T04:22:47.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.954+0000 7f78dfe00700 1 -- start start 2024-05-10T04:22:47.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.955+0000 7f6f4d400700 1 Processor -- start 2024-05-10T04:22:47.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.954+0000 7fdcc8a00700 1 -- 172.21.15.80:0/1818524619 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3726004103 0 0) 0x7fdcb00035b0 con 0x7fdccc0d0ea0 2024-05-10T04:22:47.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.954+0000 7fdcc8a00700 1 -- 172.21.15.80:0/1818524619 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdccc0b9930 msgr2=0x7fdccc0d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:47.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.954+0000 7fdcc8a00700 1 --2- 172.21.15.80:0/1818524619 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdccc0b9930 0x7fdccc0d2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.954+0000 7fdcc8a00700 1 -- 172.21.15.80:0/1818524619 >> v2:172.21.15.80:3300/0 conn(0x7fdccc0b5650 msgr2=0x7fdccc0d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:47.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.954+0000 7fdcc8a00700 1 --2- 172.21.15.80:0/1818524619 >> v2:172.21.15.80:3300/0 conn(0x7fdccc0b5650 0x7fdccc0d0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.954+0000 7fdcc8a00700 1 -- 172.21.15.80:0/1818524619 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc0d12b0 con 0x7fdccc0d0ea0 2024-05-10T04:22:47.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.954+0000 7fdcc8a00700 1 -- 172.21.15.80:0/1818524619 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7fdcb8001670 con 0x7fdccc0d0ea0 2024-05-10T04:22:47.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.954+0000 7fdcc8a00700 1 -- 172.21.15.80:0/1818524619 >> v1:172.21.15.106:6789/0 conn(0x7fdccc0d0ea0 legacy=0x7fdccc15d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.955+0000 7fdcc8a00700 1 --2- 172.21.15.80:0/1818524619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb0003a00 0x7fdcb0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.955+0000 7fdcc8a00700 1 --2- 172.21.15.80:0/1818524619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcb0004850 0x7fdcb0004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.955+0000 7fdcc8a00700 1 --2- 172.21.15.80:0/1818524619 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcb00051a0 0x7fdcb000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.955+0000 7fdcc8a00700 1 -- 172.21.15.80:0/1818524619 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0d3640 con 0x7fdcb0003a00 2024-05-10T04:22:47.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.955+0000 7fdcc8a00700 1 -- 172.21.15.80:0/1818524619 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0b7450 con 0x7fdcb0004850 2024-05-10T04:22:47.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.955+0000 7fdcc8a00700 1 -- 172.21.15.80:0/1818524619 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb000bfd0 con 0x7fdcb00051a0 2024-05-10T04:22:47.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.955+0000 7f6f4d400700 1 -- start start 2024-05-10T04:22:47.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.956+0000 7fdcc9e00700 1 --2- 172.21.15.80:0/1818524619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb0003a00 0x7fdcb0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.956+0000 7fdcc9400700 1 --2- 172.21.15.80:0/1818524619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcb0004850 0x7fdcb0004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.956+0000 7fdcca800700 1 --2- 172.21.15.80:0/1818524619 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcb00051a0 0x7fdcb000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.956+0000 7fdcc9400700 1 -- 172.21.15.80:0/1818524619 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcb00051a0 msgr2=0x7fdcb000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:47.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.956+0000 7fdcc9400700 1 --2- 172.21.15.80:0/1818524619 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcb00051a0 0x7fdcb000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.956+0000 7fdcc9400700 1 -- 172.21.15.80:0/1818524619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb0003a00 msgr2=0x7fdcb0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:47.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.956+0000 7fdcc9400700 1 --2- 172.21.15.80:0/1818524619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb0003a00 0x7fdcb0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.956+0000 7fdcc9400700 1 -- 172.21.15.80:0/1818524619 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc0d12b0 con 0x7fdcb0004850 2024-05-10T04:22:47.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.957+0000 7fdcc9400700 1 --2- 172.21.15.80:0/1818524619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcb0004850 0x7fdcb0004c60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0d4c70 tx=0x7fdcb0005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b857ec9847989b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.954+0000 7f4247e00700 1 -- 172.21.15.80:0/1252358101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f424806b0b0 msgr2=0x7f424806b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.954+0000 7f4247e00700 1 --2- 172.21.15.80:0/1252358101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f424806b0b0 0x7f424806b4c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f42480b4dd0 tx=0x7f4234009bd0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.957+0000 7fdcc8a00700 1 -- 172.21.15.80:0/1818524619 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc00e6c0 con 0x7fdcb0004850 2024-05-10T04:22:47.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.957+0000 7f4247e00700 1 -- 172.21.15.80:0/1252358101 shutdown_connections 2024-05-10T04:22:47.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.957+0000 7f4247e00700 1 --2- 172.21.15.80:0/1252358101 >> v2:172.21.15.80:3300/0 conn(0x7f424806ac30 0x7f42480cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.957+0000 7f4247e00700 1 --2- 172.21.15.80:0/1252358101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f424806b0b0 0x7f424806b4c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.957+0000 7f4247e00700 1 -- 172.21.15.80:0/1252358101 >> 172.21.15.80:0/1252358101 conn(0x7f42480b17e0 msgr2=0x7f42480b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:47.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.958+0000 7f4247e00700 1 -- 172.21.15.80:0/1252358101 shutdown_connections 2024-05-10T04:22:47.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.957+0000 7fdcc8a00700 1 -- 172.21.15.80:0/1818524619 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc00e820 con 0x7fdcb0004850 2024-05-10T04:22:47.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.957+0000 7f78dfe00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78d80cf080 0x7f78d813f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.958+0000 7f78dfe00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78d8071690 0x7f78d8071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.958+0000 7f78dfe00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d8071fe0 con 0x7f78d8140870 2024-05-10T04:22:47.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.958+0000 7f78dfe00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d80cf890 con 0x7f78d80cf080 2024-05-10T04:22:47.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.958+0000 7f78dde00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78d8071690 0x7f78d8071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.958+0000 7f78dde00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78d8071690 0x7f78d8071aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43336/0 (socket says 172.21.15.80:43336) 2024-05-10T04:22:47.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.958+0000 7f78dde00700 1 -- 172.21.15.80:0/2182123174 learned_addr learned my addr 172.21.15.80:0/2182123174 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:47.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.958+0000 7f78dfe00700 1 -- 172.21.15.80:0/2182123174 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d813fdb0 con 0x7f78d8071690 2024-05-10T04:22:47.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.958+0000 7f78dd400700 1 --2- 172.21.15.80:0/2182123174 >> v2:172.21.15.80:3300/0 conn(0x7f78d80cf080 0x7f78d813f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.958+0000 7f6f4d400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f480ae8f0 0x7f6f48152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.958+0000 7f6f4d400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f480b2900 0x7f6f48156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.959+0000 7f6f4d400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f4815cdd0 0x7f6f4815e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.959+0000 7f78dde00700 1 -- 172.21.15.80:0/2182123174 >> v2:172.21.15.80:3300/0 conn(0x7f78d80cf080 msgr2=0x7f78d813f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:47.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.959+0000 7f78dde00700 1 --2- 172.21.15.80:0/2182123174 >> v2:172.21.15.80:3300/0 conn(0x7f78d80cf080 0x7f78d813f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.959+0000 7f78dde00700 1 -- 172.21.15.80:0/2182123174 >> v1:172.21.15.106:6789/0 conn(0x7f78d8140870 legacy=0x7f78d80cbc30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T04:22:47.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.959+0000 7f78dde00700 1 -- 172.21.15.80:0/2182123174 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d80cf5b0 con 0x7f78d8071690 2024-05-10T04:22:47.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.958+0000 7fdcca800700 1 --2- 172.21.15.80:0/1818524619 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcb00051a0 0x7fdcb000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:47.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.958+0000 7fdcd0c00700 1 -- 172.21.15.80:0/1818524619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcb0004850 msgr2=0x7fdcb0004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.958+0000 7fdcd0c00700 1 --2- 172.21.15.80:0/1818524619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcb0004850 0x7fdcb0004c60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0d4c70 tx=0x7fdcb0005880 comp rx=0 tx=0).stop 2024-05-10T04:22:47.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.959+0000 7f6f4d400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f481575a0 con 0x7f6f4815cdd0 2024-05-10T04:22:47.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.959+0000 7f6f4d400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4815d620 con 0x7f6f480b2900 2024-05-10T04:22:47.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.959+0000 7f6f4d400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4815e480 con 0x7f6f480ae8f0 2024-05-10T04:22:47.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.959+0000 7f78dde00700 1 --2- 172.21.15.80:0/2182123174 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78d8071690 0x7f78d8071aa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f78d000d150 tx=0x7f78d000d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e205cb3d4cb0b09c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.959+0000 7f6f4ca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f4815cdd0 0x7f6f4815e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.959+0000 7f6f4ca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f4815cdd0 0x7f6f4815e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53118/0 (socket says 172.21.15.80:53118) 2024-05-10T04:22:47.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.959+0000 7f6f4ca00700 1 -- 172.21.15.80:0/3145553104 learned_addr learned my addr 172.21.15.80:0/3145553104 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:47.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.959+0000 7f78d7e00700 1 -- 172.21.15.80:0/2182123174 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0010070 con 0x7f78d8071690 2024-05-10T04:22:47.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.960+0000 7f78d7e00700 1 -- 172.21.15.80:0/2182123174 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d000db70 con 0x7f78d8071690 2024-05-10T04:22:47.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.960+0000 7f78d7e00700 1 -- 172.21.15.80:0/2182123174 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0003a20 con 0x7f78d8071690 2024-05-10T04:22:47.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.960+0000 7f6f47400700 1 --2- 172.21.15.80:0/3145553104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f480b2900 0x7f6f48156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.960+0000 7f6f4ca00700 1 -- 172.21.15.80:0/3145553104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f480ae8f0 msgr2=0x7f6f48152a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T04:22:47.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.960+0000 7f6f4ca00700 1 --2- 172.21.15.80:0/3145553104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f480ae8f0 0x7f6f48152a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.960+0000 7f6f4ca00700 1 -- 172.21.15.80:0/3145553104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f480b2900 msgr2=0x7f6f48156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.960+0000 7f6f4ca00700 1 --2- 172.21.15.80:0/3145553104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f480b2900 0x7f6f48156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.960+0000 7f6f4ca00700 1 -- 172.21.15.80:0/3145553104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f340094a0 con 0x7f6f4815cdd0 2024-05-10T04:22:47.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.961+0000 7f78dfe00700 1 -- 172.21.15.80:0/2182123174 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78d8071690 msgr2=0x7f78d8071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.961+0000 7f78dfe00700 1 --2- 172.21.15.80:0/2182123174 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78d8071690 0x7f78d8071aa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f78d000d150 tx=0x7f78d000d460 comp rx=0 tx=0).stop 2024-05-10T04:22:47.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.961+0000 7f6f4ca00700 1 --2- 172.21.15.80:0/3145553104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f4815cdd0 0x7f6f4815e910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400e8c0 tx=0x7f6f3400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.961+0000 7f78dfe00700 1 -- 172.21.15.80:0/2182123174 shutdown_connections 2024-05-10T04:22:47.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.958+0000 7f4247e00700 1 -- 172.21.15.80:0/1252358101 wait complete. 2024-05-10T04:22:47.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.962+0000 7f78dfe00700 1 --2- 172.21.15.80:0/2182123174 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78d8071690 0x7f78d8071aa0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.962+0000 7f78dfe00700 1 --2- 172.21.15.80:0/2182123174 >> v2:172.21.15.80:3300/0 conn(0x7f78d80cf080 0x7f78d813f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.962+0000 7f78dfe00700 1 -- 172.21.15.80:0/2182123174 >> 172.21.15.80:0/2182123174 conn(0x7f78d80cfa80 msgr2=0x7f78d80cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:47.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.962+0000 7f78dfe00700 1 -- 172.21.15.80:0/2182123174 shutdown_connections 2024-05-10T04:22:47.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.962+0000 7f6f3fe00700 1 -- 172.21.15.80:0/3145553104 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f34004020 con 0x7f6f4815cdd0 2024-05-10T04:22:47.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.962+0000 7f78dfe00700 1 -- 172.21.15.80:0/2182123174 wait complete. 2024-05-10T04:22:47.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.962+0000 7fdcca800700 1 -- 172.21.15.80:0/1818524619 reap_dead start 2024-05-10T04:22:47.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.962+0000 7fdcd0c00700 1 -- 172.21.15.80:0/1818524619 shutdown_connections 2024-05-10T04:22:47.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.962+0000 7fdcd0c00700 1 -- 172.21.15.80:0/1818524619 >> 172.21.15.80:0/1818524619 conn(0x7fdccc06c4e0 msgr2=0x7fdccc06c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:47.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.962+0000 7f6f3fe00700 1 -- 172.21.15.80:0/3145553104 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f340041a0 con 0x7f6f4815cdd0 2024-05-10T04:22:47.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.962+0000 7f6f3fe00700 1 -- 172.21.15.80:0/3145553104 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f34004550 con 0x7f6f4815cdd0 2024-05-10T04:22:47.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.963+0000 7fdcd0c00700 1 -- 172.21.15.80:0/1818524619 shutdown_connections 2024-05-10T04:22:47.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.963+0000 7f4247e00700 1 Processor -- start 2024-05-10T04:22:47.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.962+0000 7f6f4d400700 1 -- 172.21.15.80:0/3145553104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f38009550 con 0x7f6f4815cdd0 2024-05-10T04:22:47.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.962+0000 7f6f4d400700 1 -- 172.21.15.80:0/3145553104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f48152f50 con 0x7f6f4815cdd0 2024-05-10T04:22:47.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.963+0000 7fdcd0c00700 1 -- 172.21.15.80:0/1818524619 wait complete. 2024-05-10T04:22:47.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.963+0000 7f4247e00700 1 -- start start 2024-05-10T04:22:47.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.966+0000 7f4247e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f424806ac30 0x7f42481f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.964+0000 7f6f4d400700 1 -- 172.21.15.80:0/3145553104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f48074af0 con 0x7f6f4815cdd0 2024-05-10T04:22:47.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.967+0000 7f4247e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f424806b0b0 0x7f4248151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.967+0000 7f78dfe00700 1 Processor -- start 2024-05-10T04:22:47.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.967+0000 7f4247e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f424815a2e0 0x7f42481f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.967+0000 7f4246000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f424806b0b0 0x7f4248151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.967+0000 7f4246a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f424806ac30 0x7f42481f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.967+0000 7f4246000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f424806b0b0 0x7f4248151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43338/0 (socket says 172.21.15.80:43338) 2024-05-10T04:22:47.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.967+0000 7f4246000700 1 -- 172.21.15.80:0/3980600912 learned_addr learned my addr 172.21.15.80:0/3980600912 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:47.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.967+0000 7f78dfe00700 1 -- start start 2024-05-10T04:22:47.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.967+0000 7f4247400700 1 --2- 172.21.15.80:0/3980600912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f424815a2e0 0x7f42481f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.968+0000 7f4247e00700 1 -- 172.21.15.80:0/3980600912 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4248169a90 con 0x7f424806ac30 2024-05-10T04:22:47.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.968+0000 7f4247e00700 1 -- 172.21.15.80:0/3980600912 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424816b470 con 0x7f424815a2e0 2024-05-10T04:22:47.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.968+0000 7f4247e00700 1 -- 172.21.15.80:0/3980600912 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424816bf60 con 0x7f424806b0b0 2024-05-10T04:22:47.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.969+0000 7f4246000700 1 -- 172.21.15.80:0/3980600912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f424815a2e0 msgr2=0x7f42481f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.969+0000 7f4246000700 1 --2- 172.21.15.80:0/3980600912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f424815a2e0 0x7f42481f1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.969+0000 7f4246000700 1 -- 172.21.15.80:0/3980600912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f424806ac30 msgr2=0x7f42481f4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.969+0000 7f4246000700 1 --2- 172.21.15.80:0/3980600912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f424806ac30 0x7f42481f4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.969+0000 7f4246000700 1 -- 172.21.15.80:0/3980600912 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4234009550 con 0x7f424806b0b0 2024-05-10T04:22:47.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.970+0000 7fdcd0c00700 1 Processor -- start 2024-05-10T04:22:47.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.970+0000 7fdcd0c00700 1 -- start start 2024-05-10T04:22:47.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.970+0000 7f6f3fe00700 1 -- 172.21.15.80:0/3145553104 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6f340036a0 con 0x7f6f4815cdd0 2024-05-10T04:22:47.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.971+0000 7f4246000700 1 --2- 172.21.15.80:0/3980600912 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f424806b0b0 0x7f4248151b60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4234009c10 tx=0x7f4234004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.970+0000 7f78dfe00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78d8071690 0x7f78d81f7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.970+0000 7f78dfe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78d80cf080 0x7f78d815bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.970+0000 7f78dfe00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78d8140870 0x7f78d80c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.970+0000 7f78dfe00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d813eae0 con 0x7f78d80cf080 2024-05-10T04:22:47.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.970+0000 7f78dfe00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d80b2cd0 con 0x7f78d8140870 2024-05-10T04:22:47.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.970+0000 7f78dfe00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d80b4710 con 0x7f78d8071690 2024-05-10T04:22:47.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.971+0000 7f423ea00700 1 -- 172.21.15.80:0/3980600912 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234003ce0 con 0x7f424806b0b0 2024-05-10T04:22:47.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.971+0000 7f423ea00700 1 -- 172.21.15.80:0/3980600912 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4234003e40 con 0x7f424806b0b0 2024-05-10T04:22:47.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.971+0000 7f423ea00700 1 -- 172.21.15.80:0/3980600912 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234011870 con 0x7f424806b0b0 2024-05-10T04:22:47.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.971+0000 7f78dd400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78d8071690 0x7f78d81f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.971+0000 7f4247e00700 1 -- 172.21.15.80:0/3980600912 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42481520a0 con 0x7f424806b0b0 2024-05-10T04:22:47.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.971+0000 7f4247e00700 1 -- 172.21.15.80:0/3980600912 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424816b9a0 con 0x7f424806b0b0 2024-05-10T04:22:47.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.971+0000 7f78dd400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78d8071690 0x7f78d81f7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43344/0 (socket says 172.21.15.80:43344) 2024-05-10T04:22:47.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.972+0000 7f78dd400700 1 -- 172.21.15.80:0/1487567491 learned_addr learned my addr 172.21.15.80:0/1487567491 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:47.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.972+0000 7f78dde00700 1 --2- 172.21.15.80:0/1487567491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78d8140870 0x7f78d80c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.972+0000 7f78dca00700 1 --2- 172.21.15.80:0/1487567491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78d80cf080 0x7f78d815bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.973+0000 7f6f3fe00700 1 --2- 172.21.15.80:0/3145553104 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6f2806ad90 0x7f6f2806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.973+0000 7f6f3fe00700 1 -- 172.21.15.80:0/3145553104 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f34089670 con 0x7f6f4815cdd0 2024-05-10T04:22:47.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.973+0000 7f6f47e00700 1 --2- 172.21.15.80:0/3145553104 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6f2806ad90 0x7f6f2806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.973+0000 7f78dca00700 1 -- 172.21.15.80:0/1487567491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78d8071690 msgr2=0x7f78d81f7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.973+0000 7f78dca00700 1 --2- 172.21.15.80:0/1487567491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78d8071690 0x7f78d81f7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.973+0000 7f78dca00700 1 -- 172.21.15.80:0/1487567491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78d8140870 msgr2=0x7f78d80c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.973+0000 7f78dca00700 1 --2- 172.21.15.80:0/1487567491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78d8140870 0x7f78d80c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.973+0000 7f78dca00700 1 -- 172.21.15.80:0/1487567491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d000bd40 con 0x7f78d80cf080 2024-05-10T04:22:47.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.974+0000 7f6f47e00700 1 --2- 172.21.15.80:0/3145553104 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6f2806ad90 0x7f6f2806d2a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6f48072220 tx=0x7f6f38008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.971+0000 7f8ee8600700 1 Processor -- start 2024-05-10T04:22:47.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.971+0000 7f8ee8600700 1 -- start start 2024-05-10T04:22:47.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.974+0000 7f8ee8600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ee00cec00 0x7f8ee015cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.974+0000 7fdcd0c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb0004850 0x7fdccc200e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.975+0000 7fdcd0c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdccc06efc0 0x7fdccc06f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.975+0000 7fdcd0c00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdccc071560 0x7fdccc071970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.975+0000 7f78dca00700 1 --2- 172.21.15.80:0/1487567491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78d80cf080 0x7f78d815bac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00b440 tx=0x7f78cc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.975+0000 7f8ee5c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ee00cec00 0x7f8ee015cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.975+0000 7fdcc9400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdccc06efc0 0x7fdccc06f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.975+0000 7fdcc9400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdccc06efc0 0x7fdccc06f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43350/0 (socket says 172.21.15.80:43350) 2024-05-10T04:22:47.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.975+0000 7fdcc9400700 1 -- 172.21.15.80:0/2320614932 learned_addr learned my addr 172.21.15.80:0/2320614932 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:47.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.975+0000 7fdcd0c00700 1 -- 172.21.15.80:0/2320614932 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc201750 con 0x7fdcb0004850 2024-05-10T04:22:47.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.975+0000 7fdcd0c00700 1 -- 172.21.15.80:0/2320614932 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc06f910 con 0x7fdccc071560 2024-05-10T04:22:47.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.975+0000 7fdcd0c00700 1 -- 172.21.15.80:0/2320614932 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc071eb0 con 0x7fdccc06efc0 2024-05-10T04:22:47.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.975+0000 7fdcca800700 1 --2- 172.21.15.80:0/2320614932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdccc071560 0x7fdccc071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.976+0000 7f8ee5c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ee00cec00 0x7f8ee015cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43346/0 (socket says 172.21.15.80:43346) 2024-05-10T04:22:47.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.976+0000 7fdcc9400700 1 -- 172.21.15.80:0/2320614932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdccc071560 msgr2=0x7fdccc071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.976+0000 7fdcc9400700 1 --2- 172.21.15.80:0/2320614932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdccc071560 0x7fdccc071970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.976+0000 7fdcc9400700 1 -- 172.21.15.80:0/2320614932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb0004850 msgr2=0x7fdccc200e10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T04:22:47.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.976+0000 7fdcc9400700 1 --2- 172.21.15.80:0/2320614932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb0004850 0x7fdccc200e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.976+0000 7fdcc9400700 1 -- 172.21.15.80:0/2320614932 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc0704c0 con 0x7fdccc06efc0 2024-05-10T04:22:47.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.977+0000 7f4247e00700 1 -- 172.21.15.80:0/3980600912 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42200052f0 con 0x7f424806b0b0 2024-05-10T04:22:47.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.976+0000 7fdcc9400700 1 --2- 172.21.15.80:0/2320614932 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdccc06efc0 0x7fdccc06f3d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00e4b0 tx=0x7fdcbc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.977+0000 7fdcc2000700 1 -- 172.21.15.80:0/2320614932 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc021070 con 0x7fdccc06efc0 2024-05-10T04:22:47.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.977+0000 7f8ee5200700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8ee0166a00 0x7f8ee00d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41548/0 (socket says 172.21.15.80:41548) 2024-05-10T04:22:47.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.977+0000 7f8ee5c00700 1 -- 172.21.15.80:0/120826281 learned_addr learned my addr 172.21.15.80:0/120826281 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:47.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.977+0000 7fdcc2000700 1 -- 172.21.15.80:0/2320614932 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc0038b0 con 0x7fdccc06efc0 2024-05-10T04:22:47.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.977+0000 7f423ea00700 1 -- 172.21.15.80:0/3980600912 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f42340119d0 con 0x7f424806b0b0 2024-05-10T04:22:47.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.977+0000 7fdcc2000700 1 -- 172.21.15.80:0/2320614932 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc003c20 con 0x7fdccc06efc0 2024-05-10T04:22:47.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.977+0000 7fdcd0c00700 1 -- 172.21.15.80:0/2320614932 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdccc0707a0 con 0x7fdccc06efc0 2024-05-10T04:22:47.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.978+0000 7fdcd0c00700 1 -- 172.21.15.80:0/2320614932 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc070d60 con 0x7fdccc06efc0 2024-05-10T04:22:47.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.978+0000 7f78d5600700 1 -- 172.21.15.80:0/1487567491 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc011620 con 0x7f78d80cf080 2024-05-10T04:22:47.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.979+0000 7f78d5600700 1 -- 172.21.15.80:0/1487567491 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78cc011780 con 0x7f78d80cf080 2024-05-10T04:22:47.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.979+0000 7f78dfe00700 1 -- 172.21.15.80:0/1487567491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d815c2c0 con 0x7f78d80cf080 2024-05-10T04:22:47.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.979+0000 7f423ea00700 1 --2- 172.21.15.80:0/3980600912 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f422806ac90 0x7f422806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.979+0000 7f423ea00700 1 -- 172.21.15.80:0/3980600912 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f423408a030 con 0x7f424806b0b0 2024-05-10T04:22:47.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.980+0000 7f4246a00700 1 --2- 172.21.15.80:0/3980600912 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f422806ac90 0x7f422806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.980+0000 7f8ee8600700 1 --2- 172.21.15.80:0/120826281 >> v2:172.21.15.80:3300/0 conn(0x7f8ee00d0bc0 0x7f8ee00d1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.979+0000 7f78d5600700 1 -- 172.21.15.80:0/1487567491 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc011b10 con 0x7f78d80cf080 2024-05-10T04:22:47.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.979+0000 7f78dfe00700 1 -- 172.21.15.80:0/1487567491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d81f7790 con 0x7f78d80cf080 2024-05-10T04:22:47.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.980+0000 7f78dfe00700 1 -- 172.21.15.80:0/1487567491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b40052f0 con 0x7f78d80cf080 2024-05-10T04:22:47.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.980+0000 7f4246a00700 1 --2- 172.21.15.80:0/3980600912 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f422806ac90 0x7f422806d1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4240009fd0 tx=0x7f424000d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.980+0000 7f8ee8600700 1 -- 172.21.15.80:0/120826281 --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee0162c50 con 0x7f8ee0166a00 2024-05-10T04:22:47.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.981+0000 7fdcd0c00700 1 -- 172.21.15.80:0/2320614932 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdccc074af0 con 0x7fdccc06efc0 2024-05-10T04:22:47.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.981+0000 7f6f3fe00700 1 -- 172.21.15.80:0/3145553104 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6f340548c0 con 0x7f6f4815cdd0 2024-05-10T04:22:47.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.981+0000 7f8ee6600700 1 --2- 172.21.15.80:0/120826281 >> v2:172.21.15.80:3300/0 conn(0x7f8ee00d0bc0 0x7f8ee00d1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.981+0000 7f8ee8600700 1 -- 172.21.15.80:0/120826281 --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee00d1b20 con 0x7f8ee00d0bc0 2024-05-10T04:22:47.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.981+0000 7f8ee8600700 1 -- 172.21.15.80:0/120826281 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee0162f30 con 0x7f8ee00cec00 2024-05-10T04:22:47.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.983+0000 7f8ee6600700 1 -- 172.21.15.80:0/120826281 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ee00cec00 msgr2=0x7f8ee015cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:47.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.983+0000 7f8ee6600700 1 --2- 172.21.15.80:0/120826281 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ee00cec00 0x7f8ee015cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:47.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.983+0000 7f8ee6600700 1 -- 172.21.15.80:0/120826281 >> v1:172.21.15.80:6789/0 conn(0x7f8ee0166a00 legacy=0x7f8ee00d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:47.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.983+0000 7f8ee6600700 1 -- 172.21.15.80:0/120826281 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee0163210 con 0x7f8ee00d0bc0 2024-05-10T04:22:47.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.983+0000 7f8ee6600700 1 --2- 172.21.15.80:0/120826281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee00d0bc0 0x7f8ee00d1f70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc009840 tx=0x7f8ecc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0099ccdce32944 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.983+0000 7f423ea00700 1 -- 172.21.15.80:0/3980600912 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f42340553c0 con 0x7f424806b0b0 2024-05-10T04:22:47.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.987+0000 7f8edfe00700 1 -- 172.21.15.80:0/120826281 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc011830 con 0x7f8ee00d0bc0 2024-05-10T04:22:47.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.991+0000 7fdcc2000700 1 -- 172.21.15.80:0/2320614932 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdcbc026470 con 0x7fdccc06efc0 2024-05-10T04:22:47.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.989+0000 7f78d5600700 1 -- 172.21.15.80:0/1487567491 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f78cc011c70 con 0x7f78d80cf080 2024-05-10T04:22:47.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.990+0000 7f78d5600700 1 --2- 172.21.15.80:0/1487567491 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f78b806ace0 0x7f78b806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.991+0000 7f78d5600700 1 -- 172.21.15.80:0/1487567491 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78cc089640 con 0x7f78d80cf080 2024-05-10T04:22:47.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.991+0000 7f78dd400700 1 --2- 172.21.15.80:0/1487567491 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f78b806ace0 0x7f78b806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.992+0000 7f78dd400700 1 --2- 172.21.15.80:0/1487567491 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f78b806ace0 0x7f78b806d1f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f78c4007af0 tx=0x7f78c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.992+0000 7fdcc2000700 1 --2- 172.21.15.80:0/2320614932 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdcac06ad90 0x7fdcac06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:47.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.993+0000 7fdcc2000700 1 -- 172.21.15.80:0/2320614932 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcbc08ae50 con 0x7fdccc06efc0 2024-05-10T04:22:47.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.993+0000 7fdcc2000700 1 -- 172.21.15.80:0/2320614932 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdcbc08b230 con 0x7fdccc06efc0 2024-05-10T04:22:47.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.993+0000 7fdcc9e00700 1 --2- 172.21.15.80:0/2320614932 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdcac06ad90 0x7fdcac06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:47.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.994+0000 7fdcc9e00700 1 --2- 172.21.15.80:0/2320614932 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdcac06ad90 0x7fdcac06d2a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009670 tx=0x7fdcc400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:47.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.996+0000 7f8edfe00700 1 -- 172.21.15.80:0/120826281 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc011990 con 0x7f8ee00d0bc0 2024-05-10T04:22:47.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.996+0000 7f8edfe00700 1 -- 172.21.15.80:0/120826281 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc011d20 con 0x7f8ee00d0bc0 2024-05-10T04:22:47.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.996+0000 7f78d5600700 1 -- 172.21.15.80:0/1487567491 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f78cc054900 con 0x7f78d80cf080 2024-05-10T04:22:48.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.998+0000 7f8ee8600700 1 -- 172.21.15.80:0/120826281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee00d0bc0 msgr2=0x7f8ee00d1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.998+0000 7f8ee8600700 1 --2- 172.21.15.80:0/120826281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee00d0bc0 0x7f8ee00d1f70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc009840 tx=0x7f8ecc009b50 comp rx=0 tx=0).stop 2024-05-10T04:22:48.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.999+0000 7f8ee8600700 1 -- 172.21.15.80:0/120826281 shutdown_connections 2024-05-10T04:22:48.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.999+0000 7f8ee8600700 1 --2- 172.21.15.80:0/120826281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee00d0bc0 0x7f8ee00d1f70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.999+0000 7f8ee8600700 1 --2- 172.21.15.80:0/120826281 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ee00cec00 0x7f8ee015cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.999+0000 7f8ee8600700 1 -- 172.21.15.80:0/120826281 >> 172.21.15.80:0/120826281 conn(0x7f8ee006c2c0 msgr2=0x7f8ee006c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:48.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.999+0000 7f8ee8600700 1 -- 172.21.15.80:0/120826281 shutdown_connections 2024-05-10T04:22:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:47.999+0000 7f8ee8600700 1 -- 172.21.15.80:0/120826281 wait complete. 2024-05-10T04:22:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.004+0000 7f8ee8600700 1 Processor -- start 2024-05-10T04:22:48.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.004+0000 7f8ee8600700 1 -- start start 2024-05-10T04:22:48.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.007+0000 7f8ee8600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ee00cec00 0x7f8ee015b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:48.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.007+0000 7f8ee8600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee00d0bc0 0x7f8ee00b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:48.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.007+0000 7f8ee8600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ee0166a00 0x7f8ee00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:48.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.007+0000 7f8ee5200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee00d0bc0 0x7f8ee00b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:48.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.008+0000 7f8ee5200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee00d0bc0 0x7f8ee00b6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53140/0 (socket says 172.21.15.80:53140) 2024-05-10T04:22:48.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.008+0000 7f8ee5200700 1 -- 172.21.15.80:0/1016665959 learned_addr learned my addr 172.21.15.80:0/1016665959 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:48.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.008+0000 7f8ee8600700 1 -- 172.21.15.80:0/1016665959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee0202c00 con 0x7f8ee00d0bc0 2024-05-10T04:22:48.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.008+0000 7f8ee6600700 1 --2- 172.21.15.80:0/1016665959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ee0166a00 0x7f8ee00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:48.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.008+0000 7f8ee8600700 1 -- 172.21.15.80:0/1016665959 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee00b7770 con 0x7f8ee00cec00 2024-05-10T04:22:48.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.008+0000 7f8ee8600700 1 -- 172.21.15.80:0/1016665959 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee00b79c0 con 0x7f8ee0166a00 2024-05-10T04:22:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.008+0000 7f8ee5c00700 1 --2- 172.21.15.80:0/1016665959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ee00cec00 0x7f8ee015b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.009+0000 7f8ee5200700 1 -- 172.21.15.80:0/1016665959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ee0166a00 msgr2=0x7f8ee00706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.009+0000 7f8ee5200700 1 --2- 172.21.15.80:0/1016665959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ee0166a00 0x7f8ee00706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.009+0000 7f8ee5200700 1 -- 172.21.15.80:0/1016665959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ee00cec00 msgr2=0x7f8ee015b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.009+0000 7f8ee5200700 1 --2- 172.21.15.80:0/1016665959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ee00cec00 0x7f8ee015b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.009+0000 7f8ee5200700 1 -- 172.21.15.80:0/1016665959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc0094a0 con 0x7f8ee00d0bc0 2024-05-10T04:22:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.009+0000 7f8ee5200700 1 --2- 172.21.15.80:0/1016665959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee00d0bc0 0x7f8ee00b6f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400c4d0 tx=0x7f8ed400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.010+0000 7f8edd600700 1 -- 172.21.15.80:0/1016665959 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4005cb0 con 0x7f8ee00d0bc0 2024-05-10T04:22:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.010+0000 7f8edd600700 1 -- 172.21.15.80:0/1016665959 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed4005e10 con 0x7f8ee00d0bc0 2024-05-10T04:22:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.010+0000 7f8ee8600700 1 -- 172.21.15.80:0/1016665959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee00b7ca0 con 0x7f8ee00d0bc0 2024-05-10T04:22:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.010+0000 7f8edd600700 1 -- 172.21.15.80:0/1016665959 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed40072d0 con 0x7f8ee00d0bc0 2024-05-10T04:22:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.010+0000 7f8ee8600700 1 -- 172.21.15.80:0/1016665959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee00b8260 con 0x7f8ee00d0bc0 2024-05-10T04:22:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.014+0000 7f8edd600700 1 -- 172.21.15.80:0/1016665959 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8ed4007430 con 0x7f8ee00d0bc0 2024-05-10T04:22:48.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.015+0000 7f8edd600700 1 --2- 172.21.15.80:0/1016665959 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8ec006acc0 0x7f8ec006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:48.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.016+0000 7f8edd600700 1 -- 172.21.15.80:0/1016665959 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ed4057570 con 0x7f8ee00d0bc0 2024-05-10T04:22:48.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.016+0000 7f8ee5c00700 1 --2- 172.21.15.80:0/1016665959 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8ec006acc0 0x7f8ec006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:48.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.017+0000 7f8ee5c00700 1 --2- 172.21.15.80:0/1016665959 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8ec006acc0 0x7f8ec006d1d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00b3450 tx=0x7f8ed800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:48.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.018+0000 7f8ee8600700 1 -- 172.21.15.80:0/1016665959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee00b9bf0 con 0x7f8ee00d0bc0 2024-05-10T04:22:48.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.028+0000 7f8edd600700 1 -- 172.21.15.80:0/1016665959 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8ed4017070 con 0x7f8ee00d0bc0 2024-05-10T04:22:48.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.239+0000 7fe81a400700 1 -- 172.21.15.80:0/277273990 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe80c0dde70 con 0x7fe80c0e03b0 2024-05-10T04:22:48.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.242+0000 7fe807400700 1 -- 172.21.15.80:0/277273990 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe814098070 con 0x7fe80c0e03b0 2024-05-10T04:22:48.248 INFO:teuthology.orchestra.run.smithi080.stdout:55834574856 2024-05-10T04:22:48.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.248+0000 7fe81a400700 1 -- 172.21.15.80:0/277273990 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe7f406ad50 msgr2=0x7fe7f406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.248+0000 7fe81a400700 1 --2- 172.21.15.80:0/277273990 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe7f406ad50 0x7fe7f406d260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe8080011e0 tx=0x7fe808009040 comp rx=0 tx=0).stop 2024-05-10T04:22:48.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.248+0000 7fe81a400700 1 -- 172.21.15.80:0/277273990 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe80c0e03b0 msgr2=0x7fe80c0ee300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.248+0000 7fe81a400700 1 --2- 172.21.15.80:0/277273990 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe80c0e03b0 0x7fe80c0ee300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe814050680 tx=0x7fe814068750 comp rx=0 tx=0).stop 2024-05-10T04:22:48.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.248+0000 7fe81a400700 1 -- 172.21.15.80:0/277273990 shutdown_connections 2024-05-10T04:22:48.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.248+0000 7fe81a400700 1 --2- 172.21.15.80:0/277273990 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe7f406ad50 0x7fe7f406d260 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.248+0000 7fe81a400700 1 --2- 172.21.15.80:0/277273990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe80c0339b0 0x7fe80c04ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.248+0000 7fe81a400700 1 --2- 172.21.15.80:0/277273990 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe80c0e03b0 0x7fe80c0ee300 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.248+0000 7fe81a400700 1 --2- 172.21.15.80:0/277273990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe80c053e40 0x7fe80c0eddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.248+0000 7fe81a400700 1 -- 172.21.15.80:0/277273990 >> 172.21.15.80:0/277273990 conn(0x7fe80c054d50 msgr2=0x7fe80c0e3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:48.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.249+0000 7fe81a400700 1 -- 172.21.15.80:0/277273990 shutdown_connections 2024-05-10T04:22:48.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.249+0000 7fe81a400700 1 -- 172.21.15.80:0/277273990 wait complete. 2024-05-10T04:22:48.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.0 2024-05-10T04:22:48.294 DEBUG:teuthology.parallel:result is None 2024-05-10T04:22:48.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.343+0000 7fa698000700 1 -- 172.21.15.80:0/1770389023 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa6901565d0 con 0x7fa6900cf080 2024-05-10T04:22:48.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.344+0000 7fa68d600700 1 -- 172.21.15.80:0/1770389023 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa68000be60 con 0x7fa6900cf080 2024-05-10T04:22:48.345 INFO:teuthology.orchestra.run.smithi080.stdout:55834574857 2024-05-10T04:22:48.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.347+0000 7fa698000700 1 -- 172.21.15.80:0/1770389023 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa66c06ace0 msgr2=0x7fa66c06d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.348+0000 7fa698000700 1 --2- 172.21.15.80:0/1770389023 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa66c06ace0 0x7fa66c06d1f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa690155f50 tx=0x7fa688009040 comp rx=0 tx=0).stop 2024-05-10T04:22:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.348+0000 7fa698000700 1 -- 172.21.15.80:0/1770389023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6900cf080 msgr2=0x7fa690156090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.348+0000 7fa698000700 1 --2- 172.21.15.80:0/1770389023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6900cf080 0x7fa690156090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa68000b410 tx=0x7fa680009f90 comp rx=0 tx=0).stop 2024-05-10T04:22:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.348+0000 7fa698000700 1 -- 172.21.15.80:0/1770389023 shutdown_connections 2024-05-10T04:22:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.348+0000 7fa698000700 1 --2- 172.21.15.80:0/1770389023 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa66c06ace0 0x7fa66c06d1f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.348+0000 7fa698000700 1 --2- 172.21.15.80:0/1770389023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6900cf080 0x7fa690156090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.348+0000 7fa698000700 1 --2- 172.21.15.80:0/1770389023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa69015d070 0x7fa6900c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.348+0000 7fa698000700 1 --2- 172.21.15.80:0/1770389023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa690140870 0x7fa690154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.348+0000 7fa698000700 1 -- 172.21.15.80:0/1770389023 >> 172.21.15.80:0/1770389023 conn(0x7fa6900cfa80 msgr2=0x7fa690159a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:48.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.348+0000 7fa698000700 1 -- 172.21.15.80:0/1770389023 shutdown_connections 2024-05-10T04:22:48.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.348+0000 7fa698000700 1 -- 172.21.15.80:0/1770389023 wait complete. 2024-05-10T04:22:48.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.356+0000 7f5454a00700 1 -- 172.21.15.80:0/2345121823 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5450071700 con 0x7f54500cf7f0 2024-05-10T04:22:48.359 INFO:teuthology.orchestra.run.smithi080.stdout:55834574855 2024-05-10T04:22:48.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.358+0000 7f5446a00700 1 -- 172.21.15.80:0/2345121823 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5438016090 con 0x7f54500cf7f0 2024-05-10T04:22:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.362+0000 7f5454a00700 1 -- 172.21.15.80:0/2345121823 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f542c06ace0 msgr2=0x7f542c06d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.362+0000 7f5454a00700 1 --2- 172.21.15.80:0/2345121823 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f542c06ace0 0x7f542c06d1f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5440000fb0 tx=0x7f5440009040 comp rx=0 tx=0).stop 2024-05-10T04:22:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.362+0000 7f5454a00700 1 -- 172.21.15.80:0/2345121823 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54500cf7f0 msgr2=0x7f54500b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.362+0000 7f5454a00700 1 --2- 172.21.15.80:0/2345121823 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54500cf7f0 0x7f54500b1ba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5438004000 tx=0x7f5438004750 comp rx=0 tx=0).stop 2024-05-10T04:22:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.362+0000 7f5454a00700 1 -- 172.21.15.80:0/2345121823 shutdown_connections 2024-05-10T04:22:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.362+0000 7f5454a00700 1 --2- 172.21.15.80:0/2345121823 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f542c06ace0 0x7f542c06d1f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.362+0000 7f5454a00700 1 --2- 172.21.15.80:0/2345121823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54500d02e0 0x7f54501da870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.362+0000 7f5454a00700 1 --2- 172.21.15.80:0/2345121823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54500b5430 0x7f54500c06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.362+0000 7f5454a00700 1 --2- 172.21.15.80:0/2345121823 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54500cf7f0 0x7f54500b1ba0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.362+0000 7f5454a00700 1 -- 172.21.15.80:0/2345121823 >> 172.21.15.80:0/2345121823 conn(0x7f54500ce6a0 msgr2=0x7f5450070ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.362+0000 7f5454a00700 1 -- 172.21.15.80:0/2345121823 shutdown_connections 2024-05-10T04:22:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.363+0000 7f5454a00700 1 -- 172.21.15.80:0/2345121823 wait complete. 2024-05-10T04:22:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.366+0000 7f6f4d400700 1 -- 172.21.15.80:0/3145553104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6f4815e5c0 con 0x7f6f4815cdd0 2024-05-10T04:22:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.368+0000 7f6f3fe00700 1 -- 172.21.15.80:0/3145553104 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f34057ee0 con 0x7f6f4815cdd0 2024-05-10T04:22:48.371 INFO:teuthology.orchestra.run.smithi080.stdout:55834574855 2024-05-10T04:22:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.371+0000 7f6f4d400700 1 -- 172.21.15.80:0/3145553104 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6f2806ad90 msgr2=0x7f6f2806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.371+0000 7f6f4d400700 1 --2- 172.21.15.80:0/3145553104 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6f2806ad90 0x7f6f2806d2a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6f48072220 tx=0x7f6f38008030 comp rx=0 tx=0).stop 2024-05-10T04:22:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.371+0000 7f6f4d400700 1 -- 172.21.15.80:0/3145553104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f4815cdd0 msgr2=0x7f6f4815e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.371+0000 7f6f4d400700 1 --2- 172.21.15.80:0/3145553104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f4815cdd0 0x7f6f4815e910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400e8c0 tx=0x7f6f3400ebd0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.371+0000 7f6f4d400700 1 -- 172.21.15.80:0/3145553104 shutdown_connections 2024-05-10T04:22:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.371+0000 7f6f4d400700 1 --2- 172.21.15.80:0/3145553104 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6f2806ad90 0x7f6f2806d2a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.371+0000 7f6f4d400700 1 --2- 172.21.15.80:0/3145553104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f4815cdd0 0x7f6f4815e910 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.371+0000 7f6f4d400700 1 --2- 172.21.15.80:0/3145553104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f480ae8f0 0x7f6f48152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.371+0000 7f6f4d400700 1 --2- 172.21.15.80:0/3145553104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f480b2900 0x7f6f48156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.371+0000 7f6f4d400700 1 -- 172.21.15.80:0/3145553104 >> 172.21.15.80:0/3145553104 conn(0x7f6f480cf850 msgr2=0x7f6f48161cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.372+0000 7f6f4d400700 1 -- 172.21.15.80:0/3145553104 shutdown_connections 2024-05-10T04:22:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.372+0000 7f6f4d400700 1 -- 172.21.15.80:0/3145553104 wait complete. 2024-05-10T04:22:48.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.4 2024-05-10T04:22:48.396 DEBUG:teuthology.parallel:result is None 2024-05-10T04:22:48.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.6 2024-05-10T04:22:48.403 DEBUG:teuthology.parallel:result is None 2024-05-10T04:22:48.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.5 2024-05-10T04:22:48.409 DEBUG:teuthology.parallel:result is None 2024-05-10T04:22:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.423+0000 7f4247e00700 1 -- 172.21.15.80:0/3980600912 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4220005870 con 0x7f424806b0b0 2024-05-10T04:22:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.423+0000 7f423ea00700 1 -- 172.21.15.80:0/3980600912 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42340589e0 con 0x7f424806b0b0 2024-05-10T04:22:48.425 INFO:teuthology.orchestra.run.smithi080.stdout:55834574858 2024-05-10T04:22:48.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.426+0000 7f4247e00700 1 -- 172.21.15.80:0/3980600912 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f422806ac90 msgr2=0x7f422806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.426+0000 7f4247e00700 1 --2- 172.21.15.80:0/3980600912 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f422806ac90 0x7f422806d1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4240009fd0 tx=0x7f424000d040 comp rx=0 tx=0).stop 2024-05-10T04:22:48.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.426+0000 7f4247e00700 1 -- 172.21.15.80:0/3980600912 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f424806b0b0 msgr2=0x7f4248151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.426+0000 7f4247e00700 1 --2- 172.21.15.80:0/3980600912 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f424806b0b0 0x7f4248151b60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4234009c10 tx=0x7f4234004750 comp rx=0 tx=0).stop 2024-05-10T04:22:48.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.426+0000 7f4247e00700 1 -- 172.21.15.80:0/3980600912 shutdown_connections 2024-05-10T04:22:48.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.426+0000 7f4247e00700 1 --2- 172.21.15.80:0/3980600912 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f422806ac90 0x7f422806d1a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.426+0000 7f4247e00700 1 --2- 172.21.15.80:0/3980600912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f424806ac30 0x7f42481f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.426+0000 7f4247e00700 1 --2- 172.21.15.80:0/3980600912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f424815a2e0 0x7f42481f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.426+0000 7f4247e00700 1 --2- 172.21.15.80:0/3980600912 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f424806b0b0 0x7f4248151b60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.426+0000 7f4247e00700 1 -- 172.21.15.80:0/3980600912 >> 172.21.15.80:0/3980600912 conn(0x7f42480b17e0 msgr2=0x7f42480743c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.426+0000 7f4247e00700 1 -- 172.21.15.80:0/3980600912 shutdown_connections 2024-05-10T04:22:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.426+0000 7f4247e00700 1 -- 172.21.15.80:0/3980600912 wait complete. 2024-05-10T04:22:48.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.444+0000 7f8ee8600700 1 -- 172.21.15.80:0/1016665959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8ee0074af0 con 0x7f8ee00d0bc0 2024-05-10T04:22:48.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.445+0000 7f8edd600700 1 -- 172.21.15.80:0/1016665959 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ed4057340 con 0x7f8ee00d0bc0 2024-05-10T04:22:48.446 INFO:teuthology.orchestra.run.smithi080.stdout:55834574857 2024-05-10T04:22:48.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.447+0000 7f8ee8600700 1 -- 172.21.15.80:0/1016665959 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8ec006acc0 msgr2=0x7f8ec006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.447+0000 7f8ee8600700 1 --2- 172.21.15.80:0/1016665959 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8ec006acc0 0x7f8ec006d1d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00b3450 tx=0x7f8ed800b040 comp rx=0 tx=0).stop 2024-05-10T04:22:48.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.447+0000 7f8ee8600700 1 -- 172.21.15.80:0/1016665959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee00d0bc0 msgr2=0x7f8ee00b6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.447+0000 7f8ee8600700 1 --2- 172.21.15.80:0/1016665959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee00d0bc0 0x7f8ee00b6f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400c4d0 tx=0x7f8ed400c890 comp rx=0 tx=0).stop 2024-05-10T04:22:48.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.448+0000 7f8ee8600700 1 -- 172.21.15.80:0/1016665959 shutdown_connections 2024-05-10T04:22:48.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.448+0000 7f8ee8600700 1 --2- 172.21.15.80:0/1016665959 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8ec006acc0 0x7f8ec006d1d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.448+0000 7f8ee8600700 1 --2- 172.21.15.80:0/1016665959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ee0166a00 0x7f8ee00706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.448+0000 7f8ee8600700 1 --2- 172.21.15.80:0/1016665959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ee00cec00 0x7f8ee015b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.448+0000 7f8ee8600700 1 --2- 172.21.15.80:0/1016665959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee00d0bc0 0x7f8ee00b6f20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.448+0000 7f8ee8600700 1 -- 172.21.15.80:0/1016665959 >> 172.21.15.80:0/1016665959 conn(0x7f8ee006c2c0 msgr2=0x7f8ee006c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:48.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.448+0000 7f8ee8600700 1 -- 172.21.15.80:0/1016665959 shutdown_connections 2024-05-10T04:22:48.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.448+0000 7f8ee8600700 1 -- 172.21.15.80:0/1016665959 wait complete. 2024-05-10T04:22:48.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.1 2024-05-10T04:22:48.453 DEBUG:teuthology.parallel:result is None 2024-05-10T04:22:48.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.464+0000 7fdcd0c00700 1 -- 172.21.15.80:0/2320614932 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdccc071eb0 con 0x7fdccc06efc0 2024-05-10T04:22:48.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.465+0000 7fdcc2000700 1 -- 172.21.15.80:0/2320614932 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdcbc02b090 con 0x7fdccc06efc0 2024-05-10T04:22:48.466 INFO:teuthology.orchestra.run.smithi080.stdout:55834574855 2024-05-10T04:22:48.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.468+0000 7fdcd0c00700 1 -- 172.21.15.80:0/2320614932 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdcac06ad90 msgr2=0x7fdcac06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.468+0000 7fdcd0c00700 1 --2- 172.21.15.80:0/2320614932 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdcac06ad90 0x7fdcac06d2a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009670 tx=0x7fdcc400b040 comp rx=0 tx=0).stop 2024-05-10T04:22:48.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.468+0000 7fdcd0c00700 1 -- 172.21.15.80:0/2320614932 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdccc06efc0 msgr2=0x7fdccc06f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.468+0000 7fdcd0c00700 1 --2- 172.21.15.80:0/2320614932 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdccc06efc0 0x7fdccc06f3d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00e4b0 tx=0x7fdcbc0047c0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.468+0000 7f78dfe00700 1 -- 172.21.15.80:0/1487567491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f78b4005870 con 0x7f78d80cf080 2024-05-10T04:22:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.468+0000 7fdcd0c00700 1 -- 172.21.15.80:0/2320614932 shutdown_connections 2024-05-10T04:22:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.468+0000 7fdcd0c00700 1 --2- 172.21.15.80:0/2320614932 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdcac06ad90 0x7fdcac06d2a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.468+0000 7fdcd0c00700 1 --2- 172.21.15.80:0/2320614932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb0004850 0x7fdccc200e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.468+0000 7fdcd0c00700 1 --2- 172.21.15.80:0/2320614932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdccc071560 0x7fdccc071970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.468+0000 7fdcd0c00700 1 --2- 172.21.15.80:0/2320614932 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdccc06efc0 0x7fdccc06f3d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.468+0000 7fdcd0c00700 1 -- 172.21.15.80:0/2320614932 >> 172.21.15.80:0/2320614932 conn(0x7fdccc06c4e0 msgr2=0x7fdccc0b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.468+0000 7fdcd0c00700 1 -- 172.21.15.80:0/2320614932 shutdown_connections 2024-05-10T04:22:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.468+0000 7fdcd0c00700 1 -- 172.21.15.80:0/2320614932 wait complete. 2024-05-10T04:22:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.468+0000 7f78d5600700 1 -- 172.21.15.80:0/1487567491 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78cc015020 con 0x7f78d80cf080 2024-05-10T04:22:48.471 INFO:teuthology.orchestra.run.smithi080.stdout:55834574857 2024-05-10T04:22:48.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.471+0000 7f78dfe00700 1 -- 172.21.15.80:0/1487567491 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f78b806ace0 msgr2=0x7f78b806d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.471+0000 7f78dfe00700 1 --2- 172.21.15.80:0/1487567491 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f78b806ace0 0x7f78b806d1f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f78c4007af0 tx=0x7f78c4008040 comp rx=0 tx=0).stop 2024-05-10T04:22:48.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.471+0000 7f78dfe00700 1 -- 172.21.15.80:0/1487567491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78d80cf080 msgr2=0x7f78d815bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.471+0000 7f78dfe00700 1 --2- 172.21.15.80:0/1487567491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78d80cf080 0x7f78d815bac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00b440 tx=0x7f78cc009f90 comp rx=0 tx=0).stop 2024-05-10T04:22:48.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.471+0000 7f78dfe00700 1 -- 172.21.15.80:0/1487567491 shutdown_connections 2024-05-10T04:22:48.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.471+0000 7f78dfe00700 1 --2- 172.21.15.80:0/1487567491 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f78b806ace0 0x7f78b806d1f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.471+0000 7f78dfe00700 1 --2- 172.21.15.80:0/1487567491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78d8140870 0x7f78d80c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.471+0000 7f78dfe00700 1 --2- 172.21.15.80:0/1487567491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78d8071690 0x7f78d81f7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.471+0000 7f78dfe00700 1 --2- 172.21.15.80:0/1487567491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78d80cf080 0x7f78d815bac0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.471+0000 7f78dfe00700 1 -- 172.21.15.80:0/1487567491 >> 172.21.15.80:0/1487567491 conn(0x7f78d80cfa80 msgr2=0x7f78d806ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:48.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.471+0000 7f78dfe00700 1 -- 172.21.15.80:0/1487567491 shutdown_connections 2024-05-10T04:22:48.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.471+0000 7f78dfe00700 1 -- 172.21.15.80:0/1487567491 wait complete. 2024-05-10T04:22:48.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.7 2024-05-10T04:22:48.475 DEBUG:teuthology.parallel:result is None 2024-05-10T04:22:48.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.3 2024-05-10T04:22:48.495 DEBUG:teuthology.parallel:result is None 2024-05-10T04:22:48.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.2 2024-05-10T04:22:48.498 DEBUG:teuthology.parallel:result is None 2024-05-10T04:22:48.499 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T04:22:48.499 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:22:48.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.799+0000 7fb2bbe00700 1 Processor -- start 2024-05-10T04:22:48.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.799+0000 7fb2bbe00700 1 -- start start 2024-05-10T04:22:48.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.801+0000 7fb2bbe00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb2bc0b9420 0x7fb2bc0d2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:48.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.801+0000 7fb2bbe00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2bc0d2850 con 0x7fb2bc0cf360 2024-05-10T04:22:48.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.801+0000 7fb2bbe00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2bc0cf770 con 0x7fb2bc0d3220 2024-05-10T04:22:48.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.801+0000 7fb2bbe00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2bc0d3630 con 0x7fb2bc0b9420 2024-05-10T04:22:48.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.801+0000 7fb2baa00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb2bc0cf360 0x7fb2bc161d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41550/0 (socket says 172.21.15.80:41550) 2024-05-10T04:22:48.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.801+0000 7fb2baa00700 1 -- 172.21.15.80:0/747910206 learned_addr learned my addr 172.21.15.80:0/747910206 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:48.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.801+0000 7fb2b3e00700 1 --2- 172.21.15.80:0/747910206 >> v2:172.21.15.80:3300/0 conn(0x7fb2bc0b9420 0x7fb2bc0d2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.802+0000 7fb2b3e00700 1 -- 172.21.15.80:0/747910206 >> v1:172.21.15.106:6789/0 conn(0x7fb2bc0d3220 legacy=0x7fb2bc0b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.802+0000 7fb2b3e00700 1 -- 172.21.15.80:0/747910206 >> v1:172.21.15.80:6789/0 conn(0x7fb2bc0cf360 legacy=0x7fb2bc161d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.802+0000 7fb2b3e00700 1 -- 172.21.15.80:0/747910206 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc0b9830 con 0x7fb2bc0b9420 2024-05-10T04:22:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.802+0000 7fb2ba000700 1 -- 172.21.15.80:0/747910206 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025940229 0 0) 0x7fb2bc0cf770 con 0x7fb2bc0d3220 2024-05-10T04:22:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.802+0000 7fb2b3e00700 1 --2- 172.21.15.80:0/747910206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2bc0b9420 0x7fb2bc0d2ce0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009840 tx=0x7fb2a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee54fcca62114bb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.802+0000 7fb2ba000700 1 -- 172.21.15.80:0/747910206 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4011830 con 0x7fb2bc0b9420 2024-05-10T04:22:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.802+0000 7fb2ba000700 1 -- 172.21.15.80:0/747910206 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a4011990 con 0x7fb2bc0b9420 2024-05-10T04:22:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.802+0000 7fb2ba000700 1 -- 172.21.15.80:0/747910206 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4011d20 con 0x7fb2bc0b9420 2024-05-10T04:22:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.803+0000 7fb2bbe00700 1 -- 172.21.15.80:0/747910206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2bc0b9420 msgr2=0x7fb2bc0d2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.803+0000 7fb2bbe00700 1 --2- 172.21.15.80:0/747910206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2bc0b9420 0x7fb2bc0d2ce0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009840 tx=0x7fb2a4009b50 comp rx=0 tx=0).stop 2024-05-10T04:22:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.803+0000 7fb2bbe00700 1 -- 172.21.15.80:0/747910206 shutdown_connections 2024-05-10T04:22:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.803+0000 7fb2bbe00700 1 --2- 172.21.15.80:0/747910206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2bc0b9420 0x7fb2bc0d2ce0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.803+0000 7fb2bbe00700 1 -- 172.21.15.80:0/747910206 >> 172.21.15.80:0/747910206 conn(0x7fb2bc06c4e0 msgr2=0x7fb2bc06c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.803+0000 7fb2bbe00700 1 -- 172.21.15.80:0/747910206 shutdown_connections 2024-05-10T04:22:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.803+0000 7fb2bbe00700 1 -- 172.21.15.80:0/747910206 wait complete. 2024-05-10T04:22:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.806+0000 7fb2bbe00700 1 Processor -- start 2024-05-10T04:22:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.806+0000 7fb2bbe00700 1 -- start start 2024-05-10T04:22:48.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.807+0000 7fb2bbe00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2bc0b9420 0x7fb2bc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:48.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.807+0000 7fb2bbe00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2bc0cf360 0x7fb2bc0adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:48.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.807+0000 7fb2bbe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2bc0d3220 0x7fb2bc0ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:48.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.807+0000 7fb2bbe00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc0af270 con 0x7fb2bc0d3220 2024-05-10T04:22:48.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.807+0000 7fb2bbe00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc0aba80 con 0x7fb2bc0b9420 2024-05-10T04:22:48.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.807+0000 7fb2bbe00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc0ac290 con 0x7fb2bc0cf360 2024-05-10T04:22:48.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.807+0000 7fb2bb400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2bc0d3220 0x7fb2bc0ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:48.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.808+0000 7fb2bb400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2bc0d3220 0x7fb2bc0ae470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53158/0 (socket says 172.21.15.80:53158) 2024-05-10T04:22:48.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.808+0000 7fb2baa00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2bc0b9420 0x7fb2bc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:48.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.808+0000 7fb2bb400700 1 -- 172.21.15.80:0/1907709407 learned_addr learned my addr 172.21.15.80:0/1907709407 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:48.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.808+0000 7fb2b3e00700 1 --2- 172.21.15.80:0/1907709407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2bc0cf360 0x7fb2bc0adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:48.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.808+0000 7fb2bb400700 1 -- 172.21.15.80:0/1907709407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2bc0cf360 msgr2=0x7fb2bc0adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.808+0000 7fb2bb400700 1 --2- 172.21.15.80:0/1907709407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2bc0cf360 0x7fb2bc0adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.808+0000 7fb2bb400700 1 -- 172.21.15.80:0/1907709407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2bc0b9420 msgr2=0x7fb2bc154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.808+0000 7fb2bb400700 1 --2- 172.21.15.80:0/1907709407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2bc0b9420 0x7fb2bc154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.808+0000 7fb2bb400700 1 -- 172.21.15.80:0/1907709407 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a40094a0 con 0x7fb2bc0d3220 2024-05-10T04:22:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.808+0000 7fb2bb400700 1 --2- 172.21.15.80:0/1907709407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2bc0d3220 0x7fb2bc0ae470 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400c7a0 tx=0x7fb2b400cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.808+0000 7fb2b3400700 1 -- 172.21.15.80:0/1907709407 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4003e30 con 0x7fb2bc0d3220 2024-05-10T04:22:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.808+0000 7fb2b3400700 1 -- 172.21.15.80:0/1907709407 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b4005070 con 0x7fb2bc0d3220 2024-05-10T04:22:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.808+0000 7fb2bbe00700 1 -- 172.21.15.80:0/1907709407 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2bc0abcd0 con 0x7fb2bc0d3220 2024-05-10T04:22:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.809+0000 7fb2b3400700 1 -- 172.21.15.80:0/1907709407 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4005420 con 0x7fb2bc0d3220 2024-05-10T04:22:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.809+0000 7fb2bbe00700 1 -- 172.21.15.80:0/1907709407 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2bc0ad730 con 0x7fb2bc0d3220 2024-05-10T04:22:48.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.810+0000 7fb2bbe00700 1 -- 172.21.15.80:0/1907709407 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2bc074af0 con 0x7fb2bc0d3220 2024-05-10T04:22:48.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.811+0000 7fb2b3400700 1 -- 172.21.15.80:0/1907709407 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb2b4005580 con 0x7fb2bc0d3220 2024-05-10T04:22:48.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.811+0000 7fb2b3400700 1 --2- 172.21.15.80:0/1907709407 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb29806acc0 0x7fb29806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:48.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.812+0000 7fb2b3400700 1 -- 172.21.15.80:0/1907709407 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2b4088830 con 0x7fb2bc0d3220 2024-05-10T04:22:48.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.812+0000 7fb2baa00700 1 --2- 172.21.15.80:0/1907709407 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb29806acc0 0x7fb29806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:48.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.813+0000 7fb2baa00700 1 --2- 172.21.15.80:0/1907709407 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb29806acc0 0x7fb29806d1d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac000f60 tx=0x7fb2ac007f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:48.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:48.816+0000 7fb2b3400700 1 -- 172.21.15.80:0/1907709407 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb2b4053a80 con 0x7fb2bc0d3220 2024-05-10T04:22:49.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.017+0000 7fb2bbe00700 1 -- 172.21.15.80:0/1907709407 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2bc162aa0 con 0x7fb29806acc0 2024-05-10T04:22:49.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.025+0000 7fb2b3400700 1 -- 172.21.15.80:0/1907709407 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264535 (secure 0 0 0) 0x7fb2ac004b70 con 0x7fb29806acc0 2024-05-10T04:22:49.031 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:49.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.029+0000 7fb2bbe00700 1 -- 172.21.15.80:0/1907709407 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb29806acc0 msgr2=0x7fb29806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:49.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.029+0000 7fb2bbe00700 1 --2- 172.21.15.80:0/1907709407 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb29806acc0 0x7fb29806d1d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac000f60 tx=0x7fb2ac007f10 comp rx=0 tx=0).stop 2024-05-10T04:22:49.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.029+0000 7fb2bbe00700 1 -- 172.21.15.80:0/1907709407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2bc0d3220 msgr2=0x7fb2bc0ae470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:49.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.029+0000 7fb2bbe00700 1 --2- 172.21.15.80:0/1907709407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2bc0d3220 0x7fb2bc0ae470 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400c7a0 tx=0x7fb2b400cab0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.030+0000 7fb2bbe00700 1 -- 172.21.15.80:0/1907709407 shutdown_connections 2024-05-10T04:22:49.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.030+0000 7fb2bbe00700 1 --2- 172.21.15.80:0/1907709407 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb29806acc0 0x7fb29806d1d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.030+0000 7fb2bbe00700 1 --2- 172.21.15.80:0/1907709407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2bc0d3220 0x7fb2bc0ae470 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.030+0000 7fb2bbe00700 1 --2- 172.21.15.80:0/1907709407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2bc0b9420 0x7fb2bc154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.030+0000 7fb2bbe00700 1 --2- 172.21.15.80:0/1907709407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2bc0cf360 0x7fb2bc0adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.030+0000 7fb2bbe00700 1 -- 172.21.15.80:0/1907709407 >> 172.21.15.80:0/1907709407 conn(0x7fb2bc06c4e0 msgr2=0x7fb2bc161090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:49.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.030+0000 7fb2bbe00700 1 -- 172.21.15.80:0/1907709407 shutdown_connections 2024-05-10T04:22:49.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.030+0000 7fb2bbe00700 1 -- 172.21.15.80:0/1907709407 wait complete. 2024-05-10T04:22:49.035 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-10T04:22:49.059 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-10T04:22:48.737380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.243490"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.071084+0000","last_change":"2024-05-10T04:22:37.529212+0000","last_active":"2024-05-10T04:22:39.071084+0000","last_peered":"2024-05-10T04:22:39.071084+0000","last_clean":"2024-05-10T04:22:39.071084+0000","last_became_active":"2024-05-10T04:22:37.528975+0000","last_became_peered":"2024-05-10T04:22:37.528975+0000","last_unstale":"2024-05-10T04:22:39.071084+0000","last_undegraded":"2024-05-10T04:22:39.071084+0000","last_fullsized":"2024-05-10T04:22:39.071084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:43:31.418620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496348+0000","last_change":"2024-05-10T04:22:37.513971+0000","last_active":"2024-05-10T04:22:38.496348+0000","last_peered":"2024-05-10T04:22:38.496348+0000","last_clean":"2024-05-10T04:22:38.496348+0000","last_became_active":"2024-05-10T04:22:37.513528+0000","last_became_peered":"2024-05-10T04:22:37.513528+0000","last_unstale":"2024-05-10T04:22:38.496348+0000","last_undegraded":"2024-05-10T04:22:38.496348+0000","last_fullsized":"2024-05-10T04:22:38.496348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:27:09.485253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565409+0000","last_change":"2024-05-10T04:22:37.505391+0000","last_active":"2024-05-10T04:22:38.565409+0000","last_peered":"2024-05-10T04:22:38.565409+0000","last_clean":"2024-05-10T04:22:38.565409+0000","last_became_active":"2024-05-10T04:22:37.505063+0000","last_became_peered":"2024-05-10T04:22:37.505063+0000","last_unstale":"2024-05-10T04:22:38.565409+0000","last_undegraded":"2024-05-10T04:22:38.565409+0000","last_fullsized":"2024-05-10T04:22:38.565409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:27:50.672963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496838+0000","last_change":"2024-05-10T04:22:37.520462+0000","last_active":"2024-05-10T04:22:38.496838+0000","last_peered":"2024-05-10T04:22:38.496838+0000","last_clean":"2024-05-10T04:22:38.496838+0000","last_became_active":"2024-05-10T04:22:37.519497+0000","last_became_peered":"2024-05-10T04:22:37.519497+0000","last_unstale":"2024-05-10T04:22:38.496838+0000","last_undegraded":"2024-05-10T04:22:38.496838+0000","last_fullsized":"2024-05-10T04:22:38.496838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:21.117834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070309+0000","last_change":"2024-05-10T04:22:37.526517+0000","last_active":"2024-05-10T04:22:39.070309+0000","last_peered":"2024-05-10T04:22:39.070309+0000","last_clean":"2024-05-10T04:22:39.070309+0000","last_became_active":"2024-05-10T04:22:37.526181+0000","last_became_peered":"2024-05-10T04:22:37.526181+0000","last_unstale":"2024-05-10T04:22:39.070309+0000","last_undegraded":"2024-05-10T04:22:39.070309+0000","last_fullsized":"2024-05-10T04:22:39.070309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:21:00.214222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496509+0000","last_change":"2024-05-10T04:22:37.513739+0000","last_active":"2024-05-10T04:22:38.496509+0000","last_peered":"2024-05-10T04:22:38.496509+0000","last_clean":"2024-05-10T04:22:38.496509+0000","last_became_active":"2024-05-10T04:22:37.513348+0000","last_became_peered":"2024-05-10T04:22:37.513348+0000","last_unstale":"2024-05-10T04:22:38.496509+0000","last_undegraded":"2024-05-10T04:22:38.496509+0000","last_fullsized":"2024-05-10T04:22:38.496509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:50.806224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070073+0000","last_change":"2024-05-10T04:22:37.523784+0000","last_active":"2024-05-10T04:22:39.070073+0000","last_peered":"2024-05-10T04:22:39.070073+0000","last_clean":"2024-05-10T04:22:39.070073+0000","last_became_active":"2024-05-10T04:22:37.523472+0000","last_became_peered":"2024-05-10T04:22:37.523472+0000","last_unstale":"2024-05-10T04:22:39.070073+0000","last_undegraded":"2024-05-10T04:22:39.070073+0000","last_fullsized":"2024-05-10T04:22:39.070073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:19:35.892439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068081+0000","last_change":"2024-05-10T04:22:37.530486+0000","last_active":"2024-05-10T04:22:39.068081+0000","last_peered":"2024-05-10T04:22:39.068081+0000","last_clean":"2024-05-10T04:22:39.068081+0000","last_became_active":"2024-05-10T04:22:37.530129+0000","last_became_peered":"2024-05-10T04:22:37.530129+0000","last_unstale":"2024-05-10T04:22:39.068081+0000","last_undegraded":"2024-05-10T04:22:39.068081+0000","last_fullsized":"2024-05-10T04:22:39.068081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:21:00.214222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.071177+0000","last_change":"2024-05-10T04:22:37.528608+0000","last_active":"2024-05-10T04:22:39.071177+0000","last_peered":"2024-05-10T04:22:39.071177+0000","last_clean":"2024-05-10T04:22:39.071177+0000","last_became_active":"2024-05-10T04:22:37.528314+0000","last_became_peered":"2024-05-10T04:22:37.528314+0000","last_unstale":"2024-05-10T04:22:39.071177+0000","last_undegraded":"2024-05-10T04:22:39.071177+0000","last_fullsized":"2024-05-10T04:22:39.071177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:29:02.206457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069683+0000","last_change":"2024-05-10T04:22:37.516245+0000","last_active":"2024-05-10T04:22:39.069683+0000","last_peered":"2024-05-10T04:22:39.069683+0000","last_clean":"2024-05-10T04:22:39.069683+0000","last_became_active":"2024-05-10T04:22:37.515936+0000","last_became_peered":"2024-05-10T04:22:37.515936+0000","last_unstale":"2024-05-10T04:22:39.069683+0000","last_undegraded":"2024-05-10T04:22:39.069683+0000","last_fullsized":"2024-05-10T04:22:39.069683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:21.117834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.071024+0000","last_change":"2024-05-10T04:22:37.527304+0000","last_active":"2024-05-10T04:22:39.071024+0000","last_peered":"2024-05-10T04:22:39.071024+0000","last_clean":"2024-05-10T04:22:39.071024+0000","last_became_active":"2024-05-10T04:22:37.526971+0000","last_became_peered":"2024-05-10T04:22:37.526971+0000","last_unstale":"2024-05-10T04:22:39.071024+0000","last_undegraded":"2024-05-10T04:22:39.071024+0000","last_fullsized":"2024-05-10T04:22:39.071024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:50:46.925328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070689+0000","last_change":"2024-05-10T04:22:37.502589+0000","last_active":"2024-05-10T04:22:39.070689+0000","last_peered":"2024-05-10T04:22:39.070689+0000","last_clean":"2024-05-10T04:22:39.070689+0000","last_became_active":"2024-05-10T04:22:37.502178+0000","last_became_peered":"2024-05-10T04:22:37.502178+0000","last_unstale":"2024-05-10T04:22:39.070689+0000","last_undegraded":"2024-05-10T04:22:39.070689+0000","last_fullsized":"2024-05-10T04:22:39.070689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:36:22.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068213+0000","last_change":"2024-05-10T04:22:37.510847+0000","last_active":"2024-05-10T04:22:39.068213+0000","last_peered":"2024-05-10T04:22:39.068213+0000","last_clean":"2024-05-10T04:22:39.068213+0000","last_became_active":"2024-05-10T04:22:37.510633+0000","last_became_peered":"2024-05-10T04:22:37.510633+0000","last_unstale":"2024-05-10T04:22:39.068213+0000","last_undegraded":"2024-05-10T04:22:39.068213+0000","last_fullsized":"2024-05-10T04:22:39.068213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:58.202277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565340+0000","last_change":"2024-05-10T04:22:37.510710+0000","last_active":"2024-05-10T04:22:38.565340+0000","last_peered":"2024-05-10T04:22:38.565340+0000","last_clean":"2024-05-10T04:22:38.565340+0000","last_became_active":"2024-05-10T04:22:37.509156+0000","last_became_peered":"2024-05-10T04:22:37.509156+0000","last_unstale":"2024-05-10T04:22:38.565340+0000","last_undegraded":"2024-05-10T04:22:38.565340+0000","last_fullsized":"2024-05-10T04:22:38.565340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:51:34.367433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.495937+0000","last_change":"2024-05-10T04:22:37.510383+0000","last_active":"2024-05-10T04:22:38.495937+0000","last_peered":"2024-05-10T04:22:38.495937+0000","last_clean":"2024-05-10T04:22:38.495937+0000","last_became_active":"2024-05-10T04:22:37.507435+0000","last_became_peered":"2024-05-10T04:22:37.507435+0000","last_unstale":"2024-05-10T04:22:38.495937+0000","last_undegraded":"2024-05-10T04:22:38.495937+0000","last_fullsized":"2024-05-10T04:22:38.495937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:32:34.172364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496433+0000","last_change":"2024-05-10T04:22:37.513653+0000","last_active":"2024-05-10T04:22:38.496433+0000","last_peered":"2024-05-10T04:22:38.496433+0000","last_clean":"2024-05-10T04:22:38.496433+0000","last_became_active":"2024-05-10T04:22:37.513360+0000","last_became_peered":"2024-05-10T04:22:37.513360+0000","last_unstale":"2024-05-10T04:22:38.496433+0000","last_undegraded":"2024-05-10T04:22:38.496433+0000","last_fullsized":"2024-05-10T04:22:38.496433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:32:34.172364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497048+0000","last_change":"2024-05-10T04:22:37.512778+0000","last_active":"2024-05-10T04:22:38.497048+0000","last_peered":"2024-05-10T04:22:38.497048+0000","last_clean":"2024-05-10T04:22:38.497048+0000","last_became_active":"2024-05-10T04:22:37.512065+0000","last_became_peered":"2024-05-10T04:22:37.512065+0000","last_unstale":"2024-05-10T04:22:38.497048+0000","last_undegraded":"2024-05-10T04:22:38.497048+0000","last_fullsized":"2024-05-10T04:22:38.497048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:02:11.073471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497418+0000","last_change":"2024-05-10T04:22:37.512740+0000","last_active":"2024-05-10T04:22:38.497418+0000","last_peered":"2024-05-10T04:22:38.497418+0000","last_clean":"2024-05-10T04:22:38.497418+0000","last_became_active":"2024-05-10T04:22:37.511158+0000","last_became_peered":"2024-05-10T04:22:37.511158+0000","last_unstale":"2024-05-10T04:22:38.497418+0000","last_undegraded":"2024-05-10T04:22:38.497418+0000","last_fullsized":"2024-05-10T04:22:38.497418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:03.281665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070431+0000","last_change":"2024-05-10T04:22:37.527306+0000","last_active":"2024-05-10T04:22:39.070431+0000","last_peered":"2024-05-10T04:22:39.070431+0000","last_clean":"2024-05-10T04:22:39.070431+0000","last_became_active":"2024-05-10T04:22:37.527036+0000","last_became_peered":"2024-05-10T04:22:37.527036+0000","last_unstale":"2024-05-10T04:22:39.070431+0000","last_undegraded":"2024-05-10T04:22:39.070431+0000","last_fullsized":"2024-05-10T04:22:39.070431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:28.560590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565568+0000","last_change":"2024-05-10T04:22:36.932349+0000","last_active":"2024-05-10T04:22:38.565568+0000","last_peered":"2024-05-10T04:22:38.565568+0000","last_clean":"2024-05-10T04:22:38.565568+0000","last_became_active":"2024-05-10T04:22:36.931526+0000","last_became_peered":"2024-05-10T04:22:36.931526+0000","last_unstale":"2024-05-10T04:22:38.565568+0000","last_undegraded":"2024-05-10T04:22:38.565568+0000","last_fullsized":"2024-05-10T04:22:38.565568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:57:15.621386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068537+0000","last_change":"2024-05-10T04:22:37.511862+0000","last_active":"2024-05-10T04:22:39.068537+0000","last_peered":"2024-05-10T04:22:39.068537+0000","last_clean":"2024-05-10T04:22:39.068537+0000","last_became_active":"2024-05-10T04:22:37.511535+0000","last_became_peered":"2024-05-10T04:22:37.511535+0000","last_unstale":"2024-05-10T04:22:39.068537+0000","last_undegraded":"2024-05-10T04:22:39.068537+0000","last_fullsized":"2024-05-10T04:22:39.068537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:27:09.485253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068563+0000","last_change":"2024-05-10T04:22:36.930693+0000","last_active":"2024-05-10T04:22:39.068563+0000","last_peered":"2024-05-10T04:22:39.068563+0000","last_clean":"2024-05-10T04:22:39.068563+0000","last_became_active":"2024-05-10T04:22:36.929916+0000","last_became_peered":"2024-05-10T04:22:36.929916+0000","last_unstale":"2024-05-10T04:22:39.068563+0000","last_undegraded":"2024-05-10T04:22:39.068563+0000","last_fullsized":"2024-05-10T04:22:39.068563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:13:55.237529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565543+0000","last_change":"2024-05-10T04:22:37.526069+0000","last_active":"2024-05-10T04:22:38.565543+0000","last_peered":"2024-05-10T04:22:38.565543+0000","last_clean":"2024-05-10T04:22:38.565543+0000","last_became_active":"2024-05-10T04:22:37.525791+0000","last_became_peered":"2024-05-10T04:22:37.525791+0000","last_unstale":"2024-05-10T04:22:38.565543+0000","last_undegraded":"2024-05-10T04:22:38.565543+0000","last_fullsized":"2024-05-10T04:22:38.565543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:14.343190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070684+0000","last_change":"2024-05-10T04:22:36.939770+0000","last_active":"2024-05-10T04:22:39.070684+0000","last_peered":"2024-05-10T04:22:39.070684+0000","last_clean":"2024-05-10T04:22:39.070684+0000","last_became_active":"2024-05-10T04:22:36.939301+0000","last_became_peered":"2024-05-10T04:22:36.939301+0000","last_unstale":"2024-05-10T04:22:39.070684+0000","last_undegraded":"2024-05-10T04:22:39.070684+0000","last_fullsized":"2024-05-10T04:22:39.070684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:27:49.663346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496562+0000","last_change":"2024-05-10T04:22:37.507133+0000","last_active":"2024-05-10T04:22:38.496562+0000","last_peered":"2024-05-10T04:22:38.496562+0000","last_clean":"2024-05-10T04:22:38.496562+0000","last_became_active":"2024-05-10T04:22:37.506811+0000","last_became_peered":"2024-05-10T04:22:37.506811+0000","last_unstale":"2024-05-10T04:22:38.496562+0000","last_undegraded":"2024-05-10T04:22:38.496562+0000","last_fullsized":"2024-05-10T04:22:38.496562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:28.560590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070333+0000","last_change":"2024-05-10T04:22:36.937289+0000","last_active":"2024-05-10T04:22:39.070333+0000","last_peered":"2024-05-10T04:22:39.070333+0000","last_clean":"2024-05-10T04:22:39.070333+0000","last_became_active":"2024-05-10T04:22:36.936972+0000","last_became_peered":"2024-05-10T04:22:36.936972+0000","last_unstale":"2024-05-10T04:22:39.070333+0000","last_undegraded":"2024-05-10T04:22:39.070333+0000","last_fullsized":"2024-05-10T04:22:39.070333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:06.712574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496845+0000","last_change":"2024-05-10T04:22:37.509008+0000","last_active":"2024-05-10T04:22:38.496845+0000","last_peered":"2024-05-10T04:22:38.496845+0000","last_clean":"2024-05-10T04:22:38.496845+0000","last_became_active":"2024-05-10T04:22:37.508188+0000","last_became_peered":"2024-05-10T04:22:37.508188+0000","last_unstale":"2024-05-10T04:22:38.496845+0000","last_undegraded":"2024-05-10T04:22:38.496845+0000","last_fullsized":"2024-05-10T04:22:38.496845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:58.202277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068360+0000","last_change":"2024-05-10T04:22:36.931519+0000","last_active":"2024-05-10T04:22:39.068360+0000","last_peered":"2024-05-10T04:22:39.068360+0000","last_clean":"2024-05-10T04:22:39.068360+0000","last_became_active":"2024-05-10T04:22:36.930555+0000","last_became_peered":"2024-05-10T04:22:36.930555+0000","last_unstale":"2024-05-10T04:22:39.068360+0000","last_undegraded":"2024-05-10T04:22:39.068360+0000","last_fullsized":"2024-05-10T04:22:39.068360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:00.426110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069534+0000","last_change":"2024-05-10T04:22:37.510204+0000","last_active":"2024-05-10T04:22:39.069534+0000","last_peered":"2024-05-10T04:22:39.069534+0000","last_clean":"2024-05-10T04:22:39.069534+0000","last_became_active":"2024-05-10T04:22:37.509393+0000","last_became_peered":"2024-05-10T04:22:37.509393+0000","last_unstale":"2024-05-10T04:22:39.069534+0000","last_undegraded":"2024-05-10T04:22:39.069534+0000","last_fullsized":"2024-05-10T04:22:39.069534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:03.281665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069401+0000","last_change":"2024-05-10T04:22:36.939267+0000","last_active":"2024-05-10T04:22:39.069401+0000","last_peered":"2024-05-10T04:22:39.069401+0000","last_clean":"2024-05-10T04:22:39.069401+0000","last_became_active":"2024-05-10T04:22:36.938965+0000","last_became_peered":"2024-05-10T04:22:36.938965+0000","last_unstale":"2024-05-10T04:22:39.069401+0000","last_undegraded":"2024-05-10T04:22:39.069401+0000","last_fullsized":"2024-05-10T04:22:39.069401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:34:08.587305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565609+0000","last_change":"2024-05-10T04:22:37.506554+0000","last_active":"2024-05-10T04:22:38.565609+0000","last_peered":"2024-05-10T04:22:38.565609+0000","last_clean":"2024-05-10T04:22:38.565609+0000","last_became_active":"2024-05-10T04:22:37.506176+0000","last_became_peered":"2024-05-10T04:22:37.506176+0000","last_unstale":"2024-05-10T04:22:38.565609+0000","last_undegraded":"2024-05-10T04:22:38.565609+0000","last_fullsized":"2024-05-10T04:22:38.565609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:21.117834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068191+0000","last_change":"2024-05-10T04:22:36.925541+0000","last_active":"2024-05-10T04:22:39.068191+0000","last_peered":"2024-05-10T04:22:39.068191+0000","last_clean":"2024-05-10T04:22:39.068191+0000","last_became_active":"2024-05-10T04:22:36.925205+0000","last_became_peered":"2024-05-10T04:22:36.925205+0000","last_unstale":"2024-05-10T04:22:39.068191+0000","last_undegraded":"2024-05-10T04:22:39.068191+0000","last_fullsized":"2024-05-10T04:22:39.068191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:20.974889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068123+0000","last_change":"2024-05-10T04:22:37.510685+0000","last_active":"2024-05-10T04:22:39.068123+0000","last_peered":"2024-05-10T04:22:39.068123+0000","last_clean":"2024-05-10T04:22:39.068123+0000","last_became_active":"2024-05-10T04:22:37.510373+0000","last_became_peered":"2024-05-10T04:22:37.510373+0000","last_unstale":"2024-05-10T04:22:39.068123+0000","last_undegraded":"2024-05-10T04:22:39.068123+0000","last_fullsized":"2024-05-10T04:22:39.068123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:44.231090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496383+0000","last_change":"2024-05-10T04:22:36.928180+0000","last_active":"2024-05-10T04:22:38.496383+0000","last_peered":"2024-05-10T04:22:38.496383+0000","last_clean":"2024-05-10T04:22:38.496383+0000","last_became_active":"2024-05-10T04:22:36.927821+0000","last_became_peered":"2024-05-10T04:22:36.927821+0000","last_unstale":"2024-05-10T04:22:38.496383+0000","last_undegraded":"2024-05-10T04:22:38.496383+0000","last_fullsized":"2024-05-10T04:22:38.496383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:45:19.397807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496112+0000","last_change":"2024-05-10T04:22:37.516811+0000","last_active":"2024-05-10T04:22:38.496112+0000","last_peered":"2024-05-10T04:22:38.496112+0000","last_clean":"2024-05-10T04:22:38.496112+0000","last_became_active":"2024-05-10T04:22:37.511489+0000","last_became_peered":"2024-05-10T04:22:37.511489+0000","last_unstale":"2024-05-10T04:22:38.496112+0000","last_undegraded":"2024-05-10T04:22:38.496112+0000","last_fullsized":"2024-05-10T04:22:38.496112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:44.231090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069855+0000","last_change":"2024-05-10T04:22:36.931435+0000","last_active":"2024-05-10T04:22:39.069855+0000","last_peered":"2024-05-10T04:22:39.069855+0000","last_clean":"2024-05-10T04:22:39.069855+0000","last_became_active":"2024-05-10T04:22:36.930942+0000","last_became_peered":"2024-05-10T04:22:36.930942+0000","last_unstale":"2024-05-10T04:22:39.069855+0000","last_undegraded":"2024-05-10T04:22:39.069855+0000","last_fullsized":"2024-05-10T04:22:39.069855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:45:19.397807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496995+0000","last_change":"2024-05-10T04:22:37.512758+0000","last_active":"2024-05-10T04:22:38.496995+0000","last_peered":"2024-05-10T04:22:38.496995+0000","last_clean":"2024-05-10T04:22:38.496995+0000","last_became_active":"2024-05-10T04:22:37.512328+0000","last_became_peered":"2024-05-10T04:22:37.512328+0000","last_unstale":"2024-05-10T04:22:38.496995+0000","last_undegraded":"2024-05-10T04:22:38.496995+0000","last_fullsized":"2024-05-10T04:22:38.496995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:23:17.836129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496870+0000","last_change":"2024-05-10T04:22:36.930650+0000","last_active":"2024-05-10T04:22:38.496870+0000","last_peered":"2024-05-10T04:22:38.496870+0000","last_clean":"2024-05-10T04:22:38.496870+0000","last_became_active":"2024-05-10T04:22:36.929660+0000","last_became_peered":"2024-05-10T04:22:36.929660+0000","last_unstale":"2024-05-10T04:22:38.496870+0000","last_undegraded":"2024-05-10T04:22:38.496870+0000","last_fullsized":"2024-05-10T04:22:38.496870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:49:54.352088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565607+0000","last_change":"2024-05-10T04:22:37.516984+0000","last_active":"2024-05-10T04:22:38.565607+0000","last_peered":"2024-05-10T04:22:38.565607+0000","last_clean":"2024-05-10T04:22:38.565607+0000","last_became_active":"2024-05-10T04:22:37.516708+0000","last_became_peered":"2024-05-10T04:22:37.516708+0000","last_unstale":"2024-05-10T04:22:38.565607+0000","last_undegraded":"2024-05-10T04:22:38.565607+0000","last_fullsized":"2024-05-10T04:22:38.565607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:50:46.925328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496445+0000","last_change":"2024-05-10T04:22:36.933595+0000","last_active":"2024-05-10T04:22:38.496445+0000","last_peered":"2024-05-10T04:22:38.496445+0000","last_clean":"2024-05-10T04:22:38.496445+0000","last_became_active":"2024-05-10T04:22:36.933244+0000","last_became_peered":"2024-05-10T04:22:36.933244+0000","last_unstale":"2024-05-10T04:22:38.496445+0000","last_undegraded":"2024-05-10T04:22:38.496445+0000","last_fullsized":"2024-05-10T04:22:38.496445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:34:08.587305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070569+0000","last_change":"2024-05-10T04:22:37.521115+0000","last_active":"2024-05-10T04:22:39.070569+0000","last_peered":"2024-05-10T04:22:39.070569+0000","last_clean":"2024-05-10T04:22:39.070569+0000","last_became_active":"2024-05-10T04:22:37.520685+0000","last_became_peered":"2024-05-10T04:22:37.520685+0000","last_unstale":"2024-05-10T04:22:39.070569+0000","last_undegraded":"2024-05-10T04:22:39.070569+0000","last_fullsized":"2024-05-10T04:22:39.070569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:58:32.047404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069983+0000","last_change":"2024-05-10T04:22:36.934708+0000","last_active":"2024-05-10T04:22:39.069983+0000","last_peered":"2024-05-10T04:22:39.069983+0000","last_clean":"2024-05-10T04:22:39.069983+0000","last_became_active":"2024-05-10T04:22:36.934415+0000","last_became_peered":"2024-05-10T04:22:36.934415+0000","last_unstale":"2024-05-10T04:22:39.069983+0000","last_undegraded":"2024-05-10T04:22:39.069983+0000","last_fullsized":"2024-05-10T04:22:39.069983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:49:54.352088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070498+0000","last_change":"2024-05-10T04:22:37.526943+0000","last_active":"2024-05-10T04:22:39.070498+0000","last_peered":"2024-05-10T04:22:39.070498+0000","last_clean":"2024-05-10T04:22:39.070498+0000","last_became_active":"2024-05-10T04:22:37.524757+0000","last_became_peered":"2024-05-10T04:22:37.524757+0000","last_unstale":"2024-05-10T04:22:39.070498+0000","last_undegraded":"2024-05-10T04:22:39.070498+0000","last_fullsized":"2024-05-10T04:22:39.070498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:23:17.836129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565473+0000","last_change":"2024-05-10T04:22:36.938772+0000","last_active":"2024-05-10T04:22:38.565473+0000","last_peered":"2024-05-10T04:22:38.565473+0000","last_clean":"2024-05-10T04:22:38.565473+0000","last_became_active":"2024-05-10T04:22:36.938463+0000","last_became_peered":"2024-05-10T04:22:36.938463+0000","last_unstale":"2024-05-10T04:22:38.565473+0000","last_undegraded":"2024-05-10T04:22:38.565473+0000","last_fullsized":"2024-05-10T04:22:38.565473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:00.426110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565316+0000","last_change":"2024-05-10T04:22:37.516169+0000","last_active":"2024-05-10T04:22:38.565316+0000","last_peered":"2024-05-10T04:22:38.565316+0000","last_clean":"2024-05-10T04:22:38.565316+0000","last_became_active":"2024-05-10T04:22:37.515199+0000","last_became_peered":"2024-05-10T04:22:37.515199+0000","last_unstale":"2024-05-10T04:22:38.565316+0000","last_undegraded":"2024-05-10T04:22:38.565316+0000","last_fullsized":"2024-05-10T04:22:38.565316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:44.231090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497050+0000","last_change":"2024-05-10T04:22:36.927348+0000","last_active":"2024-05-10T04:22:38.497050+0000","last_peered":"2024-05-10T04:22:38.497050+0000","last_clean":"2024-05-10T04:22:38.497050+0000","last_became_active":"2024-05-10T04:22:36.927029+0000","last_became_peered":"2024-05-10T04:22:36.927029+0000","last_unstale":"2024-05-10T04:22:38.497050+0000","last_undegraded":"2024-05-10T04:22:38.497050+0000","last_fullsized":"2024-05-10T04:22:38.497050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:55.721524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070438+0000","last_change":"2024-05-10T04:22:37.519929+0000","last_active":"2024-05-10T04:22:39.070438+0000","last_peered":"2024-05-10T04:22:39.070438+0000","last_clean":"2024-05-10T04:22:39.070438+0000","last_became_active":"2024-05-10T04:22:37.518788+0000","last_became_peered":"2024-05-10T04:22:37.518788+0000","last_unstale":"2024-05-10T04:22:39.070438+0000","last_undegraded":"2024-05-10T04:22:39.070438+0000","last_fullsized":"2024-05-10T04:22:39.070438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:02:11.073471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069352+0000","last_change":"2024-05-10T04:22:36.937577+0000","last_active":"2024-05-10T04:22:39.069352+0000","last_peered":"2024-05-10T04:22:39.069352+0000","last_clean":"2024-05-10T04:22:39.069352+0000","last_became_active":"2024-05-10T04:22:36.937300+0000","last_became_peered":"2024-05-10T04:22:36.937300+0000","last_unstale":"2024-05-10T04:22:39.069352+0000","last_undegraded":"2024-05-10T04:22:39.069352+0000","last_fullsized":"2024-05-10T04:22:39.069352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:20.974889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069757+0000","last_change":"2024-05-10T04:22:37.507070+0000","last_active":"2024-05-10T04:22:39.069757+0000","last_peered":"2024-05-10T04:22:39.069757+0000","last_clean":"2024-05-10T04:22:39.069757+0000","last_became_active":"2024-05-10T04:22:37.506325+0000","last_became_peered":"2024-05-10T04:22:37.506325+0000","last_unstale":"2024-05-10T04:22:39.069757+0000","last_undegraded":"2024-05-10T04:22:39.069757+0000","last_fullsized":"2024-05-10T04:22:39.069757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:14.343190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497219+0000","last_change":"2024-05-10T04:22:36.924331+0000","last_active":"2024-05-10T04:22:38.497219+0000","last_peered":"2024-05-10T04:22:38.497219+0000","last_clean":"2024-05-10T04:22:38.497219+0000","last_became_active":"2024-05-10T04:22:36.923979+0000","last_became_peered":"2024-05-10T04:22:36.923979+0000","last_unstale":"2024-05-10T04:22:38.497219+0000","last_undegraded":"2024-05-10T04:22:38.497219+0000","last_fullsized":"2024-05-10T04:22:38.497219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:13:55.237529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070337+0000","last_change":"2024-05-10T04:22:37.518033+0000","last_active":"2024-05-10T04:22:39.070337+0000","last_peered":"2024-05-10T04:22:39.070337+0000","last_clean":"2024-05-10T04:22:39.070337+0000","last_became_active":"2024-05-10T04:22:37.517618+0000","last_became_peered":"2024-05-10T04:22:37.517618+0000","last_unstale":"2024-05-10T04:22:39.070337+0000","last_undegraded":"2024-05-10T04:22:39.070337+0000","last_fullsized":"2024-05-10T04:22:39.070337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:04:22.431028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070758+0000","last_change":"2024-05-10T04:22:36.927567+0000","last_active":"2024-05-10T04:22:39.070758+0000","last_peered":"2024-05-10T04:22:39.070758+0000","last_clean":"2024-05-10T04:22:39.070758+0000","last_became_active":"2024-05-10T04:22:36.927215+0000","last_became_peered":"2024-05-10T04:22:36.927215+0000","last_unstale":"2024-05-10T04:22:39.070758+0000","last_undegraded":"2024-05-10T04:22:39.070758+0000","last_fullsized":"2024-05-10T04:22:39.070758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:00.426110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070495+0000","last_change":"2024-05-10T04:22:37.525145+0000","last_active":"2024-05-10T04:22:39.070495+0000","last_peered":"2024-05-10T04:22:39.070495+0000","last_clean":"2024-05-10T04:22:39.070495+0000","last_became_active":"2024-05-10T04:22:37.524777+0000","last_became_peered":"2024-05-10T04:22:37.524777+0000","last_unstale":"2024-05-10T04:22:39.070495+0000","last_undegraded":"2024-05-10T04:22:39.070495+0000","last_fullsized":"2024-05-10T04:22:39.070495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:42.373586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496253+0000","last_change":"2024-05-10T04:22:36.928079+0000","last_active":"2024-05-10T04:22:38.496253+0000","last_peered":"2024-05-10T04:22:38.496253+0000","last_clean":"2024-05-10T04:22:38.496253+0000","last_became_active":"2024-05-10T04:22:36.927807+0000","last_became_peered":"2024-05-10T04:22:36.927807+0000","last_unstale":"2024-05-10T04:22:38.496253+0000","last_undegraded":"2024-05-10T04:22:38.496253+0000","last_fullsized":"2024-05-10T04:22:38.496253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:49:54.352088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496907+0000","last_change":"2024-05-10T04:22:37.523430+0000","last_active":"2024-05-10T04:22:38.496907+0000","last_peered":"2024-05-10T04:22:38.496907+0000","last_clean":"2024-05-10T04:22:38.496907+0000","last_became_active":"2024-05-10T04:22:37.523130+0000","last_became_peered":"2024-05-10T04:22:37.523130+0000","last_unstale":"2024-05-10T04:22:38.496907+0000","last_undegraded":"2024-05-10T04:22:38.496907+0000","last_fullsized":"2024-05-10T04:22:38.496907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:04:22.431028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496929+0000","last_change":"2024-05-10T04:22:36.928078+0000","last_active":"2024-05-10T04:22:38.496929+0000","last_peered":"2024-05-10T04:22:38.496929+0000","last_clean":"2024-05-10T04:22:38.496929+0000","last_became_active":"2024-05-10T04:22:36.927734+0000","last_became_peered":"2024-05-10T04:22:36.927734+0000","last_unstale":"2024-05-10T04:22:38.496929+0000","last_undegraded":"2024-05-10T04:22:38.496929+0000","last_fullsized":"2024-05-10T04:22:38.496929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:20.974889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069661+0000","last_change":"2024-05-10T04:22:37.509565+0000","last_active":"2024-05-10T04:22:39.069661+0000","last_peered":"2024-05-10T04:22:39.069661+0000","last_clean":"2024-05-10T04:22:39.069661+0000","last_became_active":"2024-05-10T04:22:37.508788+0000","last_became_peered":"2024-05-10T04:22:37.508788+0000","last_unstale":"2024-05-10T04:22:39.069661+0000","last_undegraded":"2024-05-10T04:22:39.069661+0000","last_fullsized":"2024-05-10T04:22:39.069661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:43.080008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.495916+0000","last_change":"2024-05-10T04:22:37.513544+0000","last_active":"2024-05-10T04:22:38.495916+0000","last_peered":"2024-05-10T04:22:38.495916+0000","last_clean":"2024-05-10T04:22:38.495916+0000","last_became_active":"2024-05-10T04:22:37.513229+0000","last_became_peered":"2024-05-10T04:22:37.513229+0000","last_unstale":"2024-05-10T04:22:38.495916+0000","last_undegraded":"2024-05-10T04:22:38.495916+0000","last_fullsized":"2024-05-10T04:22:38.495916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:21.117834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497135+0000","last_change":"2024-05-10T04:22:36.916069+0000","last_active":"2024-05-10T04:22:38.497135+0000","last_peered":"2024-05-10T04:22:38.497135+0000","last_clean":"2024-05-10T04:22:38.497135+0000","last_became_active":"2024-05-10T04:22:36.915725+0000","last_became_peered":"2024-05-10T04:22:36.915725+0000","last_unstale":"2024-05-10T04:22:38.497135+0000","last_undegraded":"2024-05-10T04:22:38.497135+0000","last_fullsized":"2024-05-10T04:22:38.497135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:20.974889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068254+0000","last_change":"2024-05-10T04:22:37.525366+0000","last_active":"2024-05-10T04:22:39.068254+0000","last_peered":"2024-05-10T04:22:39.068254+0000","last_clean":"2024-05-10T04:22:39.068254+0000","last_became_active":"2024-05-10T04:22:37.525122+0000","last_became_peered":"2024-05-10T04:22:37.525122+0000","last_unstale":"2024-05-10T04:22:39.068254+0000","last_undegraded":"2024-05-10T04:22:39.068254+0000","last_fullsized":"2024-05-10T04:22:39.068254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:04:22.431028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496402+0000","last_change":"2024-05-10T04:22:36.926870+0000","last_active":"2024-05-10T04:22:38.496402+0000","last_peered":"2024-05-10T04:22:38.496402+0000","last_clean":"2024-05-10T04:22:38.496402+0000","last_became_active":"2024-05-10T04:22:36.926076+0000","last_became_peered":"2024-05-10T04:22:36.926076+0000","last_unstale":"2024-05-10T04:22:38.496402+0000","last_undegraded":"2024-05-10T04:22:38.496402+0000","last_fullsized":"2024-05-10T04:22:38.496402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:34:08.587305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-10T04:22:37.508301+0000","last_change":"2024-05-10T04:22:27.829537+0000","last_active":"2024-05-10T04:22:37.508301+0000","last_peered":"2024-05-10T04:22:37.508301+0000","last_clean":"2024-05-10T04:22:37.508301+0000","last_became_active":"2024-05-10T04:22:27.828179+0000","last_became_peered":"2024-05-10T04:22:27.828179+0000","last_unstale":"2024-05-10T04:22:37.508301+0000","last_undegraded":"2024-05-10T04:22:37.508301+0000","last_fullsized":"2024-05-10T04:22:37.508301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_clean_scrub_stamp":"2024-05-10T04:22:26.813824+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:23.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565196+0000","last_change":"2024-05-10T04:22:37.505786+0000","last_active":"2024-05-10T04:22:38.565196+0000","last_peered":"2024-05-10T04:22:38.565196+0000","last_clean":"2024-05-10T04:22:38.565196+0000","last_became_active":"2024-05-10T04:22:37.505505+0000","last_became_peered":"2024-05-10T04:22:37.505505+0000","last_unstale":"2024-05-10T04:22:38.565196+0000","last_undegraded":"2024-05-10T04:22:38.565196+0000","last_fullsized":"2024-05-10T04:22:38.565196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:58.202277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069932+0000","last_change":"2024-05-10T04:22:36.936346+0000","last_active":"2024-05-10T04:22:39.069932+0000","last_peered":"2024-05-10T04:22:39.069932+0000","last_clean":"2024-05-10T04:22:39.069932+0000","last_became_active":"2024-05-10T04:22:36.935973+0000","last_became_peered":"2024-05-10T04:22:36.935973+0000","last_unstale":"2024-05-10T04:22:39.069932+0000","last_undegraded":"2024-05-10T04:22:39.069932+0000","last_fullsized":"2024-05-10T04:22:39.069932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:02.272048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070608+0000","last_change":"2024-05-10T04:22:36.936645+0000","last_active":"2024-05-10T04:22:39.070608+0000","last_peered":"2024-05-10T04:22:39.070608+0000","last_clean":"2024-05-10T04:22:39.070608+0000","last_became_active":"2024-05-10T04:22:36.936136+0000","last_became_peered":"2024-05-10T04:22:36.936136+0000","last_unstale":"2024-05-10T04:22:39.070608+0000","last_undegraded":"2024-05-10T04:22:39.070608+0000","last_fullsized":"2024-05-10T04:22:39.070608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:36:21.914720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496170+0000","last_change":"2024-05-10T04:22:37.507676+0000","last_active":"2024-05-10T04:22:38.496170+0000","last_peered":"2024-05-10T04:22:38.496170+0000","last_clean":"2024-05-10T04:22:38.496170+0000","last_became_active":"2024-05-10T04:22:37.506346+0000","last_became_peered":"2024-05-10T04:22:37.506346+0000","last_unstale":"2024-05-10T04:22:38.496170+0000","last_undegraded":"2024-05-10T04:22:38.496170+0000","last_fullsized":"2024-05-10T04:22:38.496170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:50:46.925328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:40.809496+0000","last_change":"2024-05-10T04:22:36.929577+0000","last_active":"2024-05-10T04:22:40.809496+0000","last_peered":"2024-05-10T04:22:40.809496+0000","last_clean":"2024-05-10T04:22:40.809496+0000","last_became_active":"2024-05-10T04:22:36.929233+0000","last_became_peered":"2024-05-10T04:22:36.929233+0000","last_unstale":"2024-05-10T04:22:40.809496+0000","last_undegraded":"2024-05-10T04:22:40.809496+0000","last_fullsized":"2024-05-10T04:22:40.809496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:02.272048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068722+0000","last_change":"2024-05-10T04:22:37.519249+0000","last_active":"2024-05-10T04:22:39.068722+0000","last_peered":"2024-05-10T04:22:39.068722+0000","last_clean":"2024-05-10T04:22:39.068722+0000","last_became_active":"2024-05-10T04:22:37.516952+0000","last_became_peered":"2024-05-10T04:22:37.516952+0000","last_unstale":"2024-05-10T04:22:39.068722+0000","last_undegraded":"2024-05-10T04:22:39.068722+0000","last_fullsized":"2024-05-10T04:22:39.068722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:21.117834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069775+0000","last_change":"2024-05-10T04:22:36.931235+0000","last_active":"2024-05-10T04:22:39.069775+0000","last_peered":"2024-05-10T04:22:39.069775+0000","last_clean":"2024-05-10T04:22:39.069775+0000","last_became_active":"2024-05-10T04:22:36.930721+0000","last_became_peered":"2024-05-10T04:22:36.930721+0000","last_unstale":"2024-05-10T04:22:39.069775+0000","last_undegraded":"2024-05-10T04:22:39.069775+0000","last_fullsized":"2024-05-10T04:22:39.069775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:55.721524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565564+0000","last_change":"2024-05-10T04:22:37.508611+0000","last_active":"2024-05-10T04:22:38.565564+0000","last_peered":"2024-05-10T04:22:38.565564+0000","last_clean":"2024-05-10T04:22:38.565564+0000","last_became_active":"2024-05-10T04:22:37.508350+0000","last_became_peered":"2024-05-10T04:22:37.508350+0000","last_unstale":"2024-05-10T04:22:38.565564+0000","last_undegraded":"2024-05-10T04:22:38.565564+0000","last_fullsized":"2024-05-10T04:22:38.565564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:05:50.563476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069633+0000","last_change":"2024-05-10T04:22:36.936567+0000","last_active":"2024-05-10T04:22:39.069633+0000","last_peered":"2024-05-10T04:22:39.069633+0000","last_clean":"2024-05-10T04:22:39.069633+0000","last_became_active":"2024-05-10T04:22:36.936129+0000","last_became_peered":"2024-05-10T04:22:36.936129+0000","last_unstale":"2024-05-10T04:22:39.069633+0000","last_undegraded":"2024-05-10T04:22:39.069633+0000","last_fullsized":"2024-05-10T04:22:39.069633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:58:31.037787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070074+0000","last_change":"2024-05-10T04:22:37.501502+0000","last_active":"2024-05-10T04:22:39.070074+0000","last_peered":"2024-05-10T04:22:39.070074+0000","last_clean":"2024-05-10T04:22:39.070074+0000","last_became_active":"2024-05-10T04:22:37.499775+0000","last_became_peered":"2024-05-10T04:22:37.499775+0000","last_unstale":"2024-05-10T04:22:39.070074+0000","last_undegraded":"2024-05-10T04:22:39.070074+0000","last_fullsized":"2024-05-10T04:22:39.070074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:49:55.361705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.495945+0000","last_change":"2024-05-10T04:22:36.932162+0000","last_active":"2024-05-10T04:22:38.495945+0000","last_peered":"2024-05-10T04:22:38.495945+0000","last_clean":"2024-05-10T04:22:38.495945+0000","last_became_active":"2024-05-10T04:22:36.931860+0000","last_became_peered":"2024-05-10T04:22:36.931860+0000","last_unstale":"2024-05-10T04:22:38.495945+0000","last_undegraded":"2024-05-10T04:22:38.495945+0000","last_fullsized":"2024-05-10T04:22:38.495945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:58:31.037787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068207+0000","last_change":"2024-05-10T04:22:37.509114+0000","last_active":"2024-05-10T04:22:39.068207+0000","last_peered":"2024-05-10T04:22:39.068207+0000","last_clean":"2024-05-10T04:22:39.068207+0000","last_became_active":"2024-05-10T04:22:37.508839+0000","last_became_peered":"2024-05-10T04:22:37.508839+0000","last_unstale":"2024-05-10T04:22:39.068207+0000","last_undegraded":"2024-05-10T04:22:39.068207+0000","last_fullsized":"2024-05-10T04:22:39.068207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:05:50.563476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496138+0000","last_change":"2024-05-10T04:22:36.928410+0000","last_active":"2024-05-10T04:22:38.496138+0000","last_peered":"2024-05-10T04:22:38.496138+0000","last_clean":"2024-05-10T04:22:38.496138+0000","last_became_active":"2024-05-10T04:22:36.927343+0000","last_became_peered":"2024-05-10T04:22:36.927343+0000","last_unstale":"2024-05-10T04:22:38.496138+0000","last_undegraded":"2024-05-10T04:22:38.496138+0000","last_fullsized":"2024-05-10T04:22:38.496138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:06.712574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068415+0000","last_change":"2024-05-10T04:22:37.507850+0000","last_active":"2024-05-10T04:22:39.068415+0000","last_peered":"2024-05-10T04:22:39.068415+0000","last_clean":"2024-05-10T04:22:39.068415+0000","last_became_active":"2024-05-10T04:22:37.507569+0000","last_became_peered":"2024-05-10T04:22:37.507569+0000","last_unstale":"2024-05-10T04:22:39.068415+0000","last_undegraded":"2024-05-10T04:22:39.068415+0000","last_fullsized":"2024-05-10T04:22:39.068415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:32:34.172364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070553+0000","last_change":"2024-05-10T04:22:36.938914+0000","last_active":"2024-05-10T04:22:39.070553+0000","last_peered":"2024-05-10T04:22:39.070553+0000","last_clean":"2024-05-10T04:22:39.070553+0000","last_became_active":"2024-05-10T04:22:36.938595+0000","last_became_peered":"2024-05-10T04:22:36.938595+0000","last_unstale":"2024-05-10T04:22:39.070553+0000","last_undegraded":"2024-05-10T04:22:39.070553+0000","last_fullsized":"2024-05-10T04:22:39.070553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:42.070391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069442+0000","last_change":"2024-05-10T04:22:37.505070+0000","last_active":"2024-05-10T04:22:39.069442+0000","last_peered":"2024-05-10T04:22:39.069442+0000","last_clean":"2024-05-10T04:22:39.069442+0000","last_became_active":"2024-05-10T04:22:37.504723+0000","last_became_peered":"2024-05-10T04:22:37.504723+0000","last_unstale":"2024-05-10T04:22:39.069442+0000","last_undegraded":"2024-05-10T04:22:39.069442+0000","last_fullsized":"2024-05-10T04:22:39.069442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:43:11.310124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497386+0000","last_change":"2024-05-10T04:22:36.922648+0000","last_active":"2024-05-10T04:22:38.497386+0000","last_peered":"2024-05-10T04:22:38.497386+0000","last_clean":"2024-05-10T04:22:38.497386+0000","last_became_active":"2024-05-10T04:22:36.922257+0000","last_became_peered":"2024-05-10T04:22:36.922257+0000","last_unstale":"2024-05-10T04:22:38.497386+0000","last_undegraded":"2024-05-10T04:22:38.497386+0000","last_fullsized":"2024-05-10T04:22:38.497386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:45:19.397807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070568+0000","last_change":"2024-05-10T04:22:37.531232+0000","last_active":"2024-05-10T04:22:39.070568+0000","last_peered":"2024-05-10T04:22:39.070568+0000","last_clean":"2024-05-10T04:22:39.070568+0000","last_became_active":"2024-05-10T04:22:37.530843+0000","last_became_peered":"2024-05-10T04:22:37.530843+0000","last_unstale":"2024-05-10T04:22:39.070568+0000","last_undegraded":"2024-05-10T04:22:39.070568+0000","last_fullsized":"2024-05-10T04:22:39.070568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:50.806224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496380+0000","last_change":"2024-05-10T04:22:36.936617+0000","last_active":"2024-05-10T04:22:38.496380+0000","last_peered":"2024-05-10T04:22:38.496380+0000","last_clean":"2024-05-10T04:22:38.496380+0000","last_became_active":"2024-05-10T04:22:36.936285+0000","last_became_peered":"2024-05-10T04:22:36.936285+0000","last_unstale":"2024-05-10T04:22:38.496380+0000","last_undegraded":"2024-05-10T04:22:38.496380+0000","last_fullsized":"2024-05-10T04:22:38.496380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:36:21.914720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496722+0000","last_change":"2024-05-10T04:22:37.520651+0000","last_active":"2024-05-10T04:22:38.496722+0000","last_peered":"2024-05-10T04:22:38.496722+0000","last_clean":"2024-05-10T04:22:38.496722+0000","last_became_active":"2024-05-10T04:22:37.519874+0000","last_became_peered":"2024-05-10T04:22:37.519874+0000","last_unstale":"2024-05-10T04:22:38.496722+0000","last_undegraded":"2024-05-10T04:22:38.496722+0000","last_fullsized":"2024-05-10T04:22:38.496722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:44.231090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497498+0000","last_change":"2024-05-10T04:22:36.919541+0000","last_active":"2024-05-10T04:22:38.497498+0000","last_peered":"2024-05-10T04:22:38.497498+0000","last_clean":"2024-05-10T04:22:38.497498+0000","last_became_active":"2024-05-10T04:22:36.918920+0000","last_became_peered":"2024-05-10T04:22:36.918920+0000","last_unstale":"2024-05-10T04:22:38.497498+0000","last_undegraded":"2024-05-10T04:22:38.497498+0000","last_fullsized":"2024-05-10T04:22:38.497498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:55.721524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070854+0000","last_change":"2024-05-10T04:22:37.527580+0000","last_active":"2024-05-10T04:22:39.070854+0000","last_peered":"2024-05-10T04:22:39.070854+0000","last_clean":"2024-05-10T04:22:39.070854+0000","last_became_active":"2024-05-10T04:22:37.527300+0000","last_became_peered":"2024-05-10T04:22:37.527300+0000","last_unstale":"2024-05-10T04:22:39.070854+0000","last_undegraded":"2024-05-10T04:22:39.070854+0000","last_fullsized":"2024-05-10T04:22:39.070854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:20:47.909486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069677+0000","last_change":"2024-05-10T04:22:37.510392+0000","last_active":"2024-05-10T04:22:39.069677+0000","last_peered":"2024-05-10T04:22:39.069677+0000","last_clean":"2024-05-10T04:22:39.069677+0000","last_became_active":"2024-05-10T04:22:37.510025+0000","last_became_peered":"2024-05-10T04:22:37.510025+0000","last_unstale":"2024-05-10T04:22:39.069677+0000","last_undegraded":"2024-05-10T04:22:39.069677+0000","last_fullsized":"2024-05-10T04:22:39.069677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:32:34.172364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497241+0000","last_change":"2024-05-10T04:22:37.509539+0000","last_active":"2024-05-10T04:22:38.497241+0000","last_peered":"2024-05-10T04:22:38.497241+0000","last_clean":"2024-05-10T04:22:38.497241+0000","last_became_active":"2024-05-10T04:22:37.508940+0000","last_became_peered":"2024-05-10T04:22:37.508940+0000","last_unstale":"2024-05-10T04:22:38.497241+0000","last_undegraded":"2024-05-10T04:22:38.497241+0000","last_fullsized":"2024-05-10T04:22:38.497241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:36:22.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496640+0000","last_change":"2024-05-10T04:22:37.522117+0000","last_active":"2024-05-10T04:22:38.496640+0000","last_peered":"2024-05-10T04:22:38.496640+0000","last_clean":"2024-05-10T04:22:38.496640+0000","last_became_active":"2024-05-10T04:22:37.519139+0000","last_became_peered":"2024-05-10T04:22:37.519139+0000","last_unstale":"2024-05-10T04:22:38.496640+0000","last_undegraded":"2024-05-10T04:22:38.496640+0000","last_fullsized":"2024-05-10T04:22:38.496640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:21:00.214222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565462+0000","last_change":"2024-05-10T04:22:37.519204+0000","last_active":"2024-05-10T04:22:38.565462+0000","last_peered":"2024-05-10T04:22:38.565462+0000","last_clean":"2024-05-10T04:22:38.565462+0000","last_became_active":"2024-05-10T04:22:37.517860+0000","last_became_peered":"2024-05-10T04:22:37.517860+0000","last_unstale":"2024-05-10T04:22:38.565462+0000","last_undegraded":"2024-05-10T04:22:38.565462+0000","last_fullsized":"2024-05-10T04:22:38.565462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:43:11.310124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068533+0000","last_change":"2024-05-10T04:22:37.504218+0000","last_active":"2024-05-10T04:22:39.068533+0000","last_peered":"2024-05-10T04:22:39.068533+0000","last_clean":"2024-05-10T04:22:39.068533+0000","last_became_active":"2024-05-10T04:22:37.503947+0000","last_became_peered":"2024-05-10T04:22:37.503947+0000","last_unstale":"2024-05-10T04:22:39.068533+0000","last_undegraded":"2024-05-10T04:22:39.068533+0000","last_fullsized":"2024-05-10T04:22:39.068533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:14.343190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496322+0000","last_change":"2024-05-10T04:22:37.519414+0000","last_active":"2024-05-10T04:22:38.496322+0000","last_peered":"2024-05-10T04:22:38.496322+0000","last_clean":"2024-05-10T04:22:38.496322+0000","last_became_active":"2024-05-10T04:22:37.516543+0000","last_became_peered":"2024-05-10T04:22:37.516543+0000","last_unstale":"2024-05-10T04:22:38.496322+0000","last_undegraded":"2024-05-10T04:22:38.496322+0000","last_fullsized":"2024-05-10T04:22:38.496322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:51:34.367433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069529+0000","last_change":"2024-05-10T04:22:37.514037+0000","last_active":"2024-05-10T04:22:39.069529+0000","last_peered":"2024-05-10T04:22:39.069529+0000","last_clean":"2024-05-10T04:22:39.069529+0000","last_became_active":"2024-05-10T04:22:37.513712+0000","last_became_peered":"2024-05-10T04:22:37.513712+0000","last_unstale":"2024-05-10T04:22:39.069529+0000","last_undegraded":"2024-05-10T04:22:39.069529+0000","last_fullsized":"2024-05-10T04:22:39.069529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:44.231090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068643+0000","last_change":"2024-05-10T04:22:37.506846+0000","last_active":"2024-05-10T04:22:39.068643+0000","last_peered":"2024-05-10T04:22:39.068643+0000","last_clean":"2024-05-10T04:22:39.068643+0000","last_became_active":"2024-05-10T04:22:37.506474+0000","last_became_peered":"2024-05-10T04:22:37.506474+0000","last_unstale":"2024-05-10T04:22:39.068643+0000","last_undegraded":"2024-05-10T04:22:39.068643+0000","last_fullsized":"2024-05-10T04:22:39.068643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:47:50.791426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496480+0000","last_change":"2024-05-10T04:22:37.521288+0000","last_active":"2024-05-10T04:22:38.496480+0000","last_peered":"2024-05-10T04:22:38.496480+0000","last_clean":"2024-05-10T04:22:38.496480+0000","last_became_active":"2024-05-10T04:22:37.520951+0000","last_became_peered":"2024-05-10T04:22:37.520951+0000","last_unstale":"2024-05-10T04:22:38.496480+0000","last_undegraded":"2024-05-10T04:22:38.496480+0000","last_fullsized":"2024-05-10T04:22:38.496480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:14.343190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068105+0000","last_change":"2024-05-10T04:22:37.503799+0000","last_active":"2024-05-10T04:22:39.068105+0000","last_peered":"2024-05-10T04:22:39.068105+0000","last_clean":"2024-05-10T04:22:39.068105+0000","last_became_active":"2024-05-10T04:22:37.503081+0000","last_became_peered":"2024-05-10T04:22:37.503081+0000","last_unstale":"2024-05-10T04:22:39.068105+0000","last_undegraded":"2024-05-10T04:22:39.068105+0000","last_fullsized":"2024-05-10T04:22:39.068105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:50:46.925328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497145+0000","last_change":"2024-05-10T04:22:37.522075+0000","last_active":"2024-05-10T04:22:38.497145+0000","last_peered":"2024-05-10T04:22:38.497145+0000","last_clean":"2024-05-10T04:22:38.497145+0000","last_became_active":"2024-05-10T04:22:37.518004+0000","last_became_peered":"2024-05-10T04:22:37.518004+0000","last_unstale":"2024-05-10T04:22:38.497145+0000","last_undegraded":"2024-05-10T04:22:38.497145+0000","last_fullsized":"2024-05-10T04:22:38.497145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:42.373586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565375+0000","last_change":"2024-05-10T04:22:37.519285+0000","last_active":"2024-05-10T04:22:38.565375+0000","last_peered":"2024-05-10T04:22:38.565375+0000","last_clean":"2024-05-10T04:22:38.565375+0000","last_became_active":"2024-05-10T04:22:37.518230+0000","last_became_peered":"2024-05-10T04:22:37.518230+0000","last_unstale":"2024-05-10T04:22:38.565375+0000","last_undegraded":"2024-05-10T04:22:38.565375+0000","last_fullsized":"2024-05-10T04:22:38.565375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:32:34.172364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070158+0000","last_change":"2024-05-10T04:22:37.505032+0000","last_active":"2024-05-10T04:22:39.070158+0000","last_peered":"2024-05-10T04:22:39.070158+0000","last_clean":"2024-05-10T04:22:39.070158+0000","last_became_active":"2024-05-10T04:22:37.504674+0000","last_became_peered":"2024-05-10T04:22:37.504674+0000","last_unstale":"2024-05-10T04:22:39.070158+0000","last_undegraded":"2024-05-10T04:22:39.070158+0000","last_fullsized":"2024-05-10T04:22:39.070158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:51:34.367433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.032}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9430000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:22:49.063 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:22:49.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.360+0000 7f9a90800700 1 Processor -- start 2024-05-10T04:22:49.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.360+0000 7f9a90800700 1 -- start start 2024-05-10T04:22:49.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.362+0000 7f9a90800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a880b2f50 0x7f9a88161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:49.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.362+0000 7f9a90800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a880d3030 0x7f9a880d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.362+0000 7f9a90800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a880d28c0 con 0x7f9a880d0630 2024-05-10T04:22:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.362+0000 7f9a90800700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a880b3360 con 0x7f9a880d3030 2024-05-10T04:22:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.362+0000 7f9a90800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a881624e0 con 0x7f9a880b2f50 2024-05-10T04:22:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.362+0000 7f9a8d400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a880d3030 0x7f9a880d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.362+0000 7f9a8e800700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9a880d0630 0x7f9a880d0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41562/0 (socket says 172.21.15.80:41562) 2024-05-10T04:22:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.362+0000 7f9a8e800700 1 -- 172.21.15.80:0/3667712577 learned_addr learned my addr 172.21.15.80:0/3667712577 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.362+0000 7f9a8de00700 1 --2- 172.21.15.80:0/3667712577 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a880b2f50 0x7f9a88161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.363+0000 7f9a8ca00700 1 -- 172.21.15.80:0/3667712577 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390470593 0 0) 0x7f9a880d28c0 con 0x7f9a880d0630 2024-05-10T04:22:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.363+0000 7f9a8ca00700 1 -- 172.21.15.80:0/3667712577 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a700035b0 con 0x7f9a880d0630 2024-05-10T04:22:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.363+0000 7f9a8d400700 1 -- 172.21.15.80:0/3667712577 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a880b2f50 msgr2=0x7f9a88161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.363+0000 7f9a8d400700 1 --2- 172.21.15.80:0/3667712577 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a880b2f50 0x7f9a88161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.363+0000 7f9a8d400700 1 -- 172.21.15.80:0/3667712577 >> v1:172.21.15.80:6789/0 conn(0x7f9a880d0630 legacy=0x7f9a880d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.363+0000 7f9a8d400700 1 -- 172.21.15.80:0/3667712577 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a880d2ba0 con 0x7f9a880d3030 2024-05-10T04:22:49.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.363+0000 7f9a8d400700 1 --2- 172.21.15.80:0/3667712577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a880d3030 0x7f9a880d3440 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009840 tx=0x7f9a78009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a9fdde1e0ea5f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:49.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.363+0000 7f9a8ca00700 1 -- 172.21.15.80:0/3667712577 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78011830 con 0x7f9a880d3030 2024-05-10T04:22:49.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.363+0000 7f9a8ca00700 1 -- 172.21.15.80:0/3667712577 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a78011990 con 0x7f9a880d3030 2024-05-10T04:22:49.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.363+0000 7f9a8ca00700 1 -- 172.21.15.80:0/3667712577 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78011d20 con 0x7f9a880d3030 2024-05-10T04:22:49.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.364+0000 7f9a90800700 1 -- 172.21.15.80:0/3667712577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a880d3030 msgr2=0x7f9a880d3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:49.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.364+0000 7f9a90800700 1 --2- 172.21.15.80:0/3667712577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a880d3030 0x7f9a880d3440 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009840 tx=0x7f9a78009b50 comp rx=0 tx=0).stop 2024-05-10T04:22:49.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.364+0000 7f9a90800700 1 -- 172.21.15.80:0/3667712577 shutdown_connections 2024-05-10T04:22:49.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.364+0000 7f9a90800700 1 --2- 172.21.15.80:0/3667712577 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a880b2f50 0x7f9a88161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.364+0000 7f9a90800700 1 --2- 172.21.15.80:0/3667712577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a880d3030 0x7f9a880d3440 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.364+0000 7f9a90800700 1 -- 172.21.15.80:0/3667712577 >> 172.21.15.80:0/3667712577 conn(0x7f9a8806c3f0 msgr2=0x7f9a8806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:49.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.364+0000 7f9a90800700 1 -- 172.21.15.80:0/3667712577 shutdown_connections 2024-05-10T04:22:49.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.364+0000 7f9a90800700 1 -- 172.21.15.80:0/3667712577 wait complete. 2024-05-10T04:22:49.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.367+0000 7f9a90800700 1 Processor -- start 2024-05-10T04:22:49.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.367+0000 7f9a90800700 1 -- start start 2024-05-10T04:22:49.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.369+0000 7f9a90800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a880b2f50 0x7f9a880cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:49.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.369+0000 7f9a90800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a880d0630 0x7f9a880c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:49.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.369+0000 7f9a90800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a880d3030 0x7f9a880c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:49.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.369+0000 7f9a90800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8815c7a0 con 0x7f9a880b2f50 2024-05-10T04:22:49.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.369+0000 7f9a90800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a880ccf00 con 0x7f9a880d3030 2024-05-10T04:22:49.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.369+0000 7f9a90800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a881e7e60 con 0x7f9a880d0630 2024-05-10T04:22:49.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.369+0000 7f9a8de00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a880b2f50 0x7f9a880cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:49.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.369+0000 7f9a8de00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a880b2f50 0x7f9a880cc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53176/0 (socket says 172.21.15.80:53176) 2024-05-10T04:22:49.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.369+0000 7f9a8de00700 1 -- 172.21.15.80:0/801388197 learned_addr learned my addr 172.21.15.80:0/801388197 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:49.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.369+0000 7f9a8d400700 1 --2- 172.21.15.80:0/801388197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a880d0630 0x7f9a880c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:49.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.369+0000 7f9a8e800700 1 --2- 172.21.15.80:0/801388197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a880d3030 0x7f9a880c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.369+0000 7f9a8de00700 1 -- 172.21.15.80:0/801388197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a880d0630 msgr2=0x7f9a880c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.369+0000 7f9a8de00700 1 --2- 172.21.15.80:0/801388197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a880d0630 0x7f9a880c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.369+0000 7f9a8de00700 1 -- 172.21.15.80:0/801388197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a880d3030 msgr2=0x7f9a880c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.369+0000 7f9a8de00700 1 --2- 172.21.15.80:0/801388197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a880d3030 0x7f9a880c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.369+0000 7f9a8de00700 1 -- 172.21.15.80:0/801388197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a780094a0 con 0x7f9a880b2f50 2024-05-10T04:22:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.369+0000 7f9a8de00700 1 --2- 172.21.15.80:0/801388197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a880b2f50 0x7f9a880cc460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00e870 tx=0x7f9a7c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.370+0000 7f9a82000700 1 -- 172.21.15.80:0/801388197 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c013680 con 0x7f9a880b2f50 2024-05-10T04:22:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.370+0000 7f9a82000700 1 -- 172.21.15.80:0/801388197 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7c0137e0 con 0x7f9a880b2f50 2024-05-10T04:22:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.370+0000 7f9a90800700 1 -- 172.21.15.80:0/801388197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a881e8140 con 0x7f9a880b2f50 2024-05-10T04:22:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.370+0000 7f9a82000700 1 -- 172.21.15.80:0/801388197 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c013b70 con 0x7f9a880b2f50 2024-05-10T04:22:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.370+0000 7f9a90800700 1 -- 172.21.15.80:0/801388197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a881e8700 con 0x7f9a880b2f50 2024-05-10T04:22:49.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.371+0000 7f9a90800700 1 -- 172.21.15.80:0/801388197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a88074af0 con 0x7f9a880b2f50 2024-05-10T04:22:49.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.372+0000 7f9a82000700 1 -- 172.21.15.80:0/801388197 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9a7c013cd0 con 0x7f9a880b2f50 2024-05-10T04:22:49.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.373+0000 7f9a82000700 1 --2- 172.21.15.80:0/801388197 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9a6c06ac90 0x7f9a6c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:49.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.373+0000 7f9a82000700 1 -- 172.21.15.80:0/801388197 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a7c089260 con 0x7f9a880b2f50 2024-05-10T04:22:49.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.373+0000 7f9a8d400700 1 --2- 172.21.15.80:0/801388197 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9a6c06ac90 0x7f9a6c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:49.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.374+0000 7f9a8d400700 1 --2- 172.21.15.80:0/801388197 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9a6c06ac90 0x7f9a6c06d1a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9a880b7110 tx=0x7f9a78008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:49.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.378+0000 7f9a82000700 1 -- 172.21.15.80:0/801388197 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9a7c0543b0 con 0x7f9a880b2f50 2024-05-10T04:22:49.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.577+0000 7f9a90800700 1 -- 172.21.15.80:0/801388197 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a881629b0 con 0x7f9a6c06ac90 2024-05-10T04:22:49.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.585+0000 7f9a82000700 1 -- 172.21.15.80:0/801388197 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264535 (secure 0 0 0) 0x7f9a78011b00 con 0x7f9a6c06ac90 2024-05-10T04:22:49.590 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:49.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.589+0000 7f9a90800700 1 -- 172.21.15.80:0/801388197 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9a6c06ac90 msgr2=0x7f9a6c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:49.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.589+0000 7f9a90800700 1 --2- 172.21.15.80:0/801388197 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9a6c06ac90 0x7f9a6c06d1a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9a880b7110 tx=0x7f9a78008030 comp rx=0 tx=0).stop 2024-05-10T04:22:49.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.589+0000 7f9a90800700 1 -- 172.21.15.80:0/801388197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a880b2f50 msgr2=0x7f9a880cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:49.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.589+0000 7f9a90800700 1 --2- 172.21.15.80:0/801388197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a880b2f50 0x7f9a880cc460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00e870 tx=0x7f9a7c00eb80 comp rx=0 tx=0).stop 2024-05-10T04:22:49.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.589+0000 7f9a90800700 1 -- 172.21.15.80:0/801388197 shutdown_connections 2024-05-10T04:22:49.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.589+0000 7f9a90800700 1 --2- 172.21.15.80:0/801388197 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9a6c06ac90 0x7f9a6c06d1a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.589+0000 7f9a90800700 1 --2- 172.21.15.80:0/801388197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a880b2f50 0x7f9a880cc460 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.589+0000 7f9a90800700 1 --2- 172.21.15.80:0/801388197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a880d3030 0x7f9a880c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.589+0000 7f9a90800700 1 --2- 172.21.15.80:0/801388197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a880d0630 0x7f9a880c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.589+0000 7f9a90800700 1 -- 172.21.15.80:0/801388197 >> 172.21.15.80:0/801388197 conn(0x7f9a8806c3f0 msgr2=0x7f9a880b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:49.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.589+0000 7f9a90800700 1 -- 172.21.15.80:0/801388197 shutdown_connections 2024-05-10T04:22:49.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.589+0000 7f9a90800700 1 -- 172.21.15.80:0/801388197 wait complete. 2024-05-10T04:22:49.593 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-10T04:22:49.617 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-10T04:22:48.737380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.243490"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.071084+0000","last_change":"2024-05-10T04:22:37.529212+0000","last_active":"2024-05-10T04:22:39.071084+0000","last_peered":"2024-05-10T04:22:39.071084+0000","last_clean":"2024-05-10T04:22:39.071084+0000","last_became_active":"2024-05-10T04:22:37.528975+0000","last_became_peered":"2024-05-10T04:22:37.528975+0000","last_unstale":"2024-05-10T04:22:39.071084+0000","last_undegraded":"2024-05-10T04:22:39.071084+0000","last_fullsized":"2024-05-10T04:22:39.071084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:43:31.418620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496348+0000","last_change":"2024-05-10T04:22:37.513971+0000","last_active":"2024-05-10T04:22:38.496348+0000","last_peered":"2024-05-10T04:22:38.496348+0000","last_clean":"2024-05-10T04:22:38.496348+0000","last_became_active":"2024-05-10T04:22:37.513528+0000","last_became_peered":"2024-05-10T04:22:37.513528+0000","last_unstale":"2024-05-10T04:22:38.496348+0000","last_undegraded":"2024-05-10T04:22:38.496348+0000","last_fullsized":"2024-05-10T04:22:38.496348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:27:09.485253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565409+0000","last_change":"2024-05-10T04:22:37.505391+0000","last_active":"2024-05-10T04:22:38.565409+0000","last_peered":"2024-05-10T04:22:38.565409+0000","last_clean":"2024-05-10T04:22:38.565409+0000","last_became_active":"2024-05-10T04:22:37.505063+0000","last_became_peered":"2024-05-10T04:22:37.505063+0000","last_unstale":"2024-05-10T04:22:38.565409+0000","last_undegraded":"2024-05-10T04:22:38.565409+0000","last_fullsized":"2024-05-10T04:22:38.565409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:27:50.672963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496838+0000","last_change":"2024-05-10T04:22:37.520462+0000","last_active":"2024-05-10T04:22:38.496838+0000","last_peered":"2024-05-10T04:22:38.496838+0000","last_clean":"2024-05-10T04:22:38.496838+0000","last_became_active":"2024-05-10T04:22:37.519497+0000","last_became_peered":"2024-05-10T04:22:37.519497+0000","last_unstale":"2024-05-10T04:22:38.496838+0000","last_undegraded":"2024-05-10T04:22:38.496838+0000","last_fullsized":"2024-05-10T04:22:38.496838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:21.117834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070309+0000","last_change":"2024-05-10T04:22:37.526517+0000","last_active":"2024-05-10T04:22:39.070309+0000","last_peered":"2024-05-10T04:22:39.070309+0000","last_clean":"2024-05-10T04:22:39.070309+0000","last_became_active":"2024-05-10T04:22:37.526181+0000","last_became_peered":"2024-05-10T04:22:37.526181+0000","last_unstale":"2024-05-10T04:22:39.070309+0000","last_undegraded":"2024-05-10T04:22:39.070309+0000","last_fullsized":"2024-05-10T04:22:39.070309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:21:00.214222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496509+0000","last_change":"2024-05-10T04:22:37.513739+0000","last_active":"2024-05-10T04:22:38.496509+0000","last_peered":"2024-05-10T04:22:38.496509+0000","last_clean":"2024-05-10T04:22:38.496509+0000","last_became_active":"2024-05-10T04:22:37.513348+0000","last_became_peered":"2024-05-10T04:22:37.513348+0000","last_unstale":"2024-05-10T04:22:38.496509+0000","last_undegraded":"2024-05-10T04:22:38.496509+0000","last_fullsized":"2024-05-10T04:22:38.496509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:50.806224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070073+0000","last_change":"2024-05-10T04:22:37.523784+0000","last_active":"2024-05-10T04:22:39.070073+0000","last_peered":"2024-05-10T04:22:39.070073+0000","last_clean":"2024-05-10T04:22:39.070073+0000","last_became_active":"2024-05-10T04:22:37.523472+0000","last_became_peered":"2024-05-10T04:22:37.523472+0000","last_unstale":"2024-05-10T04:22:39.070073+0000","last_undegraded":"2024-05-10T04:22:39.070073+0000","last_fullsized":"2024-05-10T04:22:39.070073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:19:35.892439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068081+0000","last_change":"2024-05-10T04:22:37.530486+0000","last_active":"2024-05-10T04:22:39.068081+0000","last_peered":"2024-05-10T04:22:39.068081+0000","last_clean":"2024-05-10T04:22:39.068081+0000","last_became_active":"2024-05-10T04:22:37.530129+0000","last_became_peered":"2024-05-10T04:22:37.530129+0000","last_unstale":"2024-05-10T04:22:39.068081+0000","last_undegraded":"2024-05-10T04:22:39.068081+0000","last_fullsized":"2024-05-10T04:22:39.068081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:21:00.214222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.071177+0000","last_change":"2024-05-10T04:22:37.528608+0000","last_active":"2024-05-10T04:22:39.071177+0000","last_peered":"2024-05-10T04:22:39.071177+0000","last_clean":"2024-05-10T04:22:39.071177+0000","last_became_active":"2024-05-10T04:22:37.528314+0000","last_became_peered":"2024-05-10T04:22:37.528314+0000","last_unstale":"2024-05-10T04:22:39.071177+0000","last_undegraded":"2024-05-10T04:22:39.071177+0000","last_fullsized":"2024-05-10T04:22:39.071177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:29:02.206457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069683+0000","last_change":"2024-05-10T04:22:37.516245+0000","last_active":"2024-05-10T04:22:39.069683+0000","last_peered":"2024-05-10T04:22:39.069683+0000","last_clean":"2024-05-10T04:22:39.069683+0000","last_became_active":"2024-05-10T04:22:37.515936+0000","last_became_peered":"2024-05-10T04:22:37.515936+0000","last_unstale":"2024-05-10T04:22:39.069683+0000","last_undegraded":"2024-05-10T04:22:39.069683+0000","last_fullsized":"2024-05-10T04:22:39.069683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:21.117834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.071024+0000","last_change":"2024-05-10T04:22:37.527304+0000","last_active":"2024-05-10T04:22:39.071024+0000","last_peered":"2024-05-10T04:22:39.071024+0000","last_clean":"2024-05-10T04:22:39.071024+0000","last_became_active":"2024-05-10T04:22:37.526971+0000","last_became_peered":"2024-05-10T04:22:37.526971+0000","last_unstale":"2024-05-10T04:22:39.071024+0000","last_undegraded":"2024-05-10T04:22:39.071024+0000","last_fullsized":"2024-05-10T04:22:39.071024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:50:46.925328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070689+0000","last_change":"2024-05-10T04:22:37.502589+0000","last_active":"2024-05-10T04:22:39.070689+0000","last_peered":"2024-05-10T04:22:39.070689+0000","last_clean":"2024-05-10T04:22:39.070689+0000","last_became_active":"2024-05-10T04:22:37.502178+0000","last_became_peered":"2024-05-10T04:22:37.502178+0000","last_unstale":"2024-05-10T04:22:39.070689+0000","last_undegraded":"2024-05-10T04:22:39.070689+0000","last_fullsized":"2024-05-10T04:22:39.070689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:36:22.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068213+0000","last_change":"2024-05-10T04:22:37.510847+0000","last_active":"2024-05-10T04:22:39.068213+0000","last_peered":"2024-05-10T04:22:39.068213+0000","last_clean":"2024-05-10T04:22:39.068213+0000","last_became_active":"2024-05-10T04:22:37.510633+0000","last_became_peered":"2024-05-10T04:22:37.510633+0000","last_unstale":"2024-05-10T04:22:39.068213+0000","last_undegraded":"2024-05-10T04:22:39.068213+0000","last_fullsized":"2024-05-10T04:22:39.068213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:58.202277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565340+0000","last_change":"2024-05-10T04:22:37.510710+0000","last_active":"2024-05-10T04:22:38.565340+0000","last_peered":"2024-05-10T04:22:38.565340+0000","last_clean":"2024-05-10T04:22:38.565340+0000","last_became_active":"2024-05-10T04:22:37.509156+0000","last_became_peered":"2024-05-10T04:22:37.509156+0000","last_unstale":"2024-05-10T04:22:38.565340+0000","last_undegraded":"2024-05-10T04:22:38.565340+0000","last_fullsized":"2024-05-10T04:22:38.565340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:51:34.367433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.495937+0000","last_change":"2024-05-10T04:22:37.510383+0000","last_active":"2024-05-10T04:22:38.495937+0000","last_peered":"2024-05-10T04:22:38.495937+0000","last_clean":"2024-05-10T04:22:38.495937+0000","last_became_active":"2024-05-10T04:22:37.507435+0000","last_became_peered":"2024-05-10T04:22:37.507435+0000","last_unstale":"2024-05-10T04:22:38.495937+0000","last_undegraded":"2024-05-10T04:22:38.495937+0000","last_fullsized":"2024-05-10T04:22:38.495937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:32:34.172364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496433+0000","last_change":"2024-05-10T04:22:37.513653+0000","last_active":"2024-05-10T04:22:38.496433+0000","last_peered":"2024-05-10T04:22:38.496433+0000","last_clean":"2024-05-10T04:22:38.496433+0000","last_became_active":"2024-05-10T04:22:37.513360+0000","last_became_peered":"2024-05-10T04:22:37.513360+0000","last_unstale":"2024-05-10T04:22:38.496433+0000","last_undegraded":"2024-05-10T04:22:38.496433+0000","last_fullsized":"2024-05-10T04:22:38.496433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:32:34.172364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497048+0000","last_change":"2024-05-10T04:22:37.512778+0000","last_active":"2024-05-10T04:22:38.497048+0000","last_peered":"2024-05-10T04:22:38.497048+0000","last_clean":"2024-05-10T04:22:38.497048+0000","last_became_active":"2024-05-10T04:22:37.512065+0000","last_became_peered":"2024-05-10T04:22:37.512065+0000","last_unstale":"2024-05-10T04:22:38.497048+0000","last_undegraded":"2024-05-10T04:22:38.497048+0000","last_fullsized":"2024-05-10T04:22:38.497048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:02:11.073471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497418+0000","last_change":"2024-05-10T04:22:37.512740+0000","last_active":"2024-05-10T04:22:38.497418+0000","last_peered":"2024-05-10T04:22:38.497418+0000","last_clean":"2024-05-10T04:22:38.497418+0000","last_became_active":"2024-05-10T04:22:37.511158+0000","last_became_peered":"2024-05-10T04:22:37.511158+0000","last_unstale":"2024-05-10T04:22:38.497418+0000","last_undegraded":"2024-05-10T04:22:38.497418+0000","last_fullsized":"2024-05-10T04:22:38.497418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:03.281665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070431+0000","last_change":"2024-05-10T04:22:37.527306+0000","last_active":"2024-05-10T04:22:39.070431+0000","last_peered":"2024-05-10T04:22:39.070431+0000","last_clean":"2024-05-10T04:22:39.070431+0000","last_became_active":"2024-05-10T04:22:37.527036+0000","last_became_peered":"2024-05-10T04:22:37.527036+0000","last_unstale":"2024-05-10T04:22:39.070431+0000","last_undegraded":"2024-05-10T04:22:39.070431+0000","last_fullsized":"2024-05-10T04:22:39.070431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:28.560590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565568+0000","last_change":"2024-05-10T04:22:36.932349+0000","last_active":"2024-05-10T04:22:38.565568+0000","last_peered":"2024-05-10T04:22:38.565568+0000","last_clean":"2024-05-10T04:22:38.565568+0000","last_became_active":"2024-05-10T04:22:36.931526+0000","last_became_peered":"2024-05-10T04:22:36.931526+0000","last_unstale":"2024-05-10T04:22:38.565568+0000","last_undegraded":"2024-05-10T04:22:38.565568+0000","last_fullsized":"2024-05-10T04:22:38.565568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:57:15.621386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068537+0000","last_change":"2024-05-10T04:22:37.511862+0000","last_active":"2024-05-10T04:22:39.068537+0000","last_peered":"2024-05-10T04:22:39.068537+0000","last_clean":"2024-05-10T04:22:39.068537+0000","last_became_active":"2024-05-10T04:22:37.511535+0000","last_became_peered":"2024-05-10T04:22:37.511535+0000","last_unstale":"2024-05-10T04:22:39.068537+0000","last_undegraded":"2024-05-10T04:22:39.068537+0000","last_fullsized":"2024-05-10T04:22:39.068537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:27:09.485253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068563+0000","last_change":"2024-05-10T04:22:36.930693+0000","last_active":"2024-05-10T04:22:39.068563+0000","last_peered":"2024-05-10T04:22:39.068563+0000","last_clean":"2024-05-10T04:22:39.068563+0000","last_became_active":"2024-05-10T04:22:36.929916+0000","last_became_peered":"2024-05-10T04:22:36.929916+0000","last_unstale":"2024-05-10T04:22:39.068563+0000","last_undegraded":"2024-05-10T04:22:39.068563+0000","last_fullsized":"2024-05-10T04:22:39.068563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:13:55.237529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565543+0000","last_change":"2024-05-10T04:22:37.526069+0000","last_active":"2024-05-10T04:22:38.565543+0000","last_peered":"2024-05-10T04:22:38.565543+0000","last_clean":"2024-05-10T04:22:38.565543+0000","last_became_active":"2024-05-10T04:22:37.525791+0000","last_became_peered":"2024-05-10T04:22:37.525791+0000","last_unstale":"2024-05-10T04:22:38.565543+0000","last_undegraded":"2024-05-10T04:22:38.565543+0000","last_fullsized":"2024-05-10T04:22:38.565543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:14.343190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070684+0000","last_change":"2024-05-10T04:22:36.939770+0000","last_active":"2024-05-10T04:22:39.070684+0000","last_peered":"2024-05-10T04:22:39.070684+0000","last_clean":"2024-05-10T04:22:39.070684+0000","last_became_active":"2024-05-10T04:22:36.939301+0000","last_became_peered":"2024-05-10T04:22:36.939301+0000","last_unstale":"2024-05-10T04:22:39.070684+0000","last_undegraded":"2024-05-10T04:22:39.070684+0000","last_fullsized":"2024-05-10T04:22:39.070684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:27:49.663346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496562+0000","last_change":"2024-05-10T04:22:37.507133+0000","last_active":"2024-05-10T04:22:38.496562+0000","last_peered":"2024-05-10T04:22:38.496562+0000","last_clean":"2024-05-10T04:22:38.496562+0000","last_became_active":"2024-05-10T04:22:37.506811+0000","last_became_peered":"2024-05-10T04:22:37.506811+0000","last_unstale":"2024-05-10T04:22:38.496562+0000","last_undegraded":"2024-05-10T04:22:38.496562+0000","last_fullsized":"2024-05-10T04:22:38.496562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:28.560590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070333+0000","last_change":"2024-05-10T04:22:36.937289+0000","last_active":"2024-05-10T04:22:39.070333+0000","last_peered":"2024-05-10T04:22:39.070333+0000","last_clean":"2024-05-10T04:22:39.070333+0000","last_became_active":"2024-05-10T04:22:36.936972+0000","last_became_peered":"2024-05-10T04:22:36.936972+0000","last_unstale":"2024-05-10T04:22:39.070333+0000","last_undegraded":"2024-05-10T04:22:39.070333+0000","last_fullsized":"2024-05-10T04:22:39.070333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:06.712574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496845+0000","last_change":"2024-05-10T04:22:37.509008+0000","last_active":"2024-05-10T04:22:38.496845+0000","last_peered":"2024-05-10T04:22:38.496845+0000","last_clean":"2024-05-10T04:22:38.496845+0000","last_became_active":"2024-05-10T04:22:37.508188+0000","last_became_peered":"2024-05-10T04:22:37.508188+0000","last_unstale":"2024-05-10T04:22:38.496845+0000","last_undegraded":"2024-05-10T04:22:38.496845+0000","last_fullsized":"2024-05-10T04:22:38.496845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:58.202277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068360+0000","last_change":"2024-05-10T04:22:36.931519+0000","last_active":"2024-05-10T04:22:39.068360+0000","last_peered":"2024-05-10T04:22:39.068360+0000","last_clean":"2024-05-10T04:22:39.068360+0000","last_became_active":"2024-05-10T04:22:36.930555+0000","last_became_peered":"2024-05-10T04:22:36.930555+0000","last_unstale":"2024-05-10T04:22:39.068360+0000","last_undegraded":"2024-05-10T04:22:39.068360+0000","last_fullsized":"2024-05-10T04:22:39.068360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:00.426110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069534+0000","last_change":"2024-05-10T04:22:37.510204+0000","last_active":"2024-05-10T04:22:39.069534+0000","last_peered":"2024-05-10T04:22:39.069534+0000","last_clean":"2024-05-10T04:22:39.069534+0000","last_became_active":"2024-05-10T04:22:37.509393+0000","last_became_peered":"2024-05-10T04:22:37.509393+0000","last_unstale":"2024-05-10T04:22:39.069534+0000","last_undegraded":"2024-05-10T04:22:39.069534+0000","last_fullsized":"2024-05-10T04:22:39.069534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:03.281665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069401+0000","last_change":"2024-05-10T04:22:36.939267+0000","last_active":"2024-05-10T04:22:39.069401+0000","last_peered":"2024-05-10T04:22:39.069401+0000","last_clean":"2024-05-10T04:22:39.069401+0000","last_became_active":"2024-05-10T04:22:36.938965+0000","last_became_peered":"2024-05-10T04:22:36.938965+0000","last_unstale":"2024-05-10T04:22:39.069401+0000","last_undegraded":"2024-05-10T04:22:39.069401+0000","last_fullsized":"2024-05-10T04:22:39.069401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:34:08.587305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565609+0000","last_change":"2024-05-10T04:22:37.506554+0000","last_active":"2024-05-10T04:22:38.565609+0000","last_peered":"2024-05-10T04:22:38.565609+0000","last_clean":"2024-05-10T04:22:38.565609+0000","last_became_active":"2024-05-10T04:22:37.506176+0000","last_became_peered":"2024-05-10T04:22:37.506176+0000","last_unstale":"2024-05-10T04:22:38.565609+0000","last_undegraded":"2024-05-10T04:22:38.565609+0000","last_fullsized":"2024-05-10T04:22:38.565609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:21.117834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068191+0000","last_change":"2024-05-10T04:22:36.925541+0000","last_active":"2024-05-10T04:22:39.068191+0000","last_peered":"2024-05-10T04:22:39.068191+0000","last_clean":"2024-05-10T04:22:39.068191+0000","last_became_active":"2024-05-10T04:22:36.925205+0000","last_became_peered":"2024-05-10T04:22:36.925205+0000","last_unstale":"2024-05-10T04:22:39.068191+0000","last_undegraded":"2024-05-10T04:22:39.068191+0000","last_fullsized":"2024-05-10T04:22:39.068191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:20.974889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068123+0000","last_change":"2024-05-10T04:22:37.510685+0000","last_active":"2024-05-10T04:22:39.068123+0000","last_peered":"2024-05-10T04:22:39.068123+0000","last_clean":"2024-05-10T04:22:39.068123+0000","last_became_active":"2024-05-10T04:22:37.510373+0000","last_became_peered":"2024-05-10T04:22:37.510373+0000","last_unstale":"2024-05-10T04:22:39.068123+0000","last_undegraded":"2024-05-10T04:22:39.068123+0000","last_fullsized":"2024-05-10T04:22:39.068123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:44.231090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496383+0000","last_change":"2024-05-10T04:22:36.928180+0000","last_active":"2024-05-10T04:22:38.496383+0000","last_peered":"2024-05-10T04:22:38.496383+0000","last_clean":"2024-05-10T04:22:38.496383+0000","last_became_active":"2024-05-10T04:22:36.927821+0000","last_became_peered":"2024-05-10T04:22:36.927821+0000","last_unstale":"2024-05-10T04:22:38.496383+0000","last_undegraded":"2024-05-10T04:22:38.496383+0000","last_fullsized":"2024-05-10T04:22:38.496383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:45:19.397807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496112+0000","last_change":"2024-05-10T04:22:37.516811+0000","last_active":"2024-05-10T04:22:38.496112+0000","last_peered":"2024-05-10T04:22:38.496112+0000","last_clean":"2024-05-10T04:22:38.496112+0000","last_became_active":"2024-05-10T04:22:37.511489+0000","last_became_peered":"2024-05-10T04:22:37.511489+0000","last_unstale":"2024-05-10T04:22:38.496112+0000","last_undegraded":"2024-05-10T04:22:38.496112+0000","last_fullsized":"2024-05-10T04:22:38.496112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:44.231090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069855+0000","last_change":"2024-05-10T04:22:36.931435+0000","last_active":"2024-05-10T04:22:39.069855+0000","last_peered":"2024-05-10T04:22:39.069855+0000","last_clean":"2024-05-10T04:22:39.069855+0000","last_became_active":"2024-05-10T04:22:36.930942+0000","last_became_peered":"2024-05-10T04:22:36.930942+0000","last_unstale":"2024-05-10T04:22:39.069855+0000","last_undegraded":"2024-05-10T04:22:39.069855+0000","last_fullsized":"2024-05-10T04:22:39.069855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:45:19.397807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496995+0000","last_change":"2024-05-10T04:22:37.512758+0000","last_active":"2024-05-10T04:22:38.496995+0000","last_peered":"2024-05-10T04:22:38.496995+0000","last_clean":"2024-05-10T04:22:38.496995+0000","last_became_active":"2024-05-10T04:22:37.512328+0000","last_became_peered":"2024-05-10T04:22:37.512328+0000","last_unstale":"2024-05-10T04:22:38.496995+0000","last_undegraded":"2024-05-10T04:22:38.496995+0000","last_fullsized":"2024-05-10T04:22:38.496995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:23:17.836129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496870+0000","last_change":"2024-05-10T04:22:36.930650+0000","last_active":"2024-05-10T04:22:38.496870+0000","last_peered":"2024-05-10T04:22:38.496870+0000","last_clean":"2024-05-10T04:22:38.496870+0000","last_became_active":"2024-05-10T04:22:36.929660+0000","last_became_peered":"2024-05-10T04:22:36.929660+0000","last_unstale":"2024-05-10T04:22:38.496870+0000","last_undegraded":"2024-05-10T04:22:38.496870+0000","last_fullsized":"2024-05-10T04:22:38.496870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:49:54.352088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565607+0000","last_change":"2024-05-10T04:22:37.516984+0000","last_active":"2024-05-10T04:22:38.565607+0000","last_peered":"2024-05-10T04:22:38.565607+0000","last_clean":"2024-05-10T04:22:38.565607+0000","last_became_active":"2024-05-10T04:22:37.516708+0000","last_became_peered":"2024-05-10T04:22:37.516708+0000","last_unstale":"2024-05-10T04:22:38.565607+0000","last_undegraded":"2024-05-10T04:22:38.565607+0000","last_fullsized":"2024-05-10T04:22:38.565607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:50:46.925328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496445+0000","last_change":"2024-05-10T04:22:36.933595+0000","last_active":"2024-05-10T04:22:38.496445+0000","last_peered":"2024-05-10T04:22:38.496445+0000","last_clean":"2024-05-10T04:22:38.496445+0000","last_became_active":"2024-05-10T04:22:36.933244+0000","last_became_peered":"2024-05-10T04:22:36.933244+0000","last_unstale":"2024-05-10T04:22:38.496445+0000","last_undegraded":"2024-05-10T04:22:38.496445+0000","last_fullsized":"2024-05-10T04:22:38.496445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:34:08.587305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070569+0000","last_change":"2024-05-10T04:22:37.521115+0000","last_active":"2024-05-10T04:22:39.070569+0000","last_peered":"2024-05-10T04:22:39.070569+0000","last_clean":"2024-05-10T04:22:39.070569+0000","last_became_active":"2024-05-10T04:22:37.520685+0000","last_became_peered":"2024-05-10T04:22:37.520685+0000","last_unstale":"2024-05-10T04:22:39.070569+0000","last_undegraded":"2024-05-10T04:22:39.070569+0000","last_fullsized":"2024-05-10T04:22:39.070569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:58:32.047404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069983+0000","last_change":"2024-05-10T04:22:36.934708+0000","last_active":"2024-05-10T04:22:39.069983+0000","last_peered":"2024-05-10T04:22:39.069983+0000","last_clean":"2024-05-10T04:22:39.069983+0000","last_became_active":"2024-05-10T04:22:36.934415+0000","last_became_peered":"2024-05-10T04:22:36.934415+0000","last_unstale":"2024-05-10T04:22:39.069983+0000","last_undegraded":"2024-05-10T04:22:39.069983+0000","last_fullsized":"2024-05-10T04:22:39.069983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:49:54.352088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070498+0000","last_change":"2024-05-10T04:22:37.526943+0000","last_active":"2024-05-10T04:22:39.070498+0000","last_peered":"2024-05-10T04:22:39.070498+0000","last_clean":"2024-05-10T04:22:39.070498+0000","last_became_active":"2024-05-10T04:22:37.524757+0000","last_became_peered":"2024-05-10T04:22:37.524757+0000","last_unstale":"2024-05-10T04:22:39.070498+0000","last_undegraded":"2024-05-10T04:22:39.070498+0000","last_fullsized":"2024-05-10T04:22:39.070498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:23:17.836129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565473+0000","last_change":"2024-05-10T04:22:36.938772+0000","last_active":"2024-05-10T04:22:38.565473+0000","last_peered":"2024-05-10T04:22:38.565473+0000","last_clean":"2024-05-10T04:22:38.565473+0000","last_became_active":"2024-05-10T04:22:36.938463+0000","last_became_peered":"2024-05-10T04:22:36.938463+0000","last_unstale":"2024-05-10T04:22:38.565473+0000","last_undegraded":"2024-05-10T04:22:38.565473+0000","last_fullsized":"2024-05-10T04:22:38.565473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:00.426110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565316+0000","last_change":"2024-05-10T04:22:37.516169+0000","last_active":"2024-05-10T04:22:38.565316+0000","last_peered":"2024-05-10T04:22:38.565316+0000","last_clean":"2024-05-10T04:22:38.565316+0000","last_became_active":"2024-05-10T04:22:37.515199+0000","last_became_peered":"2024-05-10T04:22:37.515199+0000","last_unstale":"2024-05-10T04:22:38.565316+0000","last_undegraded":"2024-05-10T04:22:38.565316+0000","last_fullsized":"2024-05-10T04:22:38.565316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:44.231090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497050+0000","last_change":"2024-05-10T04:22:36.927348+0000","last_active":"2024-05-10T04:22:38.497050+0000","last_peered":"2024-05-10T04:22:38.497050+0000","last_clean":"2024-05-10T04:22:38.497050+0000","last_became_active":"2024-05-10T04:22:36.927029+0000","last_became_peered":"2024-05-10T04:22:36.927029+0000","last_unstale":"2024-05-10T04:22:38.497050+0000","last_undegraded":"2024-05-10T04:22:38.497050+0000","last_fullsized":"2024-05-10T04:22:38.497050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:55.721524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070438+0000","last_change":"2024-05-10T04:22:37.519929+0000","last_active":"2024-05-10T04:22:39.070438+0000","last_peered":"2024-05-10T04:22:39.070438+0000","last_clean":"2024-05-10T04:22:39.070438+0000","last_became_active":"2024-05-10T04:22:37.518788+0000","last_became_peered":"2024-05-10T04:22:37.518788+0000","last_unstale":"2024-05-10T04:22:39.070438+0000","last_undegraded":"2024-05-10T04:22:39.070438+0000","last_fullsized":"2024-05-10T04:22:39.070438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:02:11.073471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069352+0000","last_change":"2024-05-10T04:22:36.937577+0000","last_active":"2024-05-10T04:22:39.069352+0000","last_peered":"2024-05-10T04:22:39.069352+0000","last_clean":"2024-05-10T04:22:39.069352+0000","last_became_active":"2024-05-10T04:22:36.937300+0000","last_became_peered":"2024-05-10T04:22:36.937300+0000","last_unstale":"2024-05-10T04:22:39.069352+0000","last_undegraded":"2024-05-10T04:22:39.069352+0000","last_fullsized":"2024-05-10T04:22:39.069352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:20.974889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069757+0000","last_change":"2024-05-10T04:22:37.507070+0000","last_active":"2024-05-10T04:22:39.069757+0000","last_peered":"2024-05-10T04:22:39.069757+0000","last_clean":"2024-05-10T04:22:39.069757+0000","last_became_active":"2024-05-10T04:22:37.506325+0000","last_became_peered":"2024-05-10T04:22:37.506325+0000","last_unstale":"2024-05-10T04:22:39.069757+0000","last_undegraded":"2024-05-10T04:22:39.069757+0000","last_fullsized":"2024-05-10T04:22:39.069757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:14.343190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497219+0000","last_change":"2024-05-10T04:22:36.924331+0000","last_active":"2024-05-10T04:22:38.497219+0000","last_peered":"2024-05-10T04:22:38.497219+0000","last_clean":"2024-05-10T04:22:38.497219+0000","last_became_active":"2024-05-10T04:22:36.923979+0000","last_became_peered":"2024-05-10T04:22:36.923979+0000","last_unstale":"2024-05-10T04:22:38.497219+0000","last_undegraded":"2024-05-10T04:22:38.497219+0000","last_fullsized":"2024-05-10T04:22:38.497219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:13:55.237529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070337+0000","last_change":"2024-05-10T04:22:37.518033+0000","last_active":"2024-05-10T04:22:39.070337+0000","last_peered":"2024-05-10T04:22:39.070337+0000","last_clean":"2024-05-10T04:22:39.070337+0000","last_became_active":"2024-05-10T04:22:37.517618+0000","last_became_peered":"2024-05-10T04:22:37.517618+0000","last_unstale":"2024-05-10T04:22:39.070337+0000","last_undegraded":"2024-05-10T04:22:39.070337+0000","last_fullsized":"2024-05-10T04:22:39.070337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:04:22.431028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070758+0000","last_change":"2024-05-10T04:22:36.927567+0000","last_active":"2024-05-10T04:22:39.070758+0000","last_peered":"2024-05-10T04:22:39.070758+0000","last_clean":"2024-05-10T04:22:39.070758+0000","last_became_active":"2024-05-10T04:22:36.927215+0000","last_became_peered":"2024-05-10T04:22:36.927215+0000","last_unstale":"2024-05-10T04:22:39.070758+0000","last_undegraded":"2024-05-10T04:22:39.070758+0000","last_fullsized":"2024-05-10T04:22:39.070758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:00.426110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070495+0000","last_change":"2024-05-10T04:22:37.525145+0000","last_active":"2024-05-10T04:22:39.070495+0000","last_peered":"2024-05-10T04:22:39.070495+0000","last_clean":"2024-05-10T04:22:39.070495+0000","last_became_active":"2024-05-10T04:22:37.524777+0000","last_became_peered":"2024-05-10T04:22:37.524777+0000","last_unstale":"2024-05-10T04:22:39.070495+0000","last_undegraded":"2024-05-10T04:22:39.070495+0000","last_fullsized":"2024-05-10T04:22:39.070495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:42.373586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496253+0000","last_change":"2024-05-10T04:22:36.928079+0000","last_active":"2024-05-10T04:22:38.496253+0000","last_peered":"2024-05-10T04:22:38.496253+0000","last_clean":"2024-05-10T04:22:38.496253+0000","last_became_active":"2024-05-10T04:22:36.927807+0000","last_became_peered":"2024-05-10T04:22:36.927807+0000","last_unstale":"2024-05-10T04:22:38.496253+0000","last_undegraded":"2024-05-10T04:22:38.496253+0000","last_fullsized":"2024-05-10T04:22:38.496253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:49:54.352088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496907+0000","last_change":"2024-05-10T04:22:37.523430+0000","last_active":"2024-05-10T04:22:38.496907+0000","last_peered":"2024-05-10T04:22:38.496907+0000","last_clean":"2024-05-10T04:22:38.496907+0000","last_became_active":"2024-05-10T04:22:37.523130+0000","last_became_peered":"2024-05-10T04:22:37.523130+0000","last_unstale":"2024-05-10T04:22:38.496907+0000","last_undegraded":"2024-05-10T04:22:38.496907+0000","last_fullsized":"2024-05-10T04:22:38.496907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:04:22.431028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496929+0000","last_change":"2024-05-10T04:22:36.928078+0000","last_active":"2024-05-10T04:22:38.496929+0000","last_peered":"2024-05-10T04:22:38.496929+0000","last_clean":"2024-05-10T04:22:38.496929+0000","last_became_active":"2024-05-10T04:22:36.927734+0000","last_became_peered":"2024-05-10T04:22:36.927734+0000","last_unstale":"2024-05-10T04:22:38.496929+0000","last_undegraded":"2024-05-10T04:22:38.496929+0000","last_fullsized":"2024-05-10T04:22:38.496929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:20.974889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069661+0000","last_change":"2024-05-10T04:22:37.509565+0000","last_active":"2024-05-10T04:22:39.069661+0000","last_peered":"2024-05-10T04:22:39.069661+0000","last_clean":"2024-05-10T04:22:39.069661+0000","last_became_active":"2024-05-10T04:22:37.508788+0000","last_became_peered":"2024-05-10T04:22:37.508788+0000","last_unstale":"2024-05-10T04:22:39.069661+0000","last_undegraded":"2024-05-10T04:22:39.069661+0000","last_fullsized":"2024-05-10T04:22:39.069661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:43.080008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.495916+0000","last_change":"2024-05-10T04:22:37.513544+0000","last_active":"2024-05-10T04:22:38.495916+0000","last_peered":"2024-05-10T04:22:38.495916+0000","last_clean":"2024-05-10T04:22:38.495916+0000","last_became_active":"2024-05-10T04:22:37.513229+0000","last_became_peered":"2024-05-10T04:22:37.513229+0000","last_unstale":"2024-05-10T04:22:38.495916+0000","last_undegraded":"2024-05-10T04:22:38.495916+0000","last_fullsized":"2024-05-10T04:22:38.495916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:21.117834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497135+0000","last_change":"2024-05-10T04:22:36.916069+0000","last_active":"2024-05-10T04:22:38.497135+0000","last_peered":"2024-05-10T04:22:38.497135+0000","last_clean":"2024-05-10T04:22:38.497135+0000","last_became_active":"2024-05-10T04:22:36.915725+0000","last_became_peered":"2024-05-10T04:22:36.915725+0000","last_unstale":"2024-05-10T04:22:38.497135+0000","last_undegraded":"2024-05-10T04:22:38.497135+0000","last_fullsized":"2024-05-10T04:22:38.497135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:20.974889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068254+0000","last_change":"2024-05-10T04:22:37.525366+0000","last_active":"2024-05-10T04:22:39.068254+0000","last_peered":"2024-05-10T04:22:39.068254+0000","last_clean":"2024-05-10T04:22:39.068254+0000","last_became_active":"2024-05-10T04:22:37.525122+0000","last_became_peered":"2024-05-10T04:22:37.525122+0000","last_unstale":"2024-05-10T04:22:39.068254+0000","last_undegraded":"2024-05-10T04:22:39.068254+0000","last_fullsized":"2024-05-10T04:22:39.068254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:04:22.431028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496402+0000","last_change":"2024-05-10T04:22:36.926870+0000","last_active":"2024-05-10T04:22:38.496402+0000","last_peered":"2024-05-10T04:22:38.496402+0000","last_clean":"2024-05-10T04:22:38.496402+0000","last_became_active":"2024-05-10T04:22:36.926076+0000","last_became_peered":"2024-05-10T04:22:36.926076+0000","last_unstale":"2024-05-10T04:22:38.496402+0000","last_undegraded":"2024-05-10T04:22:38.496402+0000","last_fullsized":"2024-05-10T04:22:38.496402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:34:08.587305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-10T04:22:37.508301+0000","last_change":"2024-05-10T04:22:27.829537+0000","last_active":"2024-05-10T04:22:37.508301+0000","last_peered":"2024-05-10T04:22:37.508301+0000","last_clean":"2024-05-10T04:22:37.508301+0000","last_became_active":"2024-05-10T04:22:27.828179+0000","last_became_peered":"2024-05-10T04:22:27.828179+0000","last_unstale":"2024-05-10T04:22:37.508301+0000","last_undegraded":"2024-05-10T04:22:37.508301+0000","last_fullsized":"2024-05-10T04:22:37.508301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_clean_scrub_stamp":"2024-05-10T04:22:26.813824+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:23.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565196+0000","last_change":"2024-05-10T04:22:37.505786+0000","last_active":"2024-05-10T04:22:38.565196+0000","last_peered":"2024-05-10T04:22:38.565196+0000","last_clean":"2024-05-10T04:22:38.565196+0000","last_became_active":"2024-05-10T04:22:37.505505+0000","last_became_peered":"2024-05-10T04:22:37.505505+0000","last_unstale":"2024-05-10T04:22:38.565196+0000","last_undegraded":"2024-05-10T04:22:38.565196+0000","last_fullsized":"2024-05-10T04:22:38.565196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:58.202277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069932+0000","last_change":"2024-05-10T04:22:36.936346+0000","last_active":"2024-05-10T04:22:39.069932+0000","last_peered":"2024-05-10T04:22:39.069932+0000","last_clean":"2024-05-10T04:22:39.069932+0000","last_became_active":"2024-05-10T04:22:36.935973+0000","last_became_peered":"2024-05-10T04:22:36.935973+0000","last_unstale":"2024-05-10T04:22:39.069932+0000","last_undegraded":"2024-05-10T04:22:39.069932+0000","last_fullsized":"2024-05-10T04:22:39.069932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:02.272048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070608+0000","last_change":"2024-05-10T04:22:36.936645+0000","last_active":"2024-05-10T04:22:39.070608+0000","last_peered":"2024-05-10T04:22:39.070608+0000","last_clean":"2024-05-10T04:22:39.070608+0000","last_became_active":"2024-05-10T04:22:36.936136+0000","last_became_peered":"2024-05-10T04:22:36.936136+0000","last_unstale":"2024-05-10T04:22:39.070608+0000","last_undegraded":"2024-05-10T04:22:39.070608+0000","last_fullsized":"2024-05-10T04:22:39.070608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:36:21.914720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496170+0000","last_change":"2024-05-10T04:22:37.507676+0000","last_active":"2024-05-10T04:22:38.496170+0000","last_peered":"2024-05-10T04:22:38.496170+0000","last_clean":"2024-05-10T04:22:38.496170+0000","last_became_active":"2024-05-10T04:22:37.506346+0000","last_became_peered":"2024-05-10T04:22:37.506346+0000","last_unstale":"2024-05-10T04:22:38.496170+0000","last_undegraded":"2024-05-10T04:22:38.496170+0000","last_fullsized":"2024-05-10T04:22:38.496170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:50:46.925328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:40.809496+0000","last_change":"2024-05-10T04:22:36.929577+0000","last_active":"2024-05-10T04:22:40.809496+0000","last_peered":"2024-05-10T04:22:40.809496+0000","last_clean":"2024-05-10T04:22:40.809496+0000","last_became_active":"2024-05-10T04:22:36.929233+0000","last_became_peered":"2024-05-10T04:22:36.929233+0000","last_unstale":"2024-05-10T04:22:40.809496+0000","last_undegraded":"2024-05-10T04:22:40.809496+0000","last_fullsized":"2024-05-10T04:22:40.809496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:02.272048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068722+0000","last_change":"2024-05-10T04:22:37.519249+0000","last_active":"2024-05-10T04:22:39.068722+0000","last_peered":"2024-05-10T04:22:39.068722+0000","last_clean":"2024-05-10T04:22:39.068722+0000","last_became_active":"2024-05-10T04:22:37.516952+0000","last_became_peered":"2024-05-10T04:22:37.516952+0000","last_unstale":"2024-05-10T04:22:39.068722+0000","last_undegraded":"2024-05-10T04:22:39.068722+0000","last_fullsized":"2024-05-10T04:22:39.068722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:21.117834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069775+0000","last_change":"2024-05-10T04:22:36.931235+0000","last_active":"2024-05-10T04:22:39.069775+0000","last_peered":"2024-05-10T04:22:39.069775+0000","last_clean":"2024-05-10T04:22:39.069775+0000","last_became_active":"2024-05-10T04:22:36.930721+0000","last_became_peered":"2024-05-10T04:22:36.930721+0000","last_unstale":"2024-05-10T04:22:39.069775+0000","last_undegraded":"2024-05-10T04:22:39.069775+0000","last_fullsized":"2024-05-10T04:22:39.069775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:55.721524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565564+0000","last_change":"2024-05-10T04:22:37.508611+0000","last_active":"2024-05-10T04:22:38.565564+0000","last_peered":"2024-05-10T04:22:38.565564+0000","last_clean":"2024-05-10T04:22:38.565564+0000","last_became_active":"2024-05-10T04:22:37.508350+0000","last_became_peered":"2024-05-10T04:22:37.508350+0000","last_unstale":"2024-05-10T04:22:38.565564+0000","last_undegraded":"2024-05-10T04:22:38.565564+0000","last_fullsized":"2024-05-10T04:22:38.565564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:05:50.563476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069633+0000","last_change":"2024-05-10T04:22:36.936567+0000","last_active":"2024-05-10T04:22:39.069633+0000","last_peered":"2024-05-10T04:22:39.069633+0000","last_clean":"2024-05-10T04:22:39.069633+0000","last_became_active":"2024-05-10T04:22:36.936129+0000","last_became_peered":"2024-05-10T04:22:36.936129+0000","last_unstale":"2024-05-10T04:22:39.069633+0000","last_undegraded":"2024-05-10T04:22:39.069633+0000","last_fullsized":"2024-05-10T04:22:39.069633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:58:31.037787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070074+0000","last_change":"2024-05-10T04:22:37.501502+0000","last_active":"2024-05-10T04:22:39.070074+0000","last_peered":"2024-05-10T04:22:39.070074+0000","last_clean":"2024-05-10T04:22:39.070074+0000","last_became_active":"2024-05-10T04:22:37.499775+0000","last_became_peered":"2024-05-10T04:22:37.499775+0000","last_unstale":"2024-05-10T04:22:39.070074+0000","last_undegraded":"2024-05-10T04:22:39.070074+0000","last_fullsized":"2024-05-10T04:22:39.070074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:49:55.361705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.495945+0000","last_change":"2024-05-10T04:22:36.932162+0000","last_active":"2024-05-10T04:22:38.495945+0000","last_peered":"2024-05-10T04:22:38.495945+0000","last_clean":"2024-05-10T04:22:38.495945+0000","last_became_active":"2024-05-10T04:22:36.931860+0000","last_became_peered":"2024-05-10T04:22:36.931860+0000","last_unstale":"2024-05-10T04:22:38.495945+0000","last_undegraded":"2024-05-10T04:22:38.495945+0000","last_fullsized":"2024-05-10T04:22:38.495945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:58:31.037787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068207+0000","last_change":"2024-05-10T04:22:37.509114+0000","last_active":"2024-05-10T04:22:39.068207+0000","last_peered":"2024-05-10T04:22:39.068207+0000","last_clean":"2024-05-10T04:22:39.068207+0000","last_became_active":"2024-05-10T04:22:37.508839+0000","last_became_peered":"2024-05-10T04:22:37.508839+0000","last_unstale":"2024-05-10T04:22:39.068207+0000","last_undegraded":"2024-05-10T04:22:39.068207+0000","last_fullsized":"2024-05-10T04:22:39.068207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:05:50.563476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496138+0000","last_change":"2024-05-10T04:22:36.928410+0000","last_active":"2024-05-10T04:22:38.496138+0000","last_peered":"2024-05-10T04:22:38.496138+0000","last_clean":"2024-05-10T04:22:38.496138+0000","last_became_active":"2024-05-10T04:22:36.927343+0000","last_became_peered":"2024-05-10T04:22:36.927343+0000","last_unstale":"2024-05-10T04:22:38.496138+0000","last_undegraded":"2024-05-10T04:22:38.496138+0000","last_fullsized":"2024-05-10T04:22:38.496138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:06.712574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068415+0000","last_change":"2024-05-10T04:22:37.507850+0000","last_active":"2024-05-10T04:22:39.068415+0000","last_peered":"2024-05-10T04:22:39.068415+0000","last_clean":"2024-05-10T04:22:39.068415+0000","last_became_active":"2024-05-10T04:22:37.507569+0000","last_became_peered":"2024-05-10T04:22:37.507569+0000","last_unstale":"2024-05-10T04:22:39.068415+0000","last_undegraded":"2024-05-10T04:22:39.068415+0000","last_fullsized":"2024-05-10T04:22:39.068415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:32:34.172364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070553+0000","last_change":"2024-05-10T04:22:36.938914+0000","last_active":"2024-05-10T04:22:39.070553+0000","last_peered":"2024-05-10T04:22:39.070553+0000","last_clean":"2024-05-10T04:22:39.070553+0000","last_became_active":"2024-05-10T04:22:36.938595+0000","last_became_peered":"2024-05-10T04:22:36.938595+0000","last_unstale":"2024-05-10T04:22:39.070553+0000","last_undegraded":"2024-05-10T04:22:39.070553+0000","last_fullsized":"2024-05-10T04:22:39.070553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:42.070391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069442+0000","last_change":"2024-05-10T04:22:37.505070+0000","last_active":"2024-05-10T04:22:39.069442+0000","last_peered":"2024-05-10T04:22:39.069442+0000","last_clean":"2024-05-10T04:22:39.069442+0000","last_became_active":"2024-05-10T04:22:37.504723+0000","last_became_peered":"2024-05-10T04:22:37.504723+0000","last_unstale":"2024-05-10T04:22:39.069442+0000","last_undegraded":"2024-05-10T04:22:39.069442+0000","last_fullsized":"2024-05-10T04:22:39.069442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:43:11.310124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497386+0000","last_change":"2024-05-10T04:22:36.922648+0000","last_active":"2024-05-10T04:22:38.497386+0000","last_peered":"2024-05-10T04:22:38.497386+0000","last_clean":"2024-05-10T04:22:38.497386+0000","last_became_active":"2024-05-10T04:22:36.922257+0000","last_became_peered":"2024-05-10T04:22:36.922257+0000","last_unstale":"2024-05-10T04:22:38.497386+0000","last_undegraded":"2024-05-10T04:22:38.497386+0000","last_fullsized":"2024-05-10T04:22:38.497386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:45:19.397807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070568+0000","last_change":"2024-05-10T04:22:37.531232+0000","last_active":"2024-05-10T04:22:39.070568+0000","last_peered":"2024-05-10T04:22:39.070568+0000","last_clean":"2024-05-10T04:22:39.070568+0000","last_became_active":"2024-05-10T04:22:37.530843+0000","last_became_peered":"2024-05-10T04:22:37.530843+0000","last_unstale":"2024-05-10T04:22:39.070568+0000","last_undegraded":"2024-05-10T04:22:39.070568+0000","last_fullsized":"2024-05-10T04:22:39.070568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:50.806224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496380+0000","last_change":"2024-05-10T04:22:36.936617+0000","last_active":"2024-05-10T04:22:38.496380+0000","last_peered":"2024-05-10T04:22:38.496380+0000","last_clean":"2024-05-10T04:22:38.496380+0000","last_became_active":"2024-05-10T04:22:36.936285+0000","last_became_peered":"2024-05-10T04:22:36.936285+0000","last_unstale":"2024-05-10T04:22:38.496380+0000","last_undegraded":"2024-05-10T04:22:38.496380+0000","last_fullsized":"2024-05-10T04:22:38.496380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:36:21.914720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496722+0000","last_change":"2024-05-10T04:22:37.520651+0000","last_active":"2024-05-10T04:22:38.496722+0000","last_peered":"2024-05-10T04:22:38.496722+0000","last_clean":"2024-05-10T04:22:38.496722+0000","last_became_active":"2024-05-10T04:22:37.519874+0000","last_became_peered":"2024-05-10T04:22:37.519874+0000","last_unstale":"2024-05-10T04:22:38.496722+0000","last_undegraded":"2024-05-10T04:22:38.496722+0000","last_fullsized":"2024-05-10T04:22:38.496722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:44.231090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497498+0000","last_change":"2024-05-10T04:22:36.919541+0000","last_active":"2024-05-10T04:22:38.497498+0000","last_peered":"2024-05-10T04:22:38.497498+0000","last_clean":"2024-05-10T04:22:38.497498+0000","last_became_active":"2024-05-10T04:22:36.918920+0000","last_became_peered":"2024-05-10T04:22:36.918920+0000","last_unstale":"2024-05-10T04:22:38.497498+0000","last_undegraded":"2024-05-10T04:22:38.497498+0000","last_fullsized":"2024-05-10T04:22:38.497498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:35.888653+0000","last_clean_scrub_stamp":"2024-05-10T04:22:35.888653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:55.721524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070854+0000","last_change":"2024-05-10T04:22:37.527580+0000","last_active":"2024-05-10T04:22:39.070854+0000","last_peered":"2024-05-10T04:22:39.070854+0000","last_clean":"2024-05-10T04:22:39.070854+0000","last_became_active":"2024-05-10T04:22:37.527300+0000","last_became_peered":"2024-05-10T04:22:37.527300+0000","last_unstale":"2024-05-10T04:22:39.070854+0000","last_undegraded":"2024-05-10T04:22:39.070854+0000","last_fullsized":"2024-05-10T04:22:39.070854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:20:47.909486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069677+0000","last_change":"2024-05-10T04:22:37.510392+0000","last_active":"2024-05-10T04:22:39.069677+0000","last_peered":"2024-05-10T04:22:39.069677+0000","last_clean":"2024-05-10T04:22:39.069677+0000","last_became_active":"2024-05-10T04:22:37.510025+0000","last_became_peered":"2024-05-10T04:22:37.510025+0000","last_unstale":"2024-05-10T04:22:39.069677+0000","last_undegraded":"2024-05-10T04:22:39.069677+0000","last_fullsized":"2024-05-10T04:22:39.069677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:32:34.172364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497241+0000","last_change":"2024-05-10T04:22:37.509539+0000","last_active":"2024-05-10T04:22:38.497241+0000","last_peered":"2024-05-10T04:22:38.497241+0000","last_clean":"2024-05-10T04:22:38.497241+0000","last_became_active":"2024-05-10T04:22:37.508940+0000","last_became_peered":"2024-05-10T04:22:37.508940+0000","last_unstale":"2024-05-10T04:22:38.497241+0000","last_undegraded":"2024-05-10T04:22:38.497241+0000","last_fullsized":"2024-05-10T04:22:38.497241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:36:22.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496640+0000","last_change":"2024-05-10T04:22:37.522117+0000","last_active":"2024-05-10T04:22:38.496640+0000","last_peered":"2024-05-10T04:22:38.496640+0000","last_clean":"2024-05-10T04:22:38.496640+0000","last_became_active":"2024-05-10T04:22:37.519139+0000","last_became_peered":"2024-05-10T04:22:37.519139+0000","last_unstale":"2024-05-10T04:22:38.496640+0000","last_undegraded":"2024-05-10T04:22:38.496640+0000","last_fullsized":"2024-05-10T04:22:38.496640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:21:00.214222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565462+0000","last_change":"2024-05-10T04:22:37.519204+0000","last_active":"2024-05-10T04:22:38.565462+0000","last_peered":"2024-05-10T04:22:38.565462+0000","last_clean":"2024-05-10T04:22:38.565462+0000","last_became_active":"2024-05-10T04:22:37.517860+0000","last_became_peered":"2024-05-10T04:22:37.517860+0000","last_unstale":"2024-05-10T04:22:38.565462+0000","last_undegraded":"2024-05-10T04:22:38.565462+0000","last_fullsized":"2024-05-10T04:22:38.565462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:43:11.310124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068533+0000","last_change":"2024-05-10T04:22:37.504218+0000","last_active":"2024-05-10T04:22:39.068533+0000","last_peered":"2024-05-10T04:22:39.068533+0000","last_clean":"2024-05-10T04:22:39.068533+0000","last_became_active":"2024-05-10T04:22:37.503947+0000","last_became_peered":"2024-05-10T04:22:37.503947+0000","last_unstale":"2024-05-10T04:22:39.068533+0000","last_undegraded":"2024-05-10T04:22:39.068533+0000","last_fullsized":"2024-05-10T04:22:39.068533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:14.343190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496322+0000","last_change":"2024-05-10T04:22:37.519414+0000","last_active":"2024-05-10T04:22:38.496322+0000","last_peered":"2024-05-10T04:22:38.496322+0000","last_clean":"2024-05-10T04:22:38.496322+0000","last_became_active":"2024-05-10T04:22:37.516543+0000","last_became_peered":"2024-05-10T04:22:37.516543+0000","last_unstale":"2024-05-10T04:22:38.496322+0000","last_undegraded":"2024-05-10T04:22:38.496322+0000","last_fullsized":"2024-05-10T04:22:38.496322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:51:34.367433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.069529+0000","last_change":"2024-05-10T04:22:37.514037+0000","last_active":"2024-05-10T04:22:39.069529+0000","last_peered":"2024-05-10T04:22:39.069529+0000","last_clean":"2024-05-10T04:22:39.069529+0000","last_became_active":"2024-05-10T04:22:37.513712+0000","last_became_peered":"2024-05-10T04:22:37.513712+0000","last_unstale":"2024-05-10T04:22:39.069529+0000","last_undegraded":"2024-05-10T04:22:39.069529+0000","last_fullsized":"2024-05-10T04:22:39.069529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:44.231090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068643+0000","last_change":"2024-05-10T04:22:37.506846+0000","last_active":"2024-05-10T04:22:39.068643+0000","last_peered":"2024-05-10T04:22:39.068643+0000","last_clean":"2024-05-10T04:22:39.068643+0000","last_became_active":"2024-05-10T04:22:37.506474+0000","last_became_peered":"2024-05-10T04:22:37.506474+0000","last_unstale":"2024-05-10T04:22:39.068643+0000","last_undegraded":"2024-05-10T04:22:39.068643+0000","last_fullsized":"2024-05-10T04:22:39.068643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:47:50.791426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.496480+0000","last_change":"2024-05-10T04:22:37.521288+0000","last_active":"2024-05-10T04:22:38.496480+0000","last_peered":"2024-05-10T04:22:38.496480+0000","last_clean":"2024-05-10T04:22:38.496480+0000","last_became_active":"2024-05-10T04:22:37.520951+0000","last_became_peered":"2024-05-10T04:22:37.520951+0000","last_unstale":"2024-05-10T04:22:38.496480+0000","last_undegraded":"2024-05-10T04:22:38.496480+0000","last_fullsized":"2024-05-10T04:22:38.496480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:14.343190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.068105+0000","last_change":"2024-05-10T04:22:37.503799+0000","last_active":"2024-05-10T04:22:39.068105+0000","last_peered":"2024-05-10T04:22:39.068105+0000","last_clean":"2024-05-10T04:22:39.068105+0000","last_became_active":"2024-05-10T04:22:37.503081+0000","last_became_peered":"2024-05-10T04:22:37.503081+0000","last_unstale":"2024-05-10T04:22:39.068105+0000","last_undegraded":"2024-05-10T04:22:39.068105+0000","last_fullsized":"2024-05-10T04:22:39.068105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:50:46.925328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.497145+0000","last_change":"2024-05-10T04:22:37.522075+0000","last_active":"2024-05-10T04:22:38.497145+0000","last_peered":"2024-05-10T04:22:38.497145+0000","last_clean":"2024-05-10T04:22:38.497145+0000","last_became_active":"2024-05-10T04:22:37.518004+0000","last_became_peered":"2024-05-10T04:22:37.518004+0000","last_unstale":"2024-05-10T04:22:38.497145+0000","last_undegraded":"2024-05-10T04:22:38.497145+0000","last_fullsized":"2024-05-10T04:22:38.497145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:42.373586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:38.565375+0000","last_change":"2024-05-10T04:22:37.519285+0000","last_active":"2024-05-10T04:22:38.565375+0000","last_peered":"2024-05-10T04:22:38.565375+0000","last_clean":"2024-05-10T04:22:38.565375+0000","last_became_active":"2024-05-10T04:22:37.518230+0000","last_became_peered":"2024-05-10T04:22:37.518230+0000","last_unstale":"2024-05-10T04:22:38.565375+0000","last_undegraded":"2024-05-10T04:22:38.565375+0000","last_fullsized":"2024-05-10T04:22:38.565375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:32:34.172364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:22:39.070158+0000","last_change":"2024-05-10T04:22:37.505032+0000","last_active":"2024-05-10T04:22:39.070158+0000","last_peered":"2024-05-10T04:22:39.070158+0000","last_clean":"2024-05-10T04:22:39.070158+0000","last_became_active":"2024-05-10T04:22:37.504674+0000","last_became_peered":"2024-05-10T04:22:37.504674+0000","last_unstale":"2024-05-10T04:22:39.070158+0000","last_undegraded":"2024-05-10T04:22:39.070158+0000","last_fullsized":"2024-05-10T04:22:39.070158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:36.898270+0000","last_clean_scrub_stamp":"2024-05-10T04:22:36.898270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:51:34.367433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.032}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9430000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:22:49.622 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T04:22:49.622 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-10T04:22:49.622 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-10T04:22:49.622 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T04:22:49.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.916+0000 7f8ac4000700 1 Processor -- start 2024-05-10T04:22:49.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.916+0000 7f8ac4000700 1 -- start start 2024-05-10T04:22:49.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.918+0000 7f8ac4000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8abc0b2f50 0x7f8abc161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:49.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.918+0000 7f8ac4000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8abc0d0d40 0x7f8abc0d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:49.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.918+0000 7f8ac4000700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc0d28c0 con 0x7f8abc0d3030 2024-05-10T04:22:49.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.918+0000 7f8ac4000700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8abc0b3360 con 0x7f8abc0d0d40 2024-05-10T04:22:49.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.918+0000 7f8ac4000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc1624e0 con 0x7f8abc0b2f50 2024-05-10T04:22:49.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.918+0000 7f8ac2000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8abc0d0d40 0x7f8abc0d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:49.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.918+0000 7f8ac2000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8abc0d0d40 0x7f8abc0d3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53184/0 (socket says 172.21.15.80:53184) 2024-05-10T04:22:49.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.918+0000 7f8ac2000700 1 -- 172.21.15.80:0/2525320906 learned_addr learned my addr 172.21.15.80:0/2525320906 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:49.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.918+0000 7f8ac1600700 1 --2- 172.21.15.80:0/2525320906 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8abc0b2f50 0x7f8abc161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:49.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.919+0000 7f8ac2000700 1 -- 172.21.15.80:0/2525320906 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8abc0b2f50 msgr2=0x7f8abc161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:49.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.919+0000 7f8ac2000700 1 --2- 172.21.15.80:0/2525320906 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8abc0b2f50 0x7f8abc161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.919+0000 7f8ac2000700 1 -- 172.21.15.80:0/2525320906 >> v1:172.21.15.106:6789/0 conn(0x7f8abc0d3030 legacy=0x7f8abc0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:49.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.919+0000 7f8ac2000700 1 -- 172.21.15.80:0/2525320906 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc0d2ba0 con 0x7f8abc0d0d40 2024-05-10T04:22:49.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.919+0000 7f8ac2000700 1 --2- 172.21.15.80:0/2525320906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8abc0d0d40 0x7f8abc0d3440 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009e50 tx=0x7f8ab400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ab94fef8db60f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.919+0000 7f8abbe00700 1 -- 172.21.15.80:0/2525320906 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400e070 con 0x7f8abc0d0d40 2024-05-10T04:22:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.919+0000 7f8abbe00700 1 -- 172.21.15.80:0/2525320906 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab400b910 con 0x7f8abc0d0d40 2024-05-10T04:22:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.919+0000 7f8abbe00700 1 -- 172.21.15.80:0/2525320906 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400bcc0 con 0x7f8abc0d0d40 2024-05-10T04:22:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.920+0000 7f8ac4000700 1 -- 172.21.15.80:0/2525320906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8abc0d0d40 msgr2=0x7f8abc0d3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.920+0000 7f8ac4000700 1 --2- 172.21.15.80:0/2525320906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8abc0d0d40 0x7f8abc0d3440 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009e50 tx=0x7f8ab400b330 comp rx=0 tx=0).stop 2024-05-10T04:22:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.920+0000 7f8ac4000700 1 -- 172.21.15.80:0/2525320906 shutdown_connections 2024-05-10T04:22:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.920+0000 7f8ac4000700 1 --2- 172.21.15.80:0/2525320906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8abc0d0d40 0x7f8abc0d3440 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.920+0000 7f8ac4000700 1 --2- 172.21.15.80:0/2525320906 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8abc0b2f50 0x7f8abc161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.920+0000 7f8ac4000700 1 -- 172.21.15.80:0/2525320906 >> 172.21.15.80:0/2525320906 conn(0x7f8abc06c3f0 msgr2=0x7f8abc06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:49.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.920+0000 7f8ac4000700 1 -- 172.21.15.80:0/2525320906 shutdown_connections 2024-05-10T04:22:49.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.920+0000 7f8ac4000700 1 -- 172.21.15.80:0/2525320906 wait complete. 2024-05-10T04:22:49.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.922+0000 7f8ac4000700 1 Processor -- start 2024-05-10T04:22:49.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.923+0000 7f8ac4000700 1 -- start start 2024-05-10T04:22:49.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.924+0000 7f8ac4000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8abc0b2f50 0x7f8abc149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:49.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.924+0000 7f8ac4000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8abc0d0d40 0x7f8abc14a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:49.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.924+0000 7f8ac4000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8abc0d3030 0x7f8abc0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:49.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.924+0000 7f8ac4000700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc14ad00 con 0x7f8abc0d0d40 2024-05-10T04:22:49.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.924+0000 7f8ac4000700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc14cf80 con 0x7f8abc0d3030 2024-05-10T04:22:49.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.924+0000 7f8ac4000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0cdc50 con 0x7f8abc0b2f50 2024-05-10T04:22:49.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.924+0000 7f8ac0c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8abc0d0d40 0x7f8abc14a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:49.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.924+0000 7f8ac0c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8abc0d0d40 0x7f8abc14a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53194/0 (socket says 172.21.15.80:53194) 2024-05-10T04:22:49.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.924+0000 7f8ac0c00700 1 -- 172.21.15.80:0/3295841868 learned_addr learned my addr 172.21.15.80:0/3295841868 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:49.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.924+0000 7f8ac1600700 1 --2- 172.21.15.80:0/3295841868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8abc0b2f50 0x7f8abc149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:49.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.924+0000 7f8ac2000700 1 --2- 172.21.15.80:0/3295841868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8abc0d3030 0x7f8abc0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:49.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.925+0000 7f8ac0c00700 1 -- 172.21.15.80:0/3295841868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8abc0b2f50 msgr2=0x7f8abc149aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:49.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.925+0000 7f8ac0c00700 1 --2- 172.21.15.80:0/3295841868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8abc0b2f50 0x7f8abc149aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.925+0000 7f8ac0c00700 1 -- 172.21.15.80:0/3295841868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8abc0d3030 msgr2=0x7f8abc0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:49.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.925+0000 7f8ac0c00700 1 --2- 172.21.15.80:0/3295841868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8abc0d3030 0x7f8abc0ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:49.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.925+0000 7f8ac0c00700 1 -- 172.21.15.80:0/3295841868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab4009b30 con 0x7f8abc0d0d40 2024-05-10T04:22:49.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.925+0000 7f8ac0c00700 1 --2- 172.21.15.80:0/3295841868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8abc0d0d40 0x7f8abc14a210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800c450 tx=0x7f8aa800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:49.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.925+0000 7f8ab9600700 1 -- 172.21.15.80:0/3295841868 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80052d0 con 0x7f8abc0d0d40 2024-05-10T04:22:49.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.925+0000 7f8ab9600700 1 -- 172.21.15.80:0/3295841868 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa8005430 con 0x7f8abc0d0d40 2024-05-10T04:22:49.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.925+0000 7f8ac4000700 1 -- 172.21.15.80:0/3295841868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc14d1d0 con 0x7f8abc0d0d40 2024-05-10T04:22:49.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.925+0000 7f8ab9600700 1 -- 172.21.15.80:0/3295841868 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80038c0 con 0x7f8abc0d0d40 2024-05-10T04:22:49.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.925+0000 7f8ac4000700 1 -- 172.21.15.80:0/3295841868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc0cd600 con 0x7f8abc0d0d40 2024-05-10T04:22:49.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.926+0000 7f8ac4000700 1 -- 172.21.15.80:0/3295841868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8abc074af0 con 0x7f8abc0d0d40 2024-05-10T04:22:49.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.927+0000 7f8ab9600700 1 -- 172.21.15.80:0/3295841868 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8aa8003a20 con 0x7f8abc0d0d40 2024-05-10T04:22:49.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.928+0000 7f8ab9600700 1 --2- 172.21.15.80:0/3295841868 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8a9c06ac90 0x7f8a9c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:49.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.928+0000 7f8ab9600700 1 -- 172.21.15.80:0/3295841868 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8aa8088690 con 0x7f8abc0d0d40 2024-05-10T04:22:49.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.929+0000 7f8ac1600700 1 --2- 172.21.15.80:0/3295841868 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8a9c06ac90 0x7f8a9c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:49.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.929+0000 7f8ac1600700 1 --2- 172.21.15.80:0/3295841868 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8a9c06ac90 0x7f8a9c06d1a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8abc08d080 tx=0x7f8ab0009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:49.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:49.933+0000 7f8ab9600700 1 -- 172.21.15.80:0/3295841868 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8aa80537d0 con 0x7f8abc0d0d40 2024-05-10T04:22:50.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.184+0000 7f8ac4000700 1 -- 172.21.15.80:0/3295841868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8abc0cdd90 con 0x7f8abc0d0d40 2024-05-10T04:22:50.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.184+0000 7f8ab9600700 1 -- 172.21.15.80:0/3295841868 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8aa8056df0 con 0x7f8abc0d0d40 2024-05-10T04:22:50.186 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:50.186 INFO:teuthology.orchestra.run.smithi080.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-10T04:22:50.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.186+0000 7f8ac4000700 1 -- 172.21.15.80:0/3295841868 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8a9c06ac90 msgr2=0x7f8a9c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:50.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.186+0000 7f8ac4000700 1 --2- 172.21.15.80:0/3295841868 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8a9c06ac90 0x7f8a9c06d1a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8abc08d080 tx=0x7f8ab0009210 comp rx=0 tx=0).stop 2024-05-10T04:22:50.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.186+0000 7f8ac4000700 1 -- 172.21.15.80:0/3295841868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8abc0d0d40 msgr2=0x7f8abc14a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:50.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.186+0000 7f8ac4000700 1 --2- 172.21.15.80:0/3295841868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8abc0d0d40 0x7f8abc14a210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800c450 tx=0x7f8aa800c760 comp rx=0 tx=0).stop 2024-05-10T04:22:50.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.187+0000 7f8ac4000700 1 -- 172.21.15.80:0/3295841868 shutdown_connections 2024-05-10T04:22:50.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.187+0000 7f8ac4000700 1 --2- 172.21.15.80:0/3295841868 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8a9c06ac90 0x7f8a9c06d1a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:50.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.187+0000 7f8ac4000700 1 --2- 172.21.15.80:0/3295841868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8abc0d3030 0x7f8abc0ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:50.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.187+0000 7f8ac4000700 1 --2- 172.21.15.80:0/3295841868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8abc0b2f50 0x7f8abc149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:50.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.187+0000 7f8ac4000700 1 --2- 172.21.15.80:0/3295841868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8abc0d0d40 0x7f8abc14a210 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:50.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.187+0000 7f8ac4000700 1 -- 172.21.15.80:0/3295841868 >> 172.21.15.80:0/3295841868 conn(0x7f8abc06c3f0 msgr2=0x7f8abc06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:50.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.187+0000 7f8ac4000700 1 -- 172.21.15.80:0/3295841868 shutdown_connections 2024-05-10T04:22:50.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.187+0000 7f8ac4000700 1 -- 172.21.15.80:0/3295841868 wait complete. 2024-05-10T04:22:50.215 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-10T04:22:50.216 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:22:50.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.473+0000 7fb10ee00700 1 Processor -- start 2024-05-10T04:22:50.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.473+0000 7fb10ee00700 1 -- start start 2024-05-10T04:22:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.474+0000 7fb10ee00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb1080b2f50 0x7fb108161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.475+0000 7fb10ee00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1080d28c0 con 0x7fb1080d0d40 2024-05-10T04:22:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.475+0000 7fb10ee00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1080d2ba0 con 0x7fb1080d3030 2024-05-10T04:22:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.475+0000 7fb10ee00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1080b3360 con 0x7fb1080b2f50 2024-05-10T04:22:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.475+0000 7fb10ce00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb1080d0d40 0x7fb1080b7320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41570/0 (socket says 172.21.15.80:41570) 2024-05-10T04:22:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.475+0000 7fb10ce00700 1 -- 172.21.15.80:0/2170798594 learned_addr learned my addr 172.21.15.80:0/2170798594 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.475+0000 7fb107e00700 1 --2- 172.21.15.80:0/2170798594 >> v2:172.21.15.106:3300/0 conn(0x7fb1080b2f50 0x7fb108161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.475+0000 7fb107400700 1 -- 172.21.15.80:0/2170798594 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235271658 0 0) 0x7fb1080d28c0 con 0x7fb1080d0d40 2024-05-10T04:22:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.475+0000 7fb107400700 1 -- 172.21.15.80:0/2170798594 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0ec0035b0 con 0x7fb1080d0d40 2024-05-10T04:22:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.475+0000 7fb107400700 1 -- 172.21.15.80:0/2170798594 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206067339 0 0) 0x7fb1080d2ba0 con 0x7fb1080d3030 2024-05-10T04:22:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.475+0000 7fb107400700 1 -- 172.21.15.80:0/2170798594 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1080d28c0 con 0x7fb1080d3030 2024-05-10T04:22:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.475+0000 7fb107400700 1 -- 172.21.15.80:0/2170798594 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 594170223 0 0) 0x7fb0ec0035b0 con 0x7fb1080d0d40 2024-05-10T04:22:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.475+0000 7fb107400700 1 -- 172.21.15.80:0/2170798594 >> v2:172.21.15.106:3300/0 conn(0x7fb1080b2f50 msgr2=0x7fb108161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.475+0000 7fb107400700 1 --2- 172.21.15.80:0/2170798594 >> v2:172.21.15.106:3300/0 conn(0x7fb1080b2f50 0x7fb108161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.475+0000 7fb107400700 1 -- 172.21.15.80:0/2170798594 >> v1:172.21.15.106:6789/0 conn(0x7fb1080d3030 legacy=0x7fb1080d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb107400700 1 -- 172.21.15.80:0/2170798594 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1080cf970 con 0x7fb1080d0d40 2024-05-10T04:22:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb107400700 1 -- 172.21.15.80:0/2170798594 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7fb1000019f0 con 0x7fb1080d0d40 2024-05-10T04:22:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb107400700 1 -- 172.21.15.80:0/2170798594 >> v1:172.21.15.80:6789/0 conn(0x7fb1080d0d40 legacy=0x7fb1080b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb107400700 1 --2- 172.21.15.80:0/2170798594 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0ec003b90 0x7fb0ec003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb107400700 1 --2- 172.21.15.80:0/2170798594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0ec004850 0x7fb0ec004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb107400700 1 --2- 172.21.15.80:0/2170798594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0ec0051f0 0x7fb0ec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb107400700 1 -- 172.21.15.80:0/2170798594 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080b3360 con 0x7fb0ec004850 2024-05-10T04:22:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb107400700 1 -- 172.21.15.80:0/2170798594 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec00c190 con 0x7fb0ec0051f0 2024-05-10T04:22:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb107400700 1 -- 172.21.15.80:0/2170798594 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec00c350 con 0x7fb0ec003b90 2024-05-10T04:22:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb0ffe00700 1 --2- 172.21.15.80:0/2170798594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0ec004850 0x7fb0ec004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb107e00700 1 --2- 172.21.15.80:0/2170798594 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0ec003b90 0x7fb0ec003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb10ce00700 1 --2- 172.21.15.80:0/2170798594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0ec0051f0 0x7fb0ec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb0ffe00700 1 -- 172.21.15.80:0/2170798594 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0ec003b90 msgr2=0x7fb0ec003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb0ffe00700 1 --2- 172.21.15.80:0/2170798594 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0ec003b90 0x7fb0ec003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:50.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb0ffe00700 1 -- 172.21.15.80:0/2170798594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0ec0051f0 msgr2=0x7fb0ec00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:50.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb0ffe00700 1 --2- 172.21.15.80:0/2170798594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0ec0051f0 0x7fb0ec00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:50.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb0ffe00700 1 -- 172.21.15.80:0/2170798594 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec0035b0 con 0x7fb0ec004850 2024-05-10T04:22:50.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.476+0000 7fb10ce00700 1 -- 172.21.15.80:0/2170798594 reap_dead start 2024-05-10T04:22:50.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.477+0000 7fb0ffe00700 1 --2- 172.21.15.80:0/2170798594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0ec004850 0x7fb0ec004c60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0047d0 tx=0x7fb0ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84e1d02df7049d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:50.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.477+0000 7fb107400700 1 -- 172.21.15.80:0/2170798594 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0006a60 con 0x7fb0ec004850 2024-05-10T04:22:50.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.477+0000 7fb107400700 1 -- 172.21.15.80:0/2170798594 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f0006be0 con 0x7fb0ec004850 2024-05-10T04:22:50.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.477+0000 7fb107400700 1 -- 172.21.15.80:0/2170798594 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0001d40 con 0x7fb0ec004850 2024-05-10T04:22:50.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.477+0000 7fb10ee00700 1 -- 172.21.15.80:0/2170798594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0ec004850 msgr2=0x7fb0ec004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:50.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.477+0000 7fb10ee00700 1 --2- 172.21.15.80:0/2170798594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0ec004850 0x7fb0ec004c60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0047d0 tx=0x7fb0ec005880 comp rx=0 tx=0).stop 2024-05-10T04:22:50.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.478+0000 7fb10ee00700 1 -- 172.21.15.80:0/2170798594 shutdown_connections 2024-05-10T04:22:50.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.478+0000 7fb10ee00700 1 --2- 172.21.15.80:0/2170798594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0ec004850 0x7fb0ec004c60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:50.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.478+0000 7fb10ee00700 1 -- 172.21.15.80:0/2170798594 >> 172.21.15.80:0/2170798594 conn(0x7fb10806c3f0 msgr2=0x7fb10806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:50.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.478+0000 7fb10ee00700 1 -- 172.21.15.80:0/2170798594 shutdown_connections 2024-05-10T04:22:50.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.478+0000 7fb10ee00700 1 -- 172.21.15.80:0/2170798594 wait complete. 2024-05-10T04:22:50.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.480+0000 7fb10ee00700 1 Processor -- start 2024-05-10T04:22:50.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.480+0000 7fb10ee00700 1 -- start start 2024-05-10T04:22:50.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.482+0000 7fb10ee00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0ec004850 0x7fb1081582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:50.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.482+0000 7fb10ee00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1081e8860 0x7fb1081e8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:50.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.482+0000 7fb10ee00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1080c8250 0x7fb1080c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:50.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.482+0000 7fb10ee00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080c9590 con 0x7fb1081e8860 2024-05-10T04:22:50.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.482+0000 7fb10ee00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1081e9390 con 0x7fb0ec004850 2024-05-10T04:22:50.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.482+0000 7fb10ee00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1081e9e80 con 0x7fb1080c8250 2024-05-10T04:22:50.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.482+0000 7fb0ffe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1081e8860 0x7fb1081e8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:50.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.482+0000 7fb0ffe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1081e8860 0x7fb1081e8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53218/0 (socket says 172.21.15.80:53218) 2024-05-10T04:22:50.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.482+0000 7fb0ffe00700 1 -- 172.21.15.80:0/3186526233 learned_addr learned my addr 172.21.15.80:0/3186526233 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:50.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.482+0000 7fb107e00700 1 --2- 172.21.15.80:0/3186526233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0ec004850 0x7fb1081582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:50.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.482+0000 7fb10ce00700 1 --2- 172.21.15.80:0/3186526233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1080c8250 0x7fb1080c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:50.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.482+0000 7fb0ffe00700 1 -- 172.21.15.80:0/3186526233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1080c8250 msgr2=0x7fb1080c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:50.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.482+0000 7fb0ffe00700 1 --2- 172.21.15.80:0/3186526233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1080c8250 0x7fb1080c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:50.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.482+0000 7fb0ffe00700 1 -- 172.21.15.80:0/3186526233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0ec004850 msgr2=0x7fb1081582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:50.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.482+0000 7fb0ffe00700 1 --2- 172.21.15.80:0/3186526233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0ec004850 0x7fb1081582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:50.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.482+0000 7fb0ffe00700 1 -- 172.21.15.80:0/3186526233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1080c7dc0 con 0x7fb1081e8860 2024-05-10T04:22:50.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.482+0000 7fb107e00700 1 --2- 172.21.15.80:0/3186526233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0ec004850 0x7fb1081582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:50.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.483+0000 7fb0ffe00700 1 --2- 172.21.15.80:0/3186526233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1081e8860 0x7fb1081e8c70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec00c160 tx=0x7fb0f00012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:50.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.483+0000 7fb104c00700 1 -- 172.21.15.80:0/3186526233 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f00054d0 con 0x7fb1081e8860 2024-05-10T04:22:50.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.483+0000 7fb104c00700 1 -- 172.21.15.80:0/3186526233 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f0001d40 con 0x7fb1081e8860 2024-05-10T04:22:50.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.483+0000 7fb10ee00700 1 -- 172.21.15.80:0/3186526233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1081e95e0 con 0x7fb1081e8860 2024-05-10T04:22:50.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.483+0000 7fb104c00700 1 -- 172.21.15.80:0/3186526233 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0007230 con 0x7fb1081e8860 2024-05-10T04:22:50.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.483+0000 7fb10ee00700 1 -- 172.21.15.80:0/3186526233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1081e9ba0 con 0x7fb1081e8860 2024-05-10T04:22:50.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.484+0000 7fb10ee00700 1 -- 172.21.15.80:0/3186526233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1080c7f50 con 0x7fb1081e8860 2024-05-10T04:22:50.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.485+0000 7fb104c00700 1 -- 172.21.15.80:0/3186526233 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb0f0007390 con 0x7fb1081e8860 2024-05-10T04:22:50.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.486+0000 7fb104c00700 1 --2- 172.21.15.80:0/3186526233 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb0e406ac90 0x7fb0e406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:50.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.486+0000 7fb104c00700 1 -- 172.21.15.80:0/3186526233 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0f0089ee0 con 0x7fb1081e8860 2024-05-10T04:22:50.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.487+0000 7fb107e00700 1 --2- 172.21.15.80:0/3186526233 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb0e406ac90 0x7fb0e406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:50.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.487+0000 7fb107e00700 1 --2- 172.21.15.80:0/3186526233 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb0e406ac90 0x7fb0e406d1a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009160 tx=0x7fb0f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:50.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.491+0000 7fb104c00700 1 -- 172.21.15.80:0/3186526233 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb0f00550b0 con 0x7fb1081e8860 2024-05-10T04:22:50.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.695+0000 7fb10ee00700 1 -- 172.21.15.80:0/3186526233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1080c9590 con 0x7fb1081e8860 2024-05-10T04:22:50.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.697+0000 7fb104c00700 1 -- 172.21.15.80:0/3186526233 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fb0f00586d0 con 0x7fb1081e8860 2024-05-10T04:22:50.698 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:50.698 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:38.485422+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:22:50.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.699+0000 7fb10ee00700 1 -- 172.21.15.80:0/3186526233 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb0e406ac90 msgr2=0x7fb0e406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:50.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.699+0000 7fb10ee00700 1 --2- 172.21.15.80:0/3186526233 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb0e406ac90 0x7fb0e406d1a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009160 tx=0x7fb0f8008040 comp rx=0 tx=0).stop 2024-05-10T04:22:50.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.699+0000 7fb10ee00700 1 -- 172.21.15.80:0/3186526233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1081e8860 msgr2=0x7fb1081e8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:50.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.699+0000 7fb10ee00700 1 --2- 172.21.15.80:0/3186526233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1081e8860 0x7fb1081e8c70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec00c160 tx=0x7fb0f00012d0 comp rx=0 tx=0).stop 2024-05-10T04:22:50.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.699+0000 7fb10ee00700 1 -- 172.21.15.80:0/3186526233 shutdown_connections 2024-05-10T04:22:50.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.699+0000 7fb10ee00700 1 --2- 172.21.15.80:0/3186526233 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb0e406ac90 0x7fb0e406d1a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:50.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.699+0000 7fb10ee00700 1 --2- 172.21.15.80:0/3186526233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1080c8250 0x7fb1080c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:50.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.699+0000 7fb10ee00700 1 --2- 172.21.15.80:0/3186526233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0ec004850 0x7fb1081582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:50.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.699+0000 7fb10ee00700 1 --2- 172.21.15.80:0/3186526233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1081e8860 0x7fb1081e8c70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:50.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.700+0000 7fb10ee00700 1 -- 172.21.15.80:0/3186526233 >> 172.21.15.80:0/3186526233 conn(0x7fb10806c3f0 msgr2=0x7fb1080cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:50.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.700+0000 7fb10ee00700 1 -- 172.21.15.80:0/3186526233 shutdown_connections 2024-05-10T04:22:50.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.700+0000 7fb10ee00700 1 -- 172.21.15.80:0/3186526233 wait complete. 2024-05-10T04:22:50.728 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:22:26.793377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:22:35.751764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:22:36.465587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:22:50.729 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:22:50.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.992+0000 7fe8e7c00700 1 Processor -- start 2024-05-10T04:22:50.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.993+0000 7fe8e7c00700 1 -- start start 2024-05-10T04:22:50.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.994+0000 7fe8e7c00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe8e0162150 0x7fe8e015e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:50.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.995+0000 7fe8e7c00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e00d2c00 con 0x7fe8e006c160 2024-05-10T04:22:50.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.995+0000 7fe8e7c00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e0162630 con 0x7fe8e00cf4d0 2024-05-10T04:22:50.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.995+0000 7fe8e7c00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e0162910 con 0x7fe8e0162150 2024-05-10T04:22:50.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.995+0000 7fe8e5c00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe8e006c160 0x7fe8e006c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41580/0 (socket says 172.21.15.80:41580) 2024-05-10T04:22:50.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.995+0000 7fe8e5c00700 1 -- 172.21.15.80:0/3568469091 learned_addr learned my addr 172.21.15.80:0/3568469091 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:50.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.995+0000 7fe8e5200700 1 --2- 172.21.15.80:0/3568469091 >> v2:172.21.15.106:3300/0 conn(0x7fe8e0162150 0x7fe8e015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:50.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.995+0000 7fe8df400700 1 -- 172.21.15.80:0/3568469091 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136807319 0 0) 0x7fe8e00d2c00 con 0x7fe8e006c160 2024-05-10T04:22:50.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.995+0000 7fe8df400700 1 -- 172.21.15.80:0/3568469091 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8c80035b0 con 0x7fe8e006c160 2024-05-10T04:22:50.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.995+0000 7fe8e5200700 1 -- 172.21.15.80:0/3568469091 >> v1:172.21.15.106:6789/0 conn(0x7fe8e00cf4d0 legacy=0x7fe8e00b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:50.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.995+0000 7fe8e5200700 1 -- 172.21.15.80:0/3568469091 >> v1:172.21.15.80:6789/0 conn(0x7fe8e006c160 legacy=0x7fe8e006c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:50.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.995+0000 7fe8e5200700 1 -- 172.21.15.80:0/3568469091 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e0162bf0 con 0x7fe8e0162150 2024-05-10T04:22:50.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.996+0000 7fe8e5200700 1 --2- 172.21.15.80:0/3568469091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8e0162150 0x7fe8e015e610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009870 tx=0x7fe8d4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb7557255b86c287 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:50.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.996+0000 7fe8df400700 1 -- 172.21.15.80:0/3568469091 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4011830 con 0x7fe8e0162150 2024-05-10T04:22:50.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.996+0000 7fe8df400700 1 -- 172.21.15.80:0/3568469091 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d4011990 con 0x7fe8e0162150 2024-05-10T04:22:50.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.996+0000 7fe8df400700 1 -- 172.21.15.80:0/3568469091 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4011d00 con 0x7fe8e0162150 2024-05-10T04:22:50.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.997+0000 7fe8e7c00700 1 -- 172.21.15.80:0/3568469091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8e0162150 msgr2=0x7fe8e015e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:50.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.997+0000 7fe8e7c00700 1 --2- 172.21.15.80:0/3568469091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8e0162150 0x7fe8e015e610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009870 tx=0x7fe8d4009b80 comp rx=0 tx=0).stop 2024-05-10T04:22:50.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.997+0000 7fe8e7c00700 1 -- 172.21.15.80:0/3568469091 shutdown_connections 2024-05-10T04:22:50.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.997+0000 7fe8e7c00700 1 --2- 172.21.15.80:0/3568469091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8e0162150 0x7fe8e015e610 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:50.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.997+0000 7fe8e7c00700 1 -- 172.21.15.80:0/3568469091 >> 172.21.15.80:0/3568469091 conn(0x7fe8e00d3e10 msgr2=0x7fe8e00d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:50.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.997+0000 7fe8e7c00700 1 -- 172.21.15.80:0/3568469091 shutdown_connections 2024-05-10T04:22:50.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.997+0000 7fe8e7c00700 1 -- 172.21.15.80:0/3568469091 wait complete. 2024-05-10T04:22:51.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:50.999+0000 7fe8e7c00700 1 Processor -- start 2024-05-10T04:22:51.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.000+0000 7fe8e7c00700 1 -- start start 2024-05-10T04:22:51.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.001+0000 7fe8e7c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8e006c160 0x7fe8e00c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:51.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.001+0000 7fe8e7c00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8e00cf4d0 0x7fe8e01f8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:51.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.001+0000 7fe8e7c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8e0162150 0x7fe8e01601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:51.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.001+0000 7fe8e7c00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e01f6c90 con 0x7fe8e006c160 2024-05-10T04:22:51.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.001+0000 7fe8e7c00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e01f8cf0 con 0x7fe8e00cf4d0 2024-05-10T04:22:51.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.001+0000 7fe8e7c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e01f4c20 con 0x7fe8e0162150 2024-05-10T04:22:51.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.001+0000 7fe8e5200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8e006c160 0x7fe8e00c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:51.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.001+0000 7fe8e5200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8e006c160 0x7fe8e00c6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53230/0 (socket says 172.21.15.80:53230) 2024-05-10T04:22:51.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.001+0000 7fe8e5200700 1 -- 172.21.15.80:0/2107232037 learned_addr learned my addr 172.21.15.80:0/2107232037 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:51.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.001+0000 7fe8e5c00700 1 --2- 172.21.15.80:0/2107232037 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8e0162150 0x7fe8e01601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:51.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.002+0000 7fe8dfe00700 1 --2- 172.21.15.80:0/2107232037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8e00cf4d0 0x7fe8e01f8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:51.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.002+0000 7fe8e5200700 1 -- 172.21.15.80:0/2107232037 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8e0162150 msgr2=0x7fe8e01601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:51.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.002+0000 7fe8e5200700 1 --2- 172.21.15.80:0/2107232037 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8e0162150 0x7fe8e01601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:51.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.002+0000 7fe8e5200700 1 -- 172.21.15.80:0/2107232037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8e00cf4d0 msgr2=0x7fe8e01f8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:51.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.002+0000 7fe8e5200700 1 --2- 172.21.15.80:0/2107232037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8e00cf4d0 0x7fe8e01f8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:51.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.002+0000 7fe8e5200700 1 -- 172.21.15.80:0/2107232037 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d40094a0 con 0x7fe8e006c160 2024-05-10T04:22:51.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.002+0000 7fe8e5c00700 1 --2- 172.21.15.80:0/2107232037 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8e0162150 0x7fe8e01601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:51.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.002+0000 7fe8e5200700 1 --2- 172.21.15.80:0/2107232037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8e006c160 0x7fe8e00c6630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4000c00 tx=0x7fe8d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:51.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.002+0000 7fe8dcc00700 1 -- 172.21.15.80:0/2107232037 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d401aa90 con 0x7fe8e006c160 2024-05-10T04:22:51.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.002+0000 7fe8dcc00700 1 -- 172.21.15.80:0/2107232037 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d401ac10 con 0x7fe8e006c160 2024-05-10T04:22:51.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.002+0000 7fe8e7c00700 1 -- 172.21.15.80:0/2107232037 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e01f8f40 con 0x7fe8e006c160 2024-05-10T04:22:51.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.002+0000 7fe8dcc00700 1 -- 172.21.15.80:0/2107232037 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d40243f0 con 0x7fe8e006c160 2024-05-10T04:22:51.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.002+0000 7fe8e7c00700 1 -- 172.21.15.80:0/2107232037 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e01f5130 con 0x7fe8e006c160 2024-05-10T04:22:51.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.003+0000 7fe8e7c00700 1 -- 172.21.15.80:0/2107232037 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e01f5780 con 0x7fe8e006c160 2024-05-10T04:22:51.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.004+0000 7fe8dcc00700 1 -- 172.21.15.80:0/2107232037 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe8d402d450 con 0x7fe8e006c160 2024-05-10T04:22:51.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.005+0000 7fe8dcc00700 1 --2- 172.21.15.80:0/2107232037 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe8c006acc0 0x7fe8c006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:51.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.005+0000 7fe8dcc00700 1 -- 172.21.15.80:0/2107232037 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8d408a6d0 con 0x7fe8e006c160 2024-05-10T04:22:51.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.005+0000 7fe8dfe00700 1 --2- 172.21.15.80:0/2107232037 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe8c006acc0 0x7fe8c006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:51.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.006+0000 7fe8dfe00700 1 --2- 172.21.15.80:0/2107232037 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe8c006acc0 0x7fe8c006d1d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00743a0 tx=0x7fe8cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:51.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.010+0000 7fe8dcc00700 1 -- 172.21.15.80:0/2107232037 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe8d4055940 con 0x7fe8e006c160 2024-05-10T04:22:51.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.217+0000 7fe8e7c00700 1 -- 172.21.15.80:0/2107232037 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8e0074af0 con 0x7fe8e006c160 2024-05-10T04:22:51.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.217+0000 7fe8dcc00700 1 -- 172.21.15.80:0/2107232037 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8d40150a0 con 0x7fe8e006c160 2024-05-10T04:22:51.218 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-10T04:22:51.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.220+0000 7fe8e7c00700 1 -- 172.21.15.80:0/2107232037 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe8c006acc0 msgr2=0x7fe8c006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:51.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.220+0000 7fe8e7c00700 1 --2- 172.21.15.80:0/2107232037 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe8c006acc0 0x7fe8c006d1d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00743a0 tx=0x7fe8cc009040 comp rx=0 tx=0).stop 2024-05-10T04:22:51.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.220+0000 7fe8e7c00700 1 -- 172.21.15.80:0/2107232037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8e006c160 msgr2=0x7fe8e00c6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:51.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.220+0000 7fe8e7c00700 1 --2- 172.21.15.80:0/2107232037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8e006c160 0x7fe8e00c6630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4000c00 tx=0x7fe8d4004750 comp rx=0 tx=0).stop 2024-05-10T04:22:51.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.220+0000 7fe8e7c00700 1 -- 172.21.15.80:0/2107232037 shutdown_connections 2024-05-10T04:22:51.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.220+0000 7fe8e7c00700 1 --2- 172.21.15.80:0/2107232037 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe8c006acc0 0x7fe8c006d1d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:51.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.220+0000 7fe8e7c00700 1 --2- 172.21.15.80:0/2107232037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8e006c160 0x7fe8e00c6630 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:51.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.220+0000 7fe8e7c00700 1 --2- 172.21.15.80:0/2107232037 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8e0162150 0x7fe8e01601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:51.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.220+0000 7fe8e7c00700 1 --2- 172.21.15.80:0/2107232037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8e00cf4d0 0x7fe8e01f8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:51.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.220+0000 7fe8e7c00700 1 -- 172.21.15.80:0/2107232037 >> 172.21.15.80:0/2107232037 conn(0x7fe8e00d3e10 msgr2=0x7fe8e015a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:51.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.220+0000 7fe8e7c00700 1 -- 172.21.15.80:0/2107232037 shutdown_connections 2024-05-10T04:22:51.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.220+0000 7fe8e7c00700 1 -- 172.21.15.80:0/2107232037 wait complete. 2024-05-10T04:22:51.246 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:22:51.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.508+0000 7fc07d000700 1 Processor -- start 2024-05-10T04:22:51.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.509+0000 7fc07d000700 1 -- start start 2024-05-10T04:22:51.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.510+0000 7fc07d000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0780d3510 0x7fc0780b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:51.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.510+0000 7fc07d000700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc0780d0ce0 0x7fc0780cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:51.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.510+0000 7fc07d000700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0780d27e0 con 0x7fc0780ceb90 2024-05-10T04:22:51.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.510+0000 7fc07d000700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0780cf4e0 con 0x7fc0780d3510 2024-05-10T04:22:51.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.510+0000 7fc07d000700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0780b82c0 con 0x7fc0780d0ce0 2024-05-10T04:22:51.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.511+0000 7fc075e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0780d3510 0x7fc0780b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:51.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.511+0000 7fc06fe00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc0780ceb90 0x7fc0780d05d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41584/0 (socket says 172.21.15.80:41584) 2024-05-10T04:22:51.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.511+0000 7fc06fe00700 1 -- 172.21.15.80:0/2616402333 learned_addr learned my addr 172.21.15.80:0/2616402333 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:51.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.511+0000 7fc076800700 1 --2- 172.21.15.80:0/2616402333 >> v2:172.21.15.106:3300/0 conn(0x7fc0780d0ce0 0x7fc0780cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:51.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.511+0000 7fc075400700 1 -- 172.21.15.80:0/2616402333 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591372713 0 0) 0x7fc0780d27e0 con 0x7fc0780ceb90 2024-05-10T04:22:51.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.511+0000 7fc075400700 1 -- 172.21.15.80:0/2616402333 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc05c0035b0 con 0x7fc0780ceb90 2024-05-10T04:22:51.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.511+0000 7fc075e00700 1 -- 172.21.15.80:0/2616402333 >> v2:172.21.15.106:3300/0 conn(0x7fc0780d0ce0 msgr2=0x7fc0780cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:51.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.511+0000 7fc075e00700 1 --2- 172.21.15.80:0/2616402333 >> v2:172.21.15.106:3300/0 conn(0x7fc0780d0ce0 0x7fc0780cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:51.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.511+0000 7fc075e00700 1 -- 172.21.15.80:0/2616402333 >> v1:172.21.15.80:6789/0 conn(0x7fc0780ceb90 legacy=0x7fc0780d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:51.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.511+0000 7fc075e00700 1 -- 172.21.15.80:0/2616402333 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0780d3080 con 0x7fc0780d3510 2024-05-10T04:22:51.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.511+0000 7fc075e00700 1 --2- 172.21.15.80:0/2616402333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0780d3510 0x7fc0780b31e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc0780b7080 tx=0x7fc068009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed70f77af14f403f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:51.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.512+0000 7fc075400700 1 -- 172.21.15.80:0/2616402333 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc068011830 con 0x7fc0780d3510 2024-05-10T04:22:51.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.512+0000 7fc075400700 1 -- 172.21.15.80:0/2616402333 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc068011990 con 0x7fc0780d3510 2024-05-10T04:22:51.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.512+0000 7fc075400700 1 -- 172.21.15.80:0/2616402333 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc068011d20 con 0x7fc0780d3510 2024-05-10T04:22:51.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.512+0000 7fc07d000700 1 -- 172.21.15.80:0/2616402333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0780d3510 msgr2=0x7fc0780b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:51.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.512+0000 7fc07d000700 1 --2- 172.21.15.80:0/2616402333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0780d3510 0x7fc0780b31e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc0780b7080 tx=0x7fc068009b20 comp rx=0 tx=0).stop 2024-05-10T04:22:51.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.512+0000 7fc07d000700 1 -- 172.21.15.80:0/2616402333 shutdown_connections 2024-05-10T04:22:51.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.512+0000 7fc07d000700 1 --2- 172.21.15.80:0/2616402333 >> v2:172.21.15.106:3300/0 conn(0x7fc0780d0ce0 0x7fc0780cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:51.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.512+0000 7fc07d000700 1 --2- 172.21.15.80:0/2616402333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0780d3510 0x7fc0780b31e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:51.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.512+0000 7fc07d000700 1 -- 172.21.15.80:0/2616402333 >> 172.21.15.80:0/2616402333 conn(0x7fc07806c4b0 msgr2=0x7fc07806c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:51.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.513+0000 7fc07d000700 1 -- 172.21.15.80:0/2616402333 shutdown_connections 2024-05-10T04:22:51.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.513+0000 7fc07d000700 1 -- 172.21.15.80:0/2616402333 wait complete. 2024-05-10T04:22:51.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.515+0000 7fc07d000700 1 Processor -- start 2024-05-10T04:22:51.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.515+0000 7fc07d000700 1 -- start start 2024-05-10T04:22:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.516+0000 7fc07d000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0780ceb90 0x7fc0781f4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.516+0000 7fc07d000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0780d0ce0 0x7fc078159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.516+0000 7fc07d000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0780d3510 0x7fc0780b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.516+0000 7fc07d000700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0780b4b10 con 0x7fc0780d3510 2024-05-10T04:22:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.516+0000 7fc07d000700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc078153b20 con 0x7fc0780ceb90 2024-05-10T04:22:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.516+0000 7fc07d000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc078153d70 con 0x7fc0780d0ce0 2024-05-10T04:22:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.517+0000 7fc076800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0780d3510 0x7fc0780b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.517+0000 7fc076800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0780d3510 0x7fc0780b5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53246/0 (socket says 172.21.15.80:53246) 2024-05-10T04:22:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.517+0000 7fc076800700 1 -- 172.21.15.80:0/3856623644 learned_addr learned my addr 172.21.15.80:0/3856623644 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.517+0000 7fc06fe00700 1 --2- 172.21.15.80:0/3856623644 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0780d0ce0 0x7fc078159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.517+0000 7fc075e00700 1 --2- 172.21.15.80:0/3856623644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0780ceb90 0x7fc0781f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.517+0000 7fc076800700 1 -- 172.21.15.80:0/3856623644 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0780d0ce0 msgr2=0x7fc078159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.517+0000 7fc076800700 1 --2- 172.21.15.80:0/3856623644 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0780d0ce0 0x7fc078159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.517+0000 7fc076800700 1 -- 172.21.15.80:0/3856623644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0780ceb90 msgr2=0x7fc0781f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.517+0000 7fc076800700 1 --2- 172.21.15.80:0/3856623644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0780ceb90 0x7fc0781f4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.517+0000 7fc076800700 1 -- 172.21.15.80:0/3856623644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0680094a0 con 0x7fc0780d3510 2024-05-10T04:22:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.517+0000 7fc076800700 1 --2- 172.21.15.80:0/3856623644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0780d3510 0x7fc0780b5be0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc07000efc0 tx=0x7fc070009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:51.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.517+0000 7fc06e000700 1 -- 172.21.15.80:0/3856623644 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070009b20 con 0x7fc0780d3510 2024-05-10T04:22:51.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.518+0000 7fc06e000700 1 -- 172.21.15.80:0/3856623644 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07000f040 con 0x7fc0780d3510 2024-05-10T04:22:51.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.518+0000 7fc06e000700 1 -- 172.21.15.80:0/3856623644 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07000cc90 con 0x7fc0780d3510 2024-05-10T04:22:51.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.518+0000 7fc07d000700 1 -- 172.21.15.80:0/3856623644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc078154050 con 0x7fc0780d3510 2024-05-10T04:22:51.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.518+0000 7fc07d000700 1 -- 172.21.15.80:0/3856623644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc078154610 con 0x7fc0780d3510 2024-05-10T04:22:51.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.519+0000 7fc07d000700 1 -- 172.21.15.80:0/3856623644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0781f5030 con 0x7fc0780d3510 2024-05-10T04:22:51.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.520+0000 7fc06e000700 1 -- 172.21.15.80:0/3856623644 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc070014480 con 0x7fc0780d3510 2024-05-10T04:22:51.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.521+0000 7fc06e000700 1 --2- 172.21.15.80:0/3856623644 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc05406ac90 0x7fc05406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:51.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.521+0000 7fc06e000700 1 -- 172.21.15.80:0/3856623644 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc070089ee0 con 0x7fc0780d3510 2024-05-10T04:22:51.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.521+0000 7fc075e00700 1 --2- 172.21.15.80:0/3856623644 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc05406ac90 0x7fc05406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.522+0000 7fc075e00700 1 --2- 172.21.15.80:0/3856623644 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc05406ac90 0x7fc05406d1a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc0780b7080 tx=0x7fc068008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:51.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.526+0000 7fc06e000700 1 -- 172.21.15.80:0/3856623644 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc070054f90 con 0x7fc0780d3510 2024-05-10T04:22:51.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.731+0000 7fc07d000700 1 -- 172.21.15.80:0/3856623644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc078074af0 con 0x7fc0780d3510 2024-05-10T04:22:51.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.731+0000 7fc06e000700 1 -- 172.21.15.80:0/3856623644 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc070018020 con 0x7fc0780d3510 2024-05-10T04:22:51.732 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-10T04:22:51.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.734+0000 7fc07d000700 1 -- 172.21.15.80:0/3856623644 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc05406ac90 msgr2=0x7fc05406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:51.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.734+0000 7fc07d000700 1 --2- 172.21.15.80:0/3856623644 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc05406ac90 0x7fc05406d1a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc0780b7080 tx=0x7fc068008030 comp rx=0 tx=0).stop 2024-05-10T04:22:51.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.734+0000 7fc07d000700 1 -- 172.21.15.80:0/3856623644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0780d3510 msgr2=0x7fc0780b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:51.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.734+0000 7fc07d000700 1 --2- 172.21.15.80:0/3856623644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0780d3510 0x7fc0780b5be0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc07000efc0 tx=0x7fc070009f60 comp rx=0 tx=0).stop 2024-05-10T04:22:51.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.734+0000 7fc07d000700 1 -- 172.21.15.80:0/3856623644 shutdown_connections 2024-05-10T04:22:51.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.734+0000 7fc07d000700 1 --2- 172.21.15.80:0/3856623644 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc05406ac90 0x7fc05406d1a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:51.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.734+0000 7fc07d000700 1 --2- 172.21.15.80:0/3856623644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0780d3510 0x7fc0780b5be0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:51.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.734+0000 7fc07d000700 1 --2- 172.21.15.80:0/3856623644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0780ceb90 0x7fc0781f4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:51.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.734+0000 7fc07d000700 1 --2- 172.21.15.80:0/3856623644 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0780d0ce0 0x7fc078159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:51.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.734+0000 7fc07d000700 1 -- 172.21.15.80:0/3856623644 >> 172.21.15.80:0/3856623644 conn(0x7fc07806c4b0 msgr2=0x7fc0780cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:51.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.734+0000 7fc07d000700 1 -- 172.21.15.80:0/3856623644 shutdown_connections 2024-05-10T04:22:51.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:51.734+0000 7fc07d000700 1 -- 172.21.15.80:0/3856623644 wait complete. 2024-05-10T04:22:51.760 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:22:52.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.023+0000 7f54e2e00700 1 Processor -- start 2024-05-10T04:22:52.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.023+0000 7f54e2e00700 1 -- start start 2024-05-10T04:22:52.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.025+0000 7f54e2e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f54dc162150 0x7f54dc15e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:52.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.025+0000 7f54e2e00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f54dc0cf4d0 0x7f54dc0b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:52.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.025+0000 7f54e2e00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54dc0d2c00 con 0x7f54dc0b7910 2024-05-10T04:22:52.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.025+0000 7f54e2e00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54dc162630 con 0x7f54dc162150 2024-05-10T04:22:52.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.025+0000 7f54e2e00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54dc162910 con 0x7f54dc0cf4d0 2024-05-10T04:22:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.025+0000 7f54e0e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f54dc0b7910 0x7f54dc06c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41588/0 (socket says 172.21.15.80:41588) 2024-05-10T04:22:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.025+0000 7f54e0e00700 1 -- 172.21.15.80:0/285648456 learned_addr learned my addr 172.21.15.80:0/285648456 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.025+0000 7f54dbe00700 1 --2- 172.21.15.80:0/285648456 >> v2:172.21.15.80:3300/0 conn(0x7f54dc162150 0x7f54dc15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.025+0000 7f54d3e00700 1 --2- 172.21.15.80:0/285648456 >> v2:172.21.15.106:3300/0 conn(0x7f54dc0cf4d0 0x7f54dc0b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.026+0000 7f54db400700 1 -- 172.21.15.80:0/285648456 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793874445 0 0) 0x7f54dc0d2c00 con 0x7f54dc0b7910 2024-05-10T04:22:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.026+0000 7f54db400700 1 -- 172.21.15.80:0/285648456 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54c00035b0 con 0x7f54dc0b7910 2024-05-10T04:22:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.026+0000 7f54dbe00700 1 -- 172.21.15.80:0/285648456 >> v2:172.21.15.106:3300/0 conn(0x7f54dc0cf4d0 msgr2=0x7f54dc0b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.026+0000 7f54dbe00700 1 --2- 172.21.15.80:0/285648456 >> v2:172.21.15.106:3300/0 conn(0x7f54dc0cf4d0 0x7f54dc0b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.026+0000 7f54dbe00700 1 -- 172.21.15.80:0/285648456 >> v1:172.21.15.80:6789/0 conn(0x7f54dc0b7910 legacy=0x7f54dc06c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.026+0000 7f54dbe00700 1 -- 172.21.15.80:0/285648456 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc162bf0 con 0x7f54dc162150 2024-05-10T04:22:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.026+0000 7f54dbe00700 1 --2- 172.21.15.80:0/285648456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54dc162150 0x7f54dc15e610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009840 tx=0x7f54cc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3dd50041e1f60a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.026+0000 7f54db400700 1 -- 172.21.15.80:0/285648456 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc011830 con 0x7f54dc162150 2024-05-10T04:22:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.026+0000 7f54db400700 1 -- 172.21.15.80:0/285648456 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc011990 con 0x7f54dc162150 2024-05-10T04:22:52.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.026+0000 7f54db400700 1 -- 172.21.15.80:0/285648456 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc011d20 con 0x7f54dc162150 2024-05-10T04:22:52.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.027+0000 7f54e2e00700 1 -- 172.21.15.80:0/285648456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54dc162150 msgr2=0x7f54dc15e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:52.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.027+0000 7f54e2e00700 1 --2- 172.21.15.80:0/285648456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54dc162150 0x7f54dc15e610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009840 tx=0x7f54cc009b50 comp rx=0 tx=0).stop 2024-05-10T04:22:52.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.027+0000 7f54e2e00700 1 -- 172.21.15.80:0/285648456 shutdown_connections 2024-05-10T04:22:52.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.027+0000 7f54e2e00700 1 --2- 172.21.15.80:0/285648456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54dc162150 0x7f54dc15e610 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.027+0000 7f54e2e00700 1 --2- 172.21.15.80:0/285648456 >> v2:172.21.15.106:3300/0 conn(0x7f54dc0cf4d0 0x7f54dc0b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.027+0000 7f54e2e00700 1 -- 172.21.15.80:0/285648456 >> 172.21.15.80:0/285648456 conn(0x7f54dc0d3e10 msgr2=0x7f54dc0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:52.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.027+0000 7f54e2e00700 1 -- 172.21.15.80:0/285648456 shutdown_connections 2024-05-10T04:22:52.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.027+0000 7f54e2e00700 1 -- 172.21.15.80:0/285648456 wait complete. 2024-05-10T04:22:52.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.029+0000 7f54e2e00700 1 Processor -- start 2024-05-10T04:22:52.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.029+0000 7f54e2e00700 1 -- start start 2024-05-10T04:22:52.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.031+0000 7f54e2e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54dc0b7910 0x7f54dc1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:52.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.031+0000 7f54e2e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54dc0cf4d0 0x7f54dc153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:52.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.031+0000 7f54e2e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54dc162150 0x7f54dc1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:52.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.031+0000 7f54e2e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc1544b0 con 0x7f54dc0cf4d0 2024-05-10T04:22:52.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.031+0000 7f54e2e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc15f620 con 0x7f54dc162150 2024-05-10T04:22:52.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.031+0000 7f54e2e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc15f860 con 0x7f54dc0b7910 2024-05-10T04:22:52.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.031+0000 7f54d3e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54dc0cf4d0 0x7f54dc153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:52.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.031+0000 7f54d3e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54dc0cf4d0 0x7f54dc153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53262/0 (socket says 172.21.15.80:53262) 2024-05-10T04:22:52.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.031+0000 7f54d3e00700 1 -- 172.21.15.80:0/684478703 learned_addr learned my addr 172.21.15.80:0/684478703 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:52.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.032+0000 7f54d3e00700 1 -- 172.21.15.80:0/684478703 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54dc0b7910 msgr2=0x7f54dc1524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:52.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.032+0000 7f54d3e00700 1 --2- 172.21.15.80:0/684478703 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54dc0b7910 0x7f54dc1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.032+0000 7f54d3e00700 1 -- 172.21.15.80:0/684478703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54dc162150 msgr2=0x7f54dc1536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:52.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.032+0000 7f54e0e00700 1 --2- 172.21.15.80:0/684478703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54dc162150 0x7f54dc1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:52.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.032+0000 7f54d3e00700 1 --2- 172.21.15.80:0/684478703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54dc162150 0x7f54dc1536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.032+0000 7f54d3e00700 1 -- 172.21.15.80:0/684478703 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc0094a0 con 0x7f54dc0cf4d0 2024-05-10T04:22:52.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.032+0000 7f54e0e00700 1 --2- 172.21.15.80:0/684478703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54dc162150 0x7f54dc1536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:22:52.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.032+0000 7f54d3e00700 1 --2- 172.21.15.80:0/684478703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54dc0cf4d0 0x7f54dc153170 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f54c400e840 tx=0x7f54c400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:52.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.032+0000 7f54d8c00700 1 -- 172.21.15.80:0/684478703 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4009590 con 0x7f54dc0cf4d0 2024-05-10T04:22:52.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.032+0000 7f54d8c00700 1 -- 172.21.15.80:0/684478703 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c4013680 con 0x7f54dc0cf4d0 2024-05-10T04:22:52.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.032+0000 7f54e2e00700 1 -- 172.21.15.80:0/684478703 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54dc160630 con 0x7f54dc0cf4d0 2024-05-10T04:22:52.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.032+0000 7f54d8c00700 1 -- 172.21.15.80:0/684478703 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4013a10 con 0x7f54dc0cf4d0 2024-05-10T04:22:52.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.032+0000 7f54e2e00700 1 -- 172.21.15.80:0/684478703 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54dc15fd90 con 0x7f54dc0cf4d0 2024-05-10T04:22:52.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.033+0000 7f54e2e00700 1 -- 172.21.15.80:0/684478703 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54dc068880 con 0x7f54dc0cf4d0 2024-05-10T04:22:52.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.034+0000 7f54d8c00700 1 -- 172.21.15.80:0/684478703 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f54c4013b70 con 0x7f54dc0cf4d0 2024-05-10T04:22:52.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.035+0000 7f54d8c00700 1 --2- 172.21.15.80:0/684478703 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f54b806ac90 0x7f54b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:52.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.035+0000 7f54d8c00700 1 -- 172.21.15.80:0/684478703 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54c4089600 con 0x7f54dc0cf4d0 2024-05-10T04:22:52.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.036+0000 7f54dbe00700 1 --2- 172.21.15.80:0/684478703 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f54b806ac90 0x7f54b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:52.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.037+0000 7f54dbe00700 1 --2- 172.21.15.80:0/684478703 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f54b806ac90 0x7f54b806d1a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009840 tx=0x7f54cc009f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:52.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.040+0000 7f54d8c00700 1 -- 172.21.15.80:0/684478703 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f54c40547d0 con 0x7f54dc0cf4d0 2024-05-10T04:22:52.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.244+0000 7f54e2e00700 1 -- 172.21.15.80:0/684478703 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f54dc0b2b70 con 0x7f54dc0cf4d0 2024-05-10T04:22:52.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.244+0000 7f54d8c00700 1 -- 172.21.15.80:0/684478703 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f54c4057df0 con 0x7f54dc0cf4d0 2024-05-10T04:22:52.245 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-10T04:22:52.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.247+0000 7f54e2e00700 1 -- 172.21.15.80:0/684478703 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f54b806ac90 msgr2=0x7f54b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:52.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.247+0000 7f54e2e00700 1 --2- 172.21.15.80:0/684478703 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f54b806ac90 0x7f54b806d1a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009840 tx=0x7f54cc009f90 comp rx=0 tx=0).stop 2024-05-10T04:22:52.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.247+0000 7f54e2e00700 1 -- 172.21.15.80:0/684478703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54dc0cf4d0 msgr2=0x7f54dc153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:52.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.247+0000 7f54e2e00700 1 --2- 172.21.15.80:0/684478703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54dc0cf4d0 0x7f54dc153170 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f54c400e840 tx=0x7f54c400ec00 comp rx=0 tx=0).stop 2024-05-10T04:22:52.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.247+0000 7f54e2e00700 1 -- 172.21.15.80:0/684478703 shutdown_connections 2024-05-10T04:22:52.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.247+0000 7f54e2e00700 1 --2- 172.21.15.80:0/684478703 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f54b806ac90 0x7f54b806d1a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.247+0000 7f54e2e00700 1 --2- 172.21.15.80:0/684478703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54dc162150 0x7f54dc1536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.247+0000 7f54e2e00700 1 --2- 172.21.15.80:0/684478703 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54dc0b7910 0x7f54dc1524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.247+0000 7f54e2e00700 1 --2- 172.21.15.80:0/684478703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54dc0cf4d0 0x7f54dc153170 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.247+0000 7f54e2e00700 1 -- 172.21.15.80:0/684478703 >> 172.21.15.80:0/684478703 conn(0x7f54dc0d3e10 msgr2=0x7f54dc06c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:52.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.247+0000 7f54e2e00700 1 -- 172.21.15.80:0/684478703 shutdown_connections 2024-05-10T04:22:52.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.247+0000 7f54e2e00700 1 -- 172.21.15.80:0/684478703 wait complete. 2024-05-10T04:22:52.272 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:22:52.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.529+0000 7fc5e1200700 1 Processor -- start 2024-05-10T04:22:52.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.530+0000 7fc5e1200700 1 -- start start 2024-05-10T04:22:52.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.531+0000 7fc5e1200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5dc0b2f50 0x7fc5dc161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:52.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.531+0000 7fc5e1200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc5dc0d0d40 0x7fc5dc0d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:52.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.531+0000 7fc5e1200700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5dc0d28c0 con 0x7fc5dc0d3030 2024-05-10T04:22:52.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.531+0000 7fc5e1200700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5dc0b3360 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.531+0000 7fc5e1200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc1624e0 con 0x7fc5dc0b2f50 2024-05-10T04:22:52.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.532+0000 7fc5da800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc5dc0d0d40 0x7fc5dc0d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:52.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.532+0000 7fc5d3e00700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc5dc0d3030 0x7fc5dc0d0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:47320/0 (socket says 172.21.15.80:47320) 2024-05-10T04:22:52.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.532+0000 7fc5d3e00700 1 -- 172.21.15.80:0/3540928608 learned_addr learned my addr 172.21.15.80:0/3540928608 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:52.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.532+0000 7fc5d9e00700 1 --2- 172.21.15.80:0/3540928608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5dc0b2f50 0x7fc5dc161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:52.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.532+0000 7fc5da800700 1 -- 172.21.15.80:0/3540928608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5dc0b2f50 msgr2=0x7fc5dc161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:52.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.532+0000 7fc5da800700 1 --2- 172.21.15.80:0/3540928608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5dc0b2f50 0x7fc5dc161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.532+0000 7fc5da800700 1 -- 172.21.15.80:0/3540928608 >> v1:172.21.15.106:6789/0 conn(0x7fc5dc0d3030 legacy=0x7fc5dc0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:52.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.532+0000 7fc5da800700 1 -- 172.21.15.80:0/3540928608 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc0d2ba0 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.532+0000 7fc5d9400700 1 -- 172.21.15.80:0/3540928608 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754259751 0 0) 0x7fc5dc0d28c0 con 0x7fc5dc0d3030 2024-05-10T04:22:52.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.533+0000 7fc5da800700 1 --2- 172.21.15.80:0/3540928608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5dc0d0d40 0x7fc5dc0d3440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4009d90 tx=0x7fc5d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f012b841f9b6d178 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:52.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.533+0000 7fc5d9400700 1 -- 172.21.15.80:0/3540928608 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d400e070 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.533+0000 7fc5d9400700 1 -- 172.21.15.80:0/3540928608 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d400bb20 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.533+0000 7fc5d9400700 1 -- 172.21.15.80:0/3540928608 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4012430 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.533+0000 7fc5e1200700 1 -- 172.21.15.80:0/3540928608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5dc0d0d40 msgr2=0x7fc5dc0d3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:52.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.533+0000 7fc5e1200700 1 --2- 172.21.15.80:0/3540928608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5dc0d0d40 0x7fc5dc0d3440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4009d90 tx=0x7fc5d400b330 comp rx=0 tx=0).stop 2024-05-10T04:22:52.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.534+0000 7fc5e1200700 1 -- 172.21.15.80:0/3540928608 shutdown_connections 2024-05-10T04:22:52.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.534+0000 7fc5e1200700 1 --2- 172.21.15.80:0/3540928608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5dc0d0d40 0x7fc5dc0d3440 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.534+0000 7fc5e1200700 1 --2- 172.21.15.80:0/3540928608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5dc0b2f50 0x7fc5dc161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.534+0000 7fc5e1200700 1 -- 172.21.15.80:0/3540928608 >> 172.21.15.80:0/3540928608 conn(0x7fc5dc06c3f0 msgr2=0x7fc5dc06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:52.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.534+0000 7fc5e1200700 1 -- 172.21.15.80:0/3540928608 shutdown_connections 2024-05-10T04:22:52.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.534+0000 7fc5e1200700 1 -- 172.21.15.80:0/3540928608 wait complete. 2024-05-10T04:22:52.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.536+0000 7fc5e1200700 1 Processor -- start 2024-05-10T04:22:52.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.536+0000 7fc5e1200700 1 -- start start 2024-05-10T04:22:52.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.538+0000 7fc5e1200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5dc0b2f50 0x7fc5dc15abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:52.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.538+0000 7fc5e1200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5dc0d0d40 0x7fc5dc14d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:52.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.538+0000 7fc5e1200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5dc0d3030 0x7fc5dc15c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:52.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.538+0000 7fc5e1200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc1f55f0 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.538+0000 7fc5e1200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0c82b0 con 0x7fc5dc0b2f50 2024-05-10T04:22:52.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.538+0000 7fc5e1200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc158720 con 0x7fc5dc0d3030 2024-05-10T04:22:52.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.538+0000 7fc5d3e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5dc0d0d40 0x7fc5dc14d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:52.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.538+0000 7fc5d3e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5dc0d0d40 0x7fc5dc14d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53282/0 (socket says 172.21.15.80:53282) 2024-05-10T04:22:52.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.538+0000 7fc5d3e00700 1 -- 172.21.15.80:0/3497192636 learned_addr learned my addr 172.21.15.80:0/3497192636 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:52.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.538+0000 7fc5d9e00700 1 --2- 172.21.15.80:0/3497192636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5dc0b2f50 0x7fc5dc15abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:52.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.538+0000 7fc5da800700 1 --2- 172.21.15.80:0/3497192636 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5dc0d3030 0x7fc5dc15c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:52.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.538+0000 7fc5d3e00700 1 -- 172.21.15.80:0/3497192636 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5dc0d3030 msgr2=0x7fc5dc15c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:52.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.538+0000 7fc5d3e00700 1 --2- 172.21.15.80:0/3497192636 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5dc0d3030 0x7fc5dc15c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.538+0000 7fc5d3e00700 1 -- 172.21.15.80:0/3497192636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5dc0b2f50 msgr2=0x7fc5dc15abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:52.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.538+0000 7fc5d3e00700 1 --2- 172.21.15.80:0/3497192636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5dc0b2f50 0x7fc5dc15abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.538+0000 7fc5d3e00700 1 -- 172.21.15.80:0/3497192636 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d4009a70 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.539+0000 7fc5d3e00700 1 --2- 172.21.15.80:0/3497192636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5dc0d0d40 0x7fc5dc14d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400c520 tx=0x7fc5c400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:52.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.539+0000 7fc5d2000700 1 -- 172.21.15.80:0/3497192636 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4004c80 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.539+0000 7fc5d2000700 1 -- 172.21.15.80:0/3497192636 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c4004de0 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.539+0000 7fc5e1200700 1 -- 172.21.15.80:0/3497192636 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5dc158a00 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.539+0000 7fc5d2000700 1 -- 172.21.15.80:0/3497192636 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c40072d0 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.539+0000 7fc5e1200700 1 -- 172.21.15.80:0/3497192636 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5dc1f5330 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.540+0000 7fc5e1200700 1 -- 172.21.15.80:0/3497192636 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5dc159050 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.541+0000 7fc5d2000700 1 -- 172.21.15.80:0/3497192636 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc5c4007430 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.542+0000 7fc5d2000700 1 --2- 172.21.15.80:0/3497192636 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc5b806ac90 0x7fc5b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.542+0000 7fc5d2000700 1 -- 172.21.15.80:0/3497192636 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5c4088e90 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.542+0000 7fc5d9e00700 1 --2- 172.21.15.80:0/3497192636 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc5b806ac90 0x7fc5b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.543+0000 7fc5d9e00700 1 --2- 172.21.15.80:0/3497192636 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc5b806ac90 0x7fc5b806d1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc08d080 tx=0x7fc5cc009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:52.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.546+0000 7fc5d2000700 1 -- 172.21.15.80:0/3497192636 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc5c4054050 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.795+0000 7fc5e1200700 1 -- 172.21.15.80:0/3497192636 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5dc074af0 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.796+0000 7fc5d2000700 1 -- 172.21.15.80:0/3497192636 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4731 (secure 0 0 0) 0x7fc5c4057670 con 0x7fc5dc0d0d40 2024-05-10T04:22:52.796 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:52.796 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4189316245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4189316245},{"type":"v1","addr":"172.21.15.106:6836","nonce":4189316245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/4150483341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":4150483341},{"type":"v1","addr":"172.21.15.80:6833","nonce":4150483341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1287697381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1287697381},{"type":"v1","addr":"172.21.15.80:6835","nonce":1287697381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:22:37.482943+0000","modified":"2024-05-10T04:22:40.916280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/961352916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":961352916},{"type":"v1","addr":"172.21.15.106:6837","nonce":961352916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:22:52.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.799+0000 7fc5e1200700 1 -- 172.21.15.80:0/3497192636 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc5b806ac90 msgr2=0x7fc5b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:52.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.799+0000 7fc5e1200700 1 --2- 172.21.15.80:0/3497192636 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc5b806ac90 0x7fc5b806d1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc08d080 tx=0x7fc5cc009210 comp rx=0 tx=0).stop 2024-05-10T04:22:52.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.799+0000 7fc5e1200700 1 -- 172.21.15.80:0/3497192636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5dc0d0d40 msgr2=0x7fc5dc14d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:52.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.799+0000 7fc5e1200700 1 --2- 172.21.15.80:0/3497192636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5dc0d0d40 0x7fc5dc14d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400c520 tx=0x7fc5c400c830 comp rx=0 tx=0).stop 2024-05-10T04:22:52.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.799+0000 7fc5e1200700 1 -- 172.21.15.80:0/3497192636 shutdown_connections 2024-05-10T04:22:52.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.799+0000 7fc5e1200700 1 --2- 172.21.15.80:0/3497192636 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc5b806ac90 0x7fc5b806d1a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.799+0000 7fc5e1200700 1 --2- 172.21.15.80:0/3497192636 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5dc0d3030 0x7fc5dc15c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.799+0000 7fc5e1200700 1 --2- 172.21.15.80:0/3497192636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5dc0b2f50 0x7fc5dc15abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.799+0000 7fc5e1200700 1 --2- 172.21.15.80:0/3497192636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5dc0d0d40 0x7fc5dc14d390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:52.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.799+0000 7fc5e1200700 1 -- 172.21.15.80:0/3497192636 >> 172.21.15.80:0/3497192636 conn(0x7fc5dc06c3f0 msgr2=0x7fc5dc161710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:52.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.799+0000 7fc5e1200700 1 -- 172.21.15.80:0/3497192636 shutdown_connections 2024-05-10T04:22:52.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:52.799+0000 7fc5e1200700 1 -- 172.21.15.80:0/3497192636 wait complete. 2024-05-10T04:22:52.800 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2024-05-10T04:22:52.826 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:22:52.827 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:22:52.832 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:22:53.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.094+0000 7f3ea0400700 1 Processor -- start 2024-05-10T04:22:53.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.094+0000 7f3ea0400700 1 -- start start 2024-05-10T04:22:53.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.096+0000 7f3ea0400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e9815b870 0x7f3e9815c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:53.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.096+0000 7f3ea0400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e980cdde0 0x7f3e980b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:53.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.096+0000 7f3ea0400700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e980cf360 con 0x7f3e980ce1f0 2024-05-10T04:22:53.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.096+0000 7f3ea0400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e9815c730 con 0x7f3e980cdde0 2024-05-10T04:22:53.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.096+0000 7f3ea0400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980ce750 con 0x7f3e9815b870 2024-05-10T04:22:53.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.096+0000 7f3e9d000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e980cdde0 0x7f3e980b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:53.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.096+0000 7f3e9d000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e980cdde0 0x7f3e980b2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35788/0 (socket says 172.21.15.80:35788) 2024-05-10T04:22:53.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.096+0000 7f3e9d000700 1 -- 172.21.15.80:0/175975938 learned_addr learned my addr 172.21.15.80:0/175975938 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:53.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.096+0000 7f3e9da00700 1 --2- 172.21.15.80:0/175975938 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e9815b870 0x7f3e9815c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:53.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.096+0000 7f3e9d000700 1 -- 172.21.15.80:0/175975938 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e9815b870 msgr2=0x7f3e9815c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:53.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.096+0000 7f3e9d000700 1 --2- 172.21.15.80:0/175975938 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e9815b870 0x7f3e9815c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.096+0000 7f3e9d000700 1 -- 172.21.15.80:0/175975938 >> v1:172.21.15.106:6789/0 conn(0x7f3e980ce1f0 legacy=0x7f3e9815ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:53.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.096+0000 7f3e9d000700 1 -- 172.21.15.80:0/175975938 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e980cea30 con 0x7f3e980cdde0 2024-05-10T04:22:53.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.097+0000 7f3e9d000700 1 --2- 172.21.15.80:0/175975938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e980cdde0 0x7f3e980b2ac0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3e840098f0 tx=0x7f3e84009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9936412b10a634 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:53.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.097+0000 7f3e97e00700 1 -- 172.21.15.80:0/175975938 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8400b8a0 con 0x7f3e980cdde0 2024-05-10T04:22:53.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.097+0000 7f3e97e00700 1 -- 172.21.15.80:0/175975938 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8400ba00 con 0x7f3e980cdde0 2024-05-10T04:22:53.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.097+0000 7f3e97e00700 1 -- 172.21.15.80:0/175975938 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8400bd90 con 0x7f3e980cdde0 2024-05-10T04:22:53.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.098+0000 7f3ea0400700 1 -- 172.21.15.80:0/175975938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e980cdde0 msgr2=0x7f3e980b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:53.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.098+0000 7f3ea0400700 1 --2- 172.21.15.80:0/175975938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e980cdde0 0x7f3e980b2ac0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3e840098f0 tx=0x7f3e84009c00 comp rx=0 tx=0).stop 2024-05-10T04:22:53.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.098+0000 7f3ea0400700 1 -- 172.21.15.80:0/175975938 shutdown_connections 2024-05-10T04:22:53.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.098+0000 7f3ea0400700 1 --2- 172.21.15.80:0/175975938 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e9815b870 0x7f3e9815c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.098+0000 7f3ea0400700 1 --2- 172.21.15.80:0/175975938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e980cdde0 0x7f3e980b2ac0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.098+0000 7f3ea0400700 1 -- 172.21.15.80:0/175975938 >> 172.21.15.80:0/175975938 conn(0x7f3e9806b470 msgr2=0x7f3e980b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:53.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.098+0000 7f3ea0400700 1 -- 172.21.15.80:0/175975938 shutdown_connections 2024-05-10T04:22:53.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.098+0000 7f3ea0400700 1 -- 172.21.15.80:0/175975938 wait complete. 2024-05-10T04:22:53.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.100+0000 7f3ea0400700 1 Processor -- start 2024-05-10T04:22:53.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.100+0000 7f3ea0400700 1 -- start start 2024-05-10T04:22:53.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.102+0000 7f3ea0400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e980cdde0 0x7f3e9815c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:53.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.102+0000 7f3ea0400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e980ce1f0 0x7f3e981547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:53.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.102+0000 7f3ea0400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e9815b870 0x7f3e980b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:53.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.102+0000 7f3ea0400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e981353f0 con 0x7f3e980ce1f0 2024-05-10T04:22:53.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.102+0000 7f3ea0400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e98133010 con 0x7f3e980cdde0 2024-05-10T04:22:53.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.102+0000 7f3ea0400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e981332f0 con 0x7f3e9815b870 2024-05-10T04:22:53.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.102+0000 7f3e9d000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e980ce1f0 0x7f3e981547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:53.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.102+0000 7f3e9d000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e980ce1f0 0x7f3e981547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35800/0 (socket says 172.21.15.80:35800) 2024-05-10T04:22:53.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.102+0000 7f3e9d000700 1 -- 172.21.15.80:0/1235786378 learned_addr learned my addr 172.21.15.80:0/1235786378 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:53.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.102+0000 7f3e9d000700 1 -- 172.21.15.80:0/1235786378 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e9815b870 msgr2=0x7f3e980b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:53.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.102+0000 7f3e9d000700 1 --2- 172.21.15.80:0/1235786378 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e9815b870 0x7f3e980b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.102+0000 7f3e9d000700 1 -- 172.21.15.80:0/1235786378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e980cdde0 msgr2=0x7f3e9815c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:53.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.102+0000 7f3e9d000700 1 --2- 172.21.15.80:0/1235786378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e980cdde0 0x7f3e9815c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.102+0000 7f3e9d000700 1 -- 172.21.15.80:0/1235786378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e84009550 con 0x7f3e980ce1f0 2024-05-10T04:22:53.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.103+0000 7f3e9d000700 1 --2- 172.21.15.80:0/1235786378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e980ce1f0 0x7f3e981547c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009c40 tx=0x7f3e84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:53.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.103+0000 7f3e95600700 1 -- 172.21.15.80:0/1235786378 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e840036a0 con 0x7f3e980ce1f0 2024-05-10T04:22:53.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.103+0000 7f3e95600700 1 -- 172.21.15.80:0/1235786378 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8401e070 con 0x7f3e980ce1f0 2024-05-10T04:22:53.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.103+0000 7f3ea0400700 1 -- 172.21.15.80:0/1235786378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e981335d0 con 0x7f3e980ce1f0 2024-05-10T04:22:53.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.103+0000 7f3e95600700 1 -- 172.21.15.80:0/1235786378 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84003a60 con 0x7f3e980ce1f0 2024-05-10T04:22:53.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.103+0000 7f3ea0400700 1 -- 172.21.15.80:0/1235786378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e98133b90 con 0x7f3e980ce1f0 2024-05-10T04:22:53.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.104+0000 7f3ea0400700 1 -- 172.21.15.80:0/1235786378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e98133d50 con 0x7f3e980ce1f0 2024-05-10T04:22:53.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.105+0000 7f3e95600700 1 -- 172.21.15.80:0/1235786378 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3e84003bc0 con 0x7f3e980ce1f0 2024-05-10T04:22:53.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.106+0000 7f3e95600700 1 --2- 172.21.15.80:0/1235786378 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3e7806acc0 0x7f3e7806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:53.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.106+0000 7f3e95600700 1 -- 172.21.15.80:0/1235786378 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e84020070 con 0x7f3e980ce1f0 2024-05-10T04:22:53.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.106+0000 7f3e9da00700 1 --2- 172.21.15.80:0/1235786378 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3e7806acc0 0x7f3e7806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:53.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.107+0000 7f3e9da00700 1 --2- 172.21.15.80:0/1235786378 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3e7806acc0 0x7f3e7806d1d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e980b5130 tx=0x7f3e8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:53.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.111+0000 7f3e95600700 1 -- 172.21.15.80:0/1235786378 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3e840559e0 con 0x7f3e980ce1f0 2024-05-10T04:22:53.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.316+0000 7f3ea0400700 1 -- 172.21.15.80:0/1235786378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e98074af0 con 0x7f3e980ce1f0 2024-05-10T04:22:53.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.318+0000 7f3e95600700 1 -- 172.21.15.80:0/1235786378 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f3e84015090 con 0x7f3e980ce1f0 2024-05-10T04:22:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:53.319 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:38.485422+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:22:53.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.320+0000 7f3ea0400700 1 -- 172.21.15.80:0/1235786378 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3e7806acc0 msgr2=0x7f3e7806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:53.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.320+0000 7f3ea0400700 1 --2- 172.21.15.80:0/1235786378 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3e7806acc0 0x7f3e7806d1d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e980b5130 tx=0x7f3e8c008040 comp rx=0 tx=0).stop 2024-05-10T04:22:53.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.320+0000 7f3ea0400700 1 -- 172.21.15.80:0/1235786378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e980ce1f0 msgr2=0x7f3e981547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:53.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.320+0000 7f3ea0400700 1 --2- 172.21.15.80:0/1235786378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e980ce1f0 0x7f3e981547c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009c40 tx=0x7f3e84004750 comp rx=0 tx=0).stop 2024-05-10T04:22:53.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.320+0000 7f3ea0400700 1 -- 172.21.15.80:0/1235786378 shutdown_connections 2024-05-10T04:22:53.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.320+0000 7f3ea0400700 1 --2- 172.21.15.80:0/1235786378 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3e7806acc0 0x7f3e7806d1d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.320+0000 7f3ea0400700 1 --2- 172.21.15.80:0/1235786378 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e9815b870 0x7f3e980b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.320+0000 7f3ea0400700 1 --2- 172.21.15.80:0/1235786378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e980cdde0 0x7f3e9815c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.320+0000 7f3ea0400700 1 --2- 172.21.15.80:0/1235786378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e980ce1f0 0x7f3e981547c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.320+0000 7f3ea0400700 1 -- 172.21.15.80:0/1235786378 >> 172.21.15.80:0/1235786378 conn(0x7f3e9806b470 msgr2=0x7f3e980b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:53.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.320+0000 7f3ea0400700 1 -- 172.21.15.80:0/1235786378 shutdown_connections 2024-05-10T04:22:53.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.320+0000 7f3ea0400700 1 -- 172.21.15.80:0/1235786378 wait complete. 2024-05-10T04:22:53.346 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:22:26.793377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:22:35.751764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:22:36.465587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:22:53.347 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:22:53.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.613+0000 7f58d9800700 1 Processor -- start 2024-05-10T04:22:53.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.613+0000 7f58d9800700 1 -- start start 2024-05-10T04:22:53.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.615+0000 7f58d9800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58d40b98e0 0x7f58d40d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:53.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.615+0000 7f58d9800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58d40b6230 0x7f58d40d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:53.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.615+0000 7f58d9800700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d40d0ed0 con 0x7f58d40d0ac0 2024-05-10T04:22:53.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.615+0000 7f58d9800700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d40d2e50 con 0x7f58d40b6230 2024-05-10T04:22:53.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.615+0000 7f58d9800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d40d3130 con 0x7f58d40b98e0 2024-05-10T04:22:53.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.615+0000 7f58d3400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58d40b6230 0x7f58d40d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:53.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.615+0000 7f58d3400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58d40b6230 0x7f58d40d0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35804/0 (socket says 172.21.15.80:35804) 2024-05-10T04:22:53.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.615+0000 7f58d3400700 1 -- 172.21.15.80:0/1209563646 learned_addr learned my addr 172.21.15.80:0/1209563646 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:53.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.616+0000 7f58d3e00700 1 --2- 172.21.15.80:0/1209563646 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58d40b98e0 0x7f58d40d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:53.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.616+0000 7f58d3400700 1 -- 172.21.15.80:0/1209563646 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58d40b98e0 msgr2=0x7f58d40d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:53.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.616+0000 7f58d3400700 1 --2- 172.21.15.80:0/1209563646 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58d40b98e0 0x7f58d40d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.616+0000 7f58d3400700 1 -- 172.21.15.80:0/1209563646 >> v1:172.21.15.106:6789/0 conn(0x7f58d40d0ac0 legacy=0x7f58d415d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:53.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.616+0000 7f58d3400700 1 -- 172.21.15.80:0/1209563646 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d40d3410 con 0x7f58d40b6230 2024-05-10T04:22:53.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.616+0000 7f58d3400700 1 --2- 172.21.15.80:0/1209563646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d40b6230 0x7f58d40d0580 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f58c00098f0 tx=0x7f58c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78bf2ea03c215fff server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:53.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.616+0000 7f58d2a00700 1 -- 172.21.15.80:0/1209563646 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c000b8a0 con 0x7f58d40b6230 2024-05-10T04:22:53.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.616+0000 7f58d2a00700 1 -- 172.21.15.80:0/1209563646 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c000ba00 con 0x7f58d40b6230 2024-05-10T04:22:53.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.616+0000 7f58d2a00700 1 -- 172.21.15.80:0/1209563646 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c000bd90 con 0x7f58d40b6230 2024-05-10T04:22:53.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.617+0000 7f58d9800700 1 -- 172.21.15.80:0/1209563646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d40b6230 msgr2=0x7f58d40d0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:53.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.617+0000 7f58d9800700 1 --2- 172.21.15.80:0/1209563646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d40b6230 0x7f58d40d0580 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f58c00098f0 tx=0x7f58c0009c00 comp rx=0 tx=0).stop 2024-05-10T04:22:53.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.617+0000 7f58d9800700 1 -- 172.21.15.80:0/1209563646 shutdown_connections 2024-05-10T04:22:53.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.617+0000 7f58d9800700 1 --2- 172.21.15.80:0/1209563646 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58d40b98e0 0x7f58d40d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.617+0000 7f58d9800700 1 --2- 172.21.15.80:0/1209563646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d40b6230 0x7f58d40d0580 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.617+0000 7f58d9800700 1 -- 172.21.15.80:0/1209563646 >> 172.21.15.80:0/1209563646 conn(0x7f58d40676c0 msgr2=0x7f58d406c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:53.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.617+0000 7f58d9800700 1 -- 172.21.15.80:0/1209563646 shutdown_connections 2024-05-10T04:22:53.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.617+0000 7f58d9800700 1 -- 172.21.15.80:0/1209563646 wait complete. 2024-05-10T04:22:53.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.620+0000 7f58d9800700 1 Processor -- start 2024-05-10T04:22:53.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.620+0000 7f58d9800700 1 -- start start 2024-05-10T04:22:53.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.622+0000 7f58d9800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d40b6230 0x7f58d415f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:53.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.622+0000 7f58d9800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58d40b98e0 0x7f58d4156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:53.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.622+0000 7f58d9800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58d40d0ac0 0x7f58d4159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:53.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.622+0000 7f58d9800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d41576a0 con 0x7f58d40b6230 2024-05-10T04:22:53.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.622+0000 7f58d9800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d415e2b0 con 0x7f58d40d0ac0 2024-05-10T04:22:53.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.622+0000 7f58d9800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d415e590 con 0x7f58d40b98e0 2024-05-10T04:22:53.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.622+0000 7f58d3e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d40b6230 0x7f58d415f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:53.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.622+0000 7f58d3e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d40b6230 0x7f58d415f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35812/0 (socket says 172.21.15.80:35812) 2024-05-10T04:22:53.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.622+0000 7f58d3e00700 1 -- 172.21.15.80:0/495632483 learned_addr learned my addr 172.21.15.80:0/495632483 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:53.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.622+0000 7f58d3400700 1 --2- 172.21.15.80:0/495632483 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58d40b98e0 0x7f58d4156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:53.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.622+0000 7f58d8e00700 1 --2- 172.21.15.80:0/495632483 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58d40d0ac0 0x7f58d4159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:53.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.623+0000 7f58d3e00700 1 -- 172.21.15.80:0/495632483 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58d40b98e0 msgr2=0x7f58d4156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:53.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.623+0000 7f58d3e00700 1 --2- 172.21.15.80:0/495632483 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58d40b98e0 0x7f58d4156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.623+0000 7f58d3e00700 1 -- 172.21.15.80:0/495632483 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58d40d0ac0 msgr2=0x7f58d4159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:53.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.623+0000 7f58d3e00700 1 --2- 172.21.15.80:0/495632483 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58d40d0ac0 0x7f58d4159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.623+0000 7f58d3e00700 1 -- 172.21.15.80:0/495632483 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c0009550 con 0x7f58d40b6230 2024-05-10T04:22:53.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.623+0000 7f58d3e00700 1 --2- 172.21.15.80:0/495632483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d40b6230 0x7f58d415f350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f58c400d800 tx=0x7f58c400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:53.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.623+0000 7f58cbe00700 1 -- 172.21.15.80:0/495632483 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c40125f0 con 0x7f58d40b6230 2024-05-10T04:22:53.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.623+0000 7f58cbe00700 1 -- 172.21.15.80:0/495632483 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c4012750 con 0x7f58d40b6230 2024-05-10T04:22:53.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.623+0000 7f58d9800700 1 -- 172.21.15.80:0/495632483 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d415e870 con 0x7f58d40b6230 2024-05-10T04:22:53.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.623+0000 7f58cbe00700 1 -- 172.21.15.80:0/495632483 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4012b00 con 0x7f58d40b6230 2024-05-10T04:22:53.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.623+0000 7f58d9800700 1 -- 172.21.15.80:0/495632483 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d415ee30 con 0x7f58d40b6230 2024-05-10T04:22:53.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.624+0000 7f58d9800700 1 -- 172.21.15.80:0/495632483 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d4074af0 con 0x7f58d40b6230 2024-05-10T04:22:53.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.625+0000 7f58cbe00700 1 -- 172.21.15.80:0/495632483 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f58c4012c60 con 0x7f58d40b6230 2024-05-10T04:22:53.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.626+0000 7f58cbe00700 1 --2- 172.21.15.80:0/495632483 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f58b406ac90 0x7f58b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:53.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.626+0000 7f58cbe00700 1 -- 172.21.15.80:0/495632483 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58c4089750 con 0x7f58d40b6230 2024-05-10T04:22:53.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.627+0000 7f58d3400700 1 --2- 172.21.15.80:0/495632483 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f58b406ac90 0x7f58b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:53.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.627+0000 7f58d3400700 1 --2- 172.21.15.80:0/495632483 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f58b406ac90 0x7f58b406d1a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f58c0014040 tx=0x7f58c0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:53.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.630+0000 7f58cbe00700 1 -- 172.21.15.80:0/495632483 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f58c4054800 con 0x7f58d40b6230 2024-05-10T04:22:53.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.834+0000 7f58d9800700 1 -- 172.21.15.80:0/495632483 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58d40b4c90 con 0x7f58d40b6230 2024-05-10T04:22:53.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.834+0000 7f58cbe00700 1 -- 172.21.15.80:0/495632483 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58c4057e20 con 0x7f58d40b6230 2024-05-10T04:22:53.836 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-10T04:22:53.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.837+0000 7f58d9800700 1 -- 172.21.15.80:0/495632483 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f58b406ac90 msgr2=0x7f58b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:53.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.837+0000 7f58d9800700 1 --2- 172.21.15.80:0/495632483 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f58b406ac90 0x7f58b406d1a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f58c0014040 tx=0x7f58c0008030 comp rx=0 tx=0).stop 2024-05-10T04:22:53.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.837+0000 7f58d9800700 1 -- 172.21.15.80:0/495632483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d40b6230 msgr2=0x7f58d415f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:53.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.837+0000 7f58d9800700 1 --2- 172.21.15.80:0/495632483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d40b6230 0x7f58d415f350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f58c400d800 tx=0x7f58c400db10 comp rx=0 tx=0).stop 2024-05-10T04:22:53.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.837+0000 7f58d9800700 1 -- 172.21.15.80:0/495632483 shutdown_connections 2024-05-10T04:22:53.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.837+0000 7f58d9800700 1 --2- 172.21.15.80:0/495632483 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f58b406ac90 0x7f58b406d1a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.837+0000 7f58d9800700 1 --2- 172.21.15.80:0/495632483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d40b6230 0x7f58d415f350 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.837+0000 7f58d9800700 1 --2- 172.21.15.80:0/495632483 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58d40d0ac0 0x7f58d4159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.837+0000 7f58d9800700 1 --2- 172.21.15.80:0/495632483 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58d40b98e0 0x7f58d4156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:53.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.837+0000 7f58d9800700 1 -- 172.21.15.80:0/495632483 >> 172.21.15.80:0/495632483 conn(0x7f58d40676c0 msgr2=0x7f58d40d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:53.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.837+0000 7f58d9800700 1 -- 172.21.15.80:0/495632483 shutdown_connections 2024-05-10T04:22:53.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:53.837+0000 7f58d9800700 1 -- 172.21.15.80:0/495632483 wait complete. 2024-05-10T04:22:53.864 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:22:54.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.125+0000 7f2dd7200700 1 Processor -- start 2024-05-10T04:22:54.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.125+0000 7f2dd7200700 1 -- start start 2024-05-10T04:22:54.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.127+0000 7f2dd7200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dd80b98e0 0x7f2dd80d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:54.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.127+0000 7f2dd7200700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd80d2e50 con 0x7f2dd80b6230 2024-05-10T04:22:54.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.127+0000 7f2dd7200700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd80d3130 con 0x7f2dd80d0c90 2024-05-10T04:22:54.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.127+0000 7f2dd7200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd80d3410 con 0x7f2dd80b98e0 2024-05-10T04:22:54.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.127+0000 7f2dcfe00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2dd80b6230 0x7f2dd80d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48614/0 (socket says 172.21.15.80:48614) 2024-05-10T04:22:54.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.127+0000 7f2dcfe00700 1 -- 172.21.15.80:0/2462352969 learned_addr learned my addr 172.21.15.80:0/2462352969 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:54.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.128+0000 7f2dd5e00700 1 --2- 172.21.15.80:0/2462352969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dd80b98e0 0x7f2dd80d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:54.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.128+0000 7f2dd5400700 1 -- 172.21.15.80:0/2462352969 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700109293 0 0) 0x7f2dd80d2e50 con 0x7f2dd80b6230 2024-05-10T04:22:54.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.128+0000 7f2dd5400700 1 -- 172.21.15.80:0/2462352969 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dbc0035b0 con 0x7f2dd80b6230 2024-05-10T04:22:54.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.128+0000 7f2dd5400700 1 -- 172.21.15.80:0/2462352969 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761749195 0 0) 0x7f2dd80d3130 con 0x7f2dd80d0c90 2024-05-10T04:22:54.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.128+0000 7f2dd5400700 1 -- 172.21.15.80:0/2462352969 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd80d2e50 con 0x7f2dd80d0c90 2024-05-10T04:22:54.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.128+0000 7f2dd5400700 1 -- 172.21.15.80:0/2462352969 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3963145113 0 0) 0x7f2dbc0035b0 con 0x7f2dd80b6230 2024-05-10T04:22:54.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.128+0000 7f2dd5e00700 1 -- 172.21.15.80:0/2462352969 >> v1:172.21.15.106:6789/0 conn(0x7f2dd80d0c90 legacy=0x7f2dd815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:54.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.128+0000 7f2dd5e00700 1 -- 172.21.15.80:0/2462352969 >> v1:172.21.15.80:6789/0 conn(0x7f2dd80b6230 legacy=0x7f2dd80d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:54.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.128+0000 7f2dd5e00700 1 -- 172.21.15.80:0/2462352969 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd80b7470 con 0x7f2dd80b98e0 2024-05-10T04:22:54.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.128+0000 7f2dd5e00700 1 --2- 172.21.15.80:0/2462352969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dd80b98e0 0x7f2dd80d2520 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8009870 tx=0x7f2dc8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc17d549910c5a1d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:54.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.129+0000 7f2dd5400700 1 -- 172.21.15.80:0/2462352969 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0001690 con 0x7f2dd80b98e0 2024-05-10T04:22:54.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.129+0000 7f2dd5400700 1 -- 172.21.15.80:0/2462352969 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc8004030 con 0x7f2dd80b98e0 2024-05-10T04:22:54.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.129+0000 7f2dd5400700 1 -- 172.21.15.80:0/2462352969 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc80043a0 con 0x7f2dd80b98e0 2024-05-10T04:22:54.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.129+0000 7f2dd7200700 1 -- 172.21.15.80:0/2462352969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dd80b98e0 msgr2=0x7f2dd80d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:54.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.129+0000 7f2dd7200700 1 --2- 172.21.15.80:0/2462352969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dd80b98e0 0x7f2dd80d2520 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8009870 tx=0x7f2dc8009b80 comp rx=0 tx=0).stop 2024-05-10T04:22:54.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.129+0000 7f2dd7200700 1 -- 172.21.15.80:0/2462352969 shutdown_connections 2024-05-10T04:22:54.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.129+0000 7f2dd7200700 1 --2- 172.21.15.80:0/2462352969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dd80b98e0 0x7f2dd80d2520 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:54.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.129+0000 7f2dd7200700 1 -- 172.21.15.80:0/2462352969 >> 172.21.15.80:0/2462352969 conn(0x7f2dd80676c0 msgr2=0x7f2dd806c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:54.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.130+0000 7f2dd7200700 1 -- 172.21.15.80:0/2462352969 shutdown_connections 2024-05-10T04:22:54.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.130+0000 7f2dd7200700 1 -- 172.21.15.80:0/2462352969 wait complete. 2024-05-10T04:22:54.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.132+0000 7f2dd7200700 1 Processor -- start 2024-05-10T04:22:54.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.132+0000 7f2dd7200700 1 -- start start 2024-05-10T04:22:54.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.133+0000 7f2dd7200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dd80b6230 0x7f2dd815c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:54.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.133+0000 7f2dd7200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dd80b98e0 0x7f2dd815a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:54.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.133+0000 7f2dd7200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd80d0c90 0x7f2dd815a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:54.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.133+0000 7f2dd7200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd815f8b0 con 0x7f2dd80d0c90 2024-05-10T04:22:54.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.133+0000 7f2dd7200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd81f7950 con 0x7f2dd80b6230 2024-05-10T04:22:54.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.133+0000 7f2dd7200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd81f7ba0 con 0x7f2dd80b98e0 2024-05-10T04:22:54.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.134+0000 7f2dd6800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd80d0c90 0x7f2dd815a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:54.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.134+0000 7f2dd6800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd80d0c90 0x7f2dd815a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35828/0 (socket says 172.21.15.80:35828) 2024-05-10T04:22:54.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.134+0000 7f2dd6800700 1 -- 172.21.15.80:0/402616947 learned_addr learned my addr 172.21.15.80:0/402616947 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:54.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.134+0000 7f2dcfe00700 1 --2- 172.21.15.80:0/402616947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dd80b98e0 0x7f2dd815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:54.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.134+0000 7f2dd5e00700 1 --2- 172.21.15.80:0/402616947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dd80b6230 0x7f2dd815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.134+0000 7f2dd6800700 1 -- 172.21.15.80:0/402616947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dd80b98e0 msgr2=0x7f2dd815a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.134+0000 7f2dd6800700 1 --2- 172.21.15.80:0/402616947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dd80b98e0 0x7f2dd815a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.134+0000 7f2dd6800700 1 -- 172.21.15.80:0/402616947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dd80b6230 msgr2=0x7f2dd815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.134+0000 7f2dd6800700 1 --2- 172.21.15.80:0/402616947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dd80b6230 0x7f2dd815c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.134+0000 7f2dd6800700 1 -- 172.21.15.80:0/402616947 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc80094a0 con 0x7f2dd80d0c90 2024-05-10T04:22:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.134+0000 7f2dd6800700 1 --2- 172.21.15.80:0/402616947 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd80d0c90 0x7f2dd815a690 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2dd000cbc0 tx=0x7f2dd000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.135+0000 7f2dce000700 1 -- 172.21.15.80:0/402616947 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0003c00 con 0x7f2dd80d0c90 2024-05-10T04:22:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.135+0000 7f2dce000700 1 -- 172.21.15.80:0/402616947 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd0003d60 con 0x7f2dd80d0c90 2024-05-10T04:22:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.135+0000 7f2dd7200700 1 -- 172.21.15.80:0/402616947 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd81f7e80 con 0x7f2dd80d0c90 2024-05-10T04:22:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.135+0000 7f2dce000700 1 -- 172.21.15.80:0/402616947 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd000aaa0 con 0x7f2dd80d0c90 2024-05-10T04:22:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.135+0000 7f2dd7200700 1 -- 172.21.15.80:0/402616947 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd81f8440 con 0x7f2dd80d0c90 2024-05-10T04:22:54.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.136+0000 7f2dd7200700 1 -- 172.21.15.80:0/402616947 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd8074af0 con 0x7f2dd80d0c90 2024-05-10T04:22:54.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.137+0000 7f2dce000700 1 -- 172.21.15.80:0/402616947 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2dd000ac00 con 0x7f2dd80d0c90 2024-05-10T04:22:54.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.138+0000 7f2dce000700 1 --2- 172.21.15.80:0/402616947 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2db406ac90 0x7f2db406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:54.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.138+0000 7f2dce000700 1 -- 172.21.15.80:0/402616947 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2dd00893b0 con 0x7f2dd80d0c90 2024-05-10T04:22:54.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.138+0000 7f2dd5e00700 1 --2- 172.21.15.80:0/402616947 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2db406ac90 0x7f2db406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:54.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.139+0000 7f2dd5e00700 1 --2- 172.21.15.80:0/402616947 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2db406ac90 0x7f2db406d1a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80097c0 tx=0x7f2dc8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:54.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.142+0000 7f2dce000700 1 -- 172.21.15.80:0/402616947 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2dd00544e0 con 0x7f2dd80d0c90 2024-05-10T04:22:54.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.350+0000 7f2dd7200700 1 -- 172.21.15.80:0/402616947 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2dd80d46f0 con 0x7f2dd80d0c90 2024-05-10T04:22:54.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.350+0000 7f2dce000700 1 -- 172.21.15.80:0/402616947 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2dd0057b00 con 0x7f2dd80d0c90 2024-05-10T04:22:54.351 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-10T04:22:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.352+0000 7f2dd7200700 1 -- 172.21.15.80:0/402616947 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2db406ac90 msgr2=0x7f2db406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.352+0000 7f2dd7200700 1 --2- 172.21.15.80:0/402616947 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2db406ac90 0x7f2db406d1a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80097c0 tx=0x7f2dc8008030 comp rx=0 tx=0).stop 2024-05-10T04:22:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.352+0000 7f2dd7200700 1 -- 172.21.15.80:0/402616947 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd80d0c90 msgr2=0x7f2dd815a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.353+0000 7f2dd7200700 1 --2- 172.21.15.80:0/402616947 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd80d0c90 0x7f2dd815a690 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2dd000cbc0 tx=0x7f2dd000ced0 comp rx=0 tx=0).stop 2024-05-10T04:22:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.353+0000 7f2dd7200700 1 -- 172.21.15.80:0/402616947 shutdown_connections 2024-05-10T04:22:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.353+0000 7f2dd7200700 1 --2- 172.21.15.80:0/402616947 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2db406ac90 0x7f2db406d1a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.353+0000 7f2dd7200700 1 --2- 172.21.15.80:0/402616947 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd80d0c90 0x7f2dd815a690 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.353+0000 7f2dd7200700 1 --2- 172.21.15.80:0/402616947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dd80b6230 0x7f2dd815c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.353+0000 7f2dd7200700 1 --2- 172.21.15.80:0/402616947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dd80b98e0 0x7f2dd815a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.353+0000 7f2dd7200700 1 -- 172.21.15.80:0/402616947 >> 172.21.15.80:0/402616947 conn(0x7f2dd80676c0 msgr2=0x7f2dd80b5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.353+0000 7f2dd7200700 1 -- 172.21.15.80:0/402616947 shutdown_connections 2024-05-10T04:22:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.353+0000 7f2dd7200700 1 -- 172.21.15.80:0/402616947 wait complete. 2024-05-10T04:22:54.379 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:22:54.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.638+0000 7f6cd5200700 1 Processor -- start 2024-05-10T04:22:54.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.638+0000 7f6cd5200700 1 -- start start 2024-05-10T04:22:54.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.640+0000 7f6cd5200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cd006c160 0x7f6cd006c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:54.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.640+0000 7f6cd5200700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd00d2c00 con 0x7f6cd015e610 2024-05-10T04:22:54.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.640+0000 7f6cd5200700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd006cab0 con 0x7f6cd0162150 2024-05-10T04:22:54.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.640+0000 7f6cd5200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd015ea20 con 0x7f6cd006c160 2024-05-10T04:22:54.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.640+0000 7f6ccd400700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6cd015e610 0x7f6cd00b73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48628/0 (socket says 172.21.15.80:48628) 2024-05-10T04:22:54.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.640+0000 7f6ccd400700 1 -- 172.21.15.80:0/472887976 learned_addr learned my addr 172.21.15.80:0/472887976 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:54.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.641+0000 7f6cce800700 1 --2- 172.21.15.80:0/472887976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cd006c160 0x7f6cd006c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:54.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.641+0000 7f6ccca00700 1 -- 172.21.15.80:0/472887976 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232190828 0 0) 0x7f6cd00d2c00 con 0x7f6cd015e610 2024-05-10T04:22:54.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.641+0000 7f6ccca00700 1 -- 172.21.15.80:0/472887976 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cb40035b0 con 0x7f6cd015e610 2024-05-10T04:22:54.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.641+0000 7f6ccca00700 1 -- 172.21.15.80:0/472887976 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439894497 0 0) 0x7f6cd006cab0 con 0x7f6cd0162150 2024-05-10T04:22:54.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.641+0000 7f6ccca00700 1 -- 172.21.15.80:0/472887976 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cd00d2c00 con 0x7f6cd0162150 2024-05-10T04:22:54.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.641+0000 7f6cce800700 1 -- 172.21.15.80:0/472887976 >> v1:172.21.15.106:6789/0 conn(0x7f6cd0162150 legacy=0x7f6cd00cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:54.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.641+0000 7f6cce800700 1 -- 172.21.15.80:0/472887976 >> v1:172.21.15.80:6789/0 conn(0x7f6cd015e610 legacy=0x7f6cd00b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:54.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.641+0000 7f6cce800700 1 -- 172.21.15.80:0/472887976 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd0162630 con 0x7f6cd006c160 2024-05-10T04:22:54.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.641+0000 7f6cce800700 1 --2- 172.21.15.80:0/472887976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cd006c160 0x7f6cd006c570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009dc0 tx=0x7f6cc800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c08e5c1e82570f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:54.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.642+0000 7f6ccca00700 1 -- 172.21.15.80:0/472887976 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc800e070 con 0x7f6cd006c160 2024-05-10T04:22:54.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.642+0000 7f6ccca00700 1 -- 172.21.15.80:0/472887976 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc800bb20 con 0x7f6cd006c160 2024-05-10T04:22:54.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.642+0000 7f6ccca00700 1 -- 172.21.15.80:0/472887976 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc800be90 con 0x7f6cd006c160 2024-05-10T04:22:54.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.642+0000 7f6cd5200700 1 -- 172.21.15.80:0/472887976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cd006c160 msgr2=0x7f6cd006c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:54.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.642+0000 7f6cd5200700 1 --2- 172.21.15.80:0/472887976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cd006c160 0x7f6cd006c570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009dc0 tx=0x7f6cc800b330 comp rx=0 tx=0).stop 2024-05-10T04:22:54.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.642+0000 7f6cd5200700 1 -- 172.21.15.80:0/472887976 shutdown_connections 2024-05-10T04:22:54.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.642+0000 7f6cd5200700 1 --2- 172.21.15.80:0/472887976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cd006c160 0x7f6cd006c570 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:54.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.642+0000 7f6cd5200700 1 -- 172.21.15.80:0/472887976 >> 172.21.15.80:0/472887976 conn(0x7f6cd00d3e10 msgr2=0x7f6cd00d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:54.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.642+0000 7f6cd5200700 1 -- 172.21.15.80:0/472887976 shutdown_connections 2024-05-10T04:22:54.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.643+0000 7f6cd5200700 1 -- 172.21.15.80:0/472887976 wait complete. 2024-05-10T04:22:54.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.645+0000 7f6cd5200700 1 Processor -- start 2024-05-10T04:22:54.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.645+0000 7f6cd5200700 1 -- start start 2024-05-10T04:22:54.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.646+0000 7f6cd5200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cd006c160 0x7f6cd0150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:54.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.646+0000 7f6cd5200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cd015e610 0x7f6cd01f8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:54.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.646+0000 7f6cd5200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cd0162150 0x7f6cd00c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:54.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.646+0000 7f6cd5200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd01503e0 con 0x7f6cd015e610 2024-05-10T04:22:54.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.646+0000 7f6cd5200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd0161260 con 0x7f6cd0162150 2024-05-10T04:22:54.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.646+0000 7f6cd5200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd01511d0 con 0x7f6cd006c160 2024-05-10T04:22:54.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.646+0000 7f6ccd400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cd015e610 0x7f6cd01f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:54.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.646+0000 7f6ccd400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cd015e610 0x7f6cd01f8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35830/0 (socket says 172.21.15.80:35830) 2024-05-10T04:22:54.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.646+0000 7f6ccd400700 1 -- 172.21.15.80:0/2968571350 learned_addr learned my addr 172.21.15.80:0/2968571350 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:54.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.647+0000 7f6ccde00700 1 --2- 172.21.15.80:0/2968571350 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cd006c160 0x7f6cd0150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:54.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.647+0000 7f6cce800700 1 --2- 172.21.15.80:0/2968571350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cd0162150 0x7f6cd00c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:54.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.647+0000 7f6ccd400700 1 -- 172.21.15.80:0/2968571350 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cd006c160 msgr2=0x7f6cd0150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:54.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.647+0000 7f6ccd400700 1 --2- 172.21.15.80:0/2968571350 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cd006c160 0x7f6cd0150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:54.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.647+0000 7f6ccd400700 1 -- 172.21.15.80:0/2968571350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cd0162150 msgr2=0x7f6cd00c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:54.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.647+0000 7f6ccd400700 1 --2- 172.21.15.80:0/2968571350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cd0162150 0x7f6cd00c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:54.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.647+0000 7f6ccd400700 1 -- 172.21.15.80:0/2968571350 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc8009a70 con 0x7f6cd015e610 2024-05-10T04:22:54.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.647+0000 7f6ccde00700 1 --2- 172.21.15.80:0/2968571350 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cd006c160 0x7f6cd0150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:54.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.647+0000 7f6ccd400700 1 --2- 172.21.15.80:0/2968571350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cd015e610 0x7f6cd01f8890 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00c4d0 tx=0x7f6cbc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:54.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.647+0000 7f6cc6000700 1 -- 172.21.15.80:0/2968571350 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc005d70 con 0x7f6cd015e610 2024-05-10T04:22:54.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.647+0000 7f6cc6000700 1 -- 172.21.15.80:0/2968571350 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cbc0070d0 con 0x7f6cd015e610 2024-05-10T04:22:54.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.647+0000 7f6cd5200700 1 -- 172.21.15.80:0/2968571350 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd01f8dd0 con 0x7f6cd015e610 2024-05-10T04:22:54.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.647+0000 7f6cc6000700 1 -- 172.21.15.80:0/2968571350 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc007460 con 0x7f6cd015e610 2024-05-10T04:22:54.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.647+0000 7f6cd5200700 1 -- 172.21.15.80:0/2968571350 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd014fd20 con 0x7f6cd015e610 2024-05-10T04:22:54.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.648+0000 7f6cd5200700 1 -- 172.21.15.80:0/2968571350 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd0150520 con 0x7f6cd015e610 2024-05-10T04:22:54.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.650+0000 7f6cc6000700 1 -- 172.21.15.80:0/2968571350 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6cbc0075c0 con 0x7f6cd015e610 2024-05-10T04:22:54.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.650+0000 7f6cc6000700 1 --2- 172.21.15.80:0/2968571350 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6cb006acc0 0x7f6cb006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:54.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.651+0000 7f6cc6000700 1 -- 172.21.15.80:0/2968571350 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cbc088850 con 0x7f6cd015e610 2024-05-10T04:22:54.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.651+0000 7f6ccde00700 1 --2- 172.21.15.80:0/2968571350 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6cb006acc0 0x7f6cb006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:54.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.652+0000 7f6ccde00700 1 --2- 172.21.15.80:0/2968571350 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6cb006acc0 0x7f6cb006d1d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00011e0 tx=0x7f6cc0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:54.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.655+0000 7f6cc6000700 1 -- 172.21.15.80:0/2968571350 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6cd0150520 con 0x7f6cd015e610 2024-05-10T04:22:54.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.861+0000 7f6cd5200700 1 -- 172.21.15.80:0/2968571350 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6cd0150520 con 0x7f6cd015e610 2024-05-10T04:22:54.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.862+0000 7f6cc6000700 1 -- 172.21.15.80:0/2968571350 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6cd0150520 con 0x7f6cd015e610 2024-05-10T04:22:54.863 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-10T04:22:54.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.864+0000 7f6cd5200700 1 -- 172.21.15.80:0/2968571350 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6cb006acc0 msgr2=0x7f6cb006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:54.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.864+0000 7f6cd5200700 1 --2- 172.21.15.80:0/2968571350 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6cb006acc0 0x7f6cb006d1d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00011e0 tx=0x7f6cc0009040 comp rx=0 tx=0).stop 2024-05-10T04:22:54.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.864+0000 7f6cd5200700 1 -- 172.21.15.80:0/2968571350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cd015e610 msgr2=0x7f6cd01f8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:54.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.864+0000 7f6cd5200700 1 --2- 172.21.15.80:0/2968571350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cd015e610 0x7f6cd01f8890 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00c4d0 tx=0x7f6cbc00c890 comp rx=0 tx=0).stop 2024-05-10T04:22:54.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.864+0000 7f6cd5200700 1 -- 172.21.15.80:0/2968571350 shutdown_connections 2024-05-10T04:22:54.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.864+0000 7f6cd5200700 1 --2- 172.21.15.80:0/2968571350 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6cb006acc0 0x7f6cb006d1d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:54.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.864+0000 7f6cd5200700 1 --2- 172.21.15.80:0/2968571350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cd0162150 0x7f6cd00c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:54.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.864+0000 7f6cd5200700 1 --2- 172.21.15.80:0/2968571350 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cd006c160 0x7f6cd0150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:54.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.864+0000 7f6cd5200700 1 --2- 172.21.15.80:0/2968571350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cd015e610 0x7f6cd01f8890 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:54.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.864+0000 7f6cd5200700 1 -- 172.21.15.80:0/2968571350 >> 172.21.15.80:0/2968571350 conn(0x7f6cd00d3e10 msgr2=0x7f6cd00b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:54.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.864+0000 7f6cd5200700 1 -- 172.21.15.80:0/2968571350 shutdown_connections 2024-05-10T04:22:54.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:54.864+0000 7f6cd5200700 1 -- 172.21.15.80:0/2968571350 wait complete. 2024-05-10T04:22:54.891 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:22:55.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.150+0000 7f0194c00700 1 Processor -- start 2024-05-10T04:22:55.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.151+0000 7f0194c00700 1 -- start start 2024-05-10T04:22:55.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.152+0000 7f0194c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01900cf360 0x7f01900b9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:55.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.152+0000 7f0194c00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01900b7120 0x7f01900b7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:55.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.152+0000 7f0194c00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01900d2850 con 0x7f0190161d10 2024-05-10T04:22:55.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.152+0000 7f0194c00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01900d25b0 con 0x7f01900b7120 2024-05-10T04:22:55.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.152+0000 7f0194c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01900b7a70 con 0x7f01900cf360 2024-05-10T04:22:55.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.152+0000 7f018fe00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01900b7120 0x7f01900b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:55.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.152+0000 7f0187e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0190161d10 0x7f01900d2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48636/0 (socket says 172.21.15.80:48636) 2024-05-10T04:22:55.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.153+0000 7f0187e00700 1 -- 172.21.15.80:0/2530980699 learned_addr learned my addr 172.21.15.80:0/2530980699 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:55.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.153+0000 7f018f400700 1 --2- 172.21.15.80:0/2530980699 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01900cf360 0x7f01900b9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:55.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.153+0000 7f018fe00700 1 -- 172.21.15.80:0/2530980699 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01900cf360 msgr2=0x7f01900b9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:55.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.153+0000 7f018fe00700 1 --2- 172.21.15.80:0/2530980699 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01900cf360 0x7f01900b9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.153+0000 7f018fe00700 1 -- 172.21.15.80:0/2530980699 >> v1:172.21.15.80:6789/0 conn(0x7f0190161d10 legacy=0x7f01900d2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:55.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.153+0000 7f018fe00700 1 -- 172.21.15.80:0/2530980699 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01900cf770 con 0x7f01900b7120 2024-05-10T04:22:55.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.153+0000 7f018ea00700 1 -- 172.21.15.80:0/2530980699 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566901594 0 0) 0x7f01900d2850 con 0x7f0190161d10 2024-05-10T04:22:55.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.153+0000 7f018fe00700 1 --2- 172.21.15.80:0/2530980699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01900b7120 0x7f01900b7530 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0188009d90 tx=0x7f018800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14ccfe44e996cbb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:55.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.153+0000 7f018ea00700 1 -- 172.21.15.80:0/2530980699 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018800e070 con 0x7f01900b7120 2024-05-10T04:22:55.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.154+0000 7f018ea00700 1 -- 172.21.15.80:0/2530980699 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018800bb20 con 0x7f01900b7120 2024-05-10T04:22:55.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.154+0000 7f018ea00700 1 -- 172.21.15.80:0/2530980699 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188012430 con 0x7f01900b7120 2024-05-10T04:22:55.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.154+0000 7f0194c00700 1 -- 172.21.15.80:0/2530980699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01900b7120 msgr2=0x7f01900b7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:55.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.154+0000 7f0194c00700 1 --2- 172.21.15.80:0/2530980699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01900b7120 0x7f01900b7530 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0188009d90 tx=0x7f018800b330 comp rx=0 tx=0).stop 2024-05-10T04:22:55.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.154+0000 7f0194c00700 1 -- 172.21.15.80:0/2530980699 shutdown_connections 2024-05-10T04:22:55.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.154+0000 7f0194c00700 1 --2- 172.21.15.80:0/2530980699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01900b7120 0x7f01900b7530 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.154+0000 7f0194c00700 1 --2- 172.21.15.80:0/2530980699 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01900cf360 0x7f01900b9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.154+0000 7f0194c00700 1 -- 172.21.15.80:0/2530980699 >> 172.21.15.80:0/2530980699 conn(0x7f019006c4e0 msgr2=0x7f019006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:55.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.154+0000 7f0194c00700 1 -- 172.21.15.80:0/2530980699 shutdown_connections 2024-05-10T04:22:55.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.154+0000 7f0194c00700 1 -- 172.21.15.80:0/2530980699 wait complete. 2024-05-10T04:22:55.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.157+0000 7f0194c00700 1 Processor -- start 2024-05-10T04:22:55.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.157+0000 7f0194c00700 1 -- start start 2024-05-10T04:22:55.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.158+0000 7f0194c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01900b7120 0x7f01901576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:55.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.158+0000 7f0194c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01900cf360 0x7f01900c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:55.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.158+0000 7f0194c00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0190161d10 0x7f019015e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:55.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.158+0000 7f0194c00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0190158190 con 0x7f01900b7120 2024-05-10T04:22:55.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.158+0000 7f0194c00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01900c85f0 con 0x7f0190161d10 2024-05-10T04:22:55.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.158+0000 7f0194c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01900c7720 con 0x7f01900cf360 2024-05-10T04:22:55.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.158+0000 7f018f400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01900b7120 0x7f01901576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:55.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.159+0000 7f018f400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01900b7120 0x7f01901576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35838/0 (socket says 172.21.15.80:35838) 2024-05-10T04:22:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.159+0000 7f018f400700 1 -- 172.21.15.80:0/532722315 learned_addr learned my addr 172.21.15.80:0/532722315 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.159+0000 7f018f400700 1 -- 172.21.15.80:0/532722315 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01900cf360 msgr2=0x7f01900c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.159+0000 7f018f400700 1 --2- 172.21.15.80:0/532722315 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01900cf360 0x7f01900c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.159+0000 7f018f400700 1 -- 172.21.15.80:0/532722315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0190161d10 msgr2=0x7f019015e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.159+0000 7f018f400700 1 --2- 172.21.15.80:0/532722315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0190161d10 0x7f019015e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.159+0000 7f018f400700 1 -- 172.21.15.80:0/532722315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0188009a70 con 0x7f01900b7120 2024-05-10T04:22:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.159+0000 7f018f400700 1 --2- 172.21.15.80:0/532722315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01900b7120 0x7f01901576e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f018000e840 tx=0x7f018000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.159+0000 7f0187400700 1 -- 172.21.15.80:0/532722315 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180009590 con 0x7f01900b7120 2024-05-10T04:22:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.159+0000 7f0187400700 1 -- 172.21.15.80:0/532722315 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0180013680 con 0x7f01900b7120 2024-05-10T04:22:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.159+0000 7f0194c00700 1 -- 172.21.15.80:0/532722315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01900c79e0 con 0x7f01900b7120 2024-05-10T04:22:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.159+0000 7f0187400700 1 -- 172.21.15.80:0/532722315 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180013a10 con 0x7f01900b7120 2024-05-10T04:22:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.160+0000 7f0194c00700 1 -- 172.21.15.80:0/532722315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01900c7fa0 con 0x7f01900b7120 2024-05-10T04:22:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.160+0000 7f0194c00700 1 -- 172.21.15.80:0/532722315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0190074af0 con 0x7f01900b7120 2024-05-10T04:22:55.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.161+0000 7f0187400700 1 -- 172.21.15.80:0/532722315 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0180013b70 con 0x7f01900b7120 2024-05-10T04:22:55.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.162+0000 7f0187400700 1 --2- 172.21.15.80:0/532722315 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f016c06ac90 0x7f016c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:55.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.162+0000 7f0187400700 1 -- 172.21.15.80:0/532722315 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0180089340 con 0x7f01900b7120 2024-05-10T04:22:55.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.163+0000 7f0187e00700 1 --2- 172.21.15.80:0/532722315 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f016c06ac90 0x7f016c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:55.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.163+0000 7f0187e00700 1 --2- 172.21.15.80:0/532722315 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f016c06ac90 0x7f016c06d1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0190159db0 tx=0x7f01780079f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:55.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.167+0000 7f0187400700 1 -- 172.21.15.80:0/532722315 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0180054490 con 0x7f01900b7120 2024-05-10T04:22:55.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.416+0000 7f0194c00700 1 -- 172.21.15.80:0/532722315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01900b82a0 con 0x7f01900b7120 2024-05-10T04:22:55.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.417+0000 7f0187400700 1 -- 172.21.15.80:0/532722315 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4731 (secure 0 0 0) 0x7f0180057ab0 con 0x7f01900b7120 2024-05-10T04:22:55.418 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:55.418 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4189316245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4189316245},{"type":"v1","addr":"172.21.15.106:6836","nonce":4189316245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/4150483341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":4150483341},{"type":"v1","addr":"172.21.15.80:6833","nonce":4150483341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1287697381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1287697381},{"type":"v1","addr":"172.21.15.80:6835","nonce":1287697381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:22:37.482943+0000","modified":"2024-05-10T04:22:40.916280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/961352916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":961352916},{"type":"v1","addr":"172.21.15.106:6837","nonce":961352916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:22:55.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.419+0000 7f0194c00700 1 -- 172.21.15.80:0/532722315 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f016c06ac90 msgr2=0x7f016c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:55.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.419+0000 7f0194c00700 1 --2- 172.21.15.80:0/532722315 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f016c06ac90 0x7f016c06d1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0190159db0 tx=0x7f01780079f0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.419+0000 7f0194c00700 1 -- 172.21.15.80:0/532722315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01900b7120 msgr2=0x7f01901576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:55.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.419+0000 7f0194c00700 1 --2- 172.21.15.80:0/532722315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01900b7120 0x7f01901576e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f018000e840 tx=0x7f018000ec00 comp rx=0 tx=0).stop 2024-05-10T04:22:55.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.419+0000 7f0194c00700 1 -- 172.21.15.80:0/532722315 shutdown_connections 2024-05-10T04:22:55.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.419+0000 7f0194c00700 1 --2- 172.21.15.80:0/532722315 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f016c06ac90 0x7f016c06d1a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.419+0000 7f0194c00700 1 --2- 172.21.15.80:0/532722315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01900b7120 0x7f01901576e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.419+0000 7f0194c00700 1 --2- 172.21.15.80:0/532722315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0190161d10 0x7f019015e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.419+0000 7f0194c00700 1 --2- 172.21.15.80:0/532722315 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01900cf360 0x7f01900c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.419+0000 7f0194c00700 1 -- 172.21.15.80:0/532722315 >> 172.21.15.80:0/532722315 conn(0x7f019006c4e0 msgr2=0x7f01900b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:55.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.419+0000 7f0194c00700 1 -- 172.21.15.80:0/532722315 shutdown_connections 2024-05-10T04:22:55.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.419+0000 7f0194c00700 1 -- 172.21.15.80:0/532722315 wait complete. 2024-05-10T04:22:55.422 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2024-05-10T04:22:55.447 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:22:55.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.704+0000 7f5d51200700 1 Processor -- start 2024-05-10T04:22:55.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.704+0000 7f5d51200700 1 -- start start 2024-05-10T04:22:55.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.706+0000 7f5d51200700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5d4c0b2f50 0x7f5d4c161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:55.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.706+0000 7f5d51200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d4c0d0d40 0x7f5d4c0d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:55.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.706+0000 7f5d51200700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c0d28c0 con 0x7f5d4c0d3030 2024-05-10T04:22:55.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.706+0000 7f5d51200700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4c0b3360 con 0x7f5d4c0b2f50 2024-05-10T04:22:55.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.706+0000 7f5d51200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c1624e0 con 0x7f5d4c0d0d40 2024-05-10T04:22:55.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.706+0000 7f5d49400700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5d4c0d3030 0x7f5d4c0d0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48638/0 (socket says 172.21.15.80:48638) 2024-05-10T04:22:55.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.706+0000 7f5d49400700 1 -- 172.21.15.80:0/1110144082 learned_addr learned my addr 172.21.15.80:0/1110144082 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:55.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.706+0000 7f5d49e00700 1 --2- 172.21.15.80:0/1110144082 >> v2:172.21.15.106:3300/0 conn(0x7f5d4c0b2f50 0x7f5d4c161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:55.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.706+0000 7f5d4a800700 1 --2- 172.21.15.80:0/1110144082 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d4c0d0d40 0x7f5d4c0d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:55.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.706+0000 7f5d48a00700 1 -- 172.21.15.80:0/1110144082 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966852866 0 0) 0x7f5d4c0d28c0 con 0x7f5d4c0d3030 2024-05-10T04:22:55.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.706+0000 7f5d48a00700 1 -- 172.21.15.80:0/1110144082 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d300035b0 con 0x7f5d4c0d3030 2024-05-10T04:22:55.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.706+0000 7f5d4a800700 1 -- 172.21.15.80:0/1110144082 >> v2:172.21.15.106:3300/0 conn(0x7f5d4c0b2f50 msgr2=0x7f5d4c161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:55.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.706+0000 7f5d4a800700 1 --2- 172.21.15.80:0/1110144082 >> v2:172.21.15.106:3300/0 conn(0x7f5d4c0b2f50 0x7f5d4c161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.707+0000 7f5d4a800700 1 -- 172.21.15.80:0/1110144082 >> v1:172.21.15.80:6789/0 conn(0x7f5d4c0d3030 legacy=0x7f5d4c0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:55.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.707+0000 7f5d4a800700 1 -- 172.21.15.80:0/1110144082 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c0d2ba0 con 0x7f5d4c0d0d40 2024-05-10T04:22:55.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.707+0000 7f5d49e00700 1 --2- 172.21.15.80:0/1110144082 >> v2:172.21.15.106:3300/0 conn(0x7f5d4c0b2f50 0x7f5d4c161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:55.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.707+0000 7f5d4a800700 1 --2- 172.21.15.80:0/1110144082 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d4c0d0d40 0x7f5d4c0d3440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009d90 tx=0x7f5d4400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69b848a55c736507 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:55.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.707+0000 7f5d48a00700 1 -- 172.21.15.80:0/1110144082 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400e070 con 0x7f5d4c0d0d40 2024-05-10T04:22:55.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.707+0000 7f5d48a00700 1 -- 172.21.15.80:0/1110144082 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4400bb20 con 0x7f5d4c0d0d40 2024-05-10T04:22:55.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.707+0000 7f5d48a00700 1 -- 172.21.15.80:0/1110144082 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400be90 con 0x7f5d4c0d0d40 2024-05-10T04:22:55.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.708+0000 7f5d51200700 1 -- 172.21.15.80:0/1110144082 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d4c0d0d40 msgr2=0x7f5d4c0d3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:55.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.708+0000 7f5d51200700 1 --2- 172.21.15.80:0/1110144082 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d4c0d0d40 0x7f5d4c0d3440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009d90 tx=0x7f5d4400b330 comp rx=0 tx=0).stop 2024-05-10T04:22:55.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.708+0000 7f5d51200700 1 -- 172.21.15.80:0/1110144082 shutdown_connections 2024-05-10T04:22:55.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.708+0000 7f5d51200700 1 --2- 172.21.15.80:0/1110144082 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d4c0d0d40 0x7f5d4c0d3440 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.708+0000 7f5d51200700 1 --2- 172.21.15.80:0/1110144082 >> v2:172.21.15.106:3300/0 conn(0x7f5d4c0b2f50 0x7f5d4c161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.708+0000 7f5d51200700 1 -- 172.21.15.80:0/1110144082 >> 172.21.15.80:0/1110144082 conn(0x7f5d4c06c3f0 msgr2=0x7f5d4c06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:55.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.708+0000 7f5d51200700 1 -- 172.21.15.80:0/1110144082 shutdown_connections 2024-05-10T04:22:55.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.708+0000 7f5d51200700 1 -- 172.21.15.80:0/1110144082 wait complete. 2024-05-10T04:22:55.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.711+0000 7f5d51200700 1 Processor -- start 2024-05-10T04:22:55.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.711+0000 7f5d51200700 1 -- start start 2024-05-10T04:22:55.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.713+0000 7f5d51200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d4c0b2f50 0x7f5d4c1501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:55.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.713+0000 7f5d51200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d4c0d0d40 0x7f5d4c0cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:55.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.713+0000 7f5d51200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d4c0d3030 0x7f5d4c0cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:55.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.713+0000 7f5d51200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0c9940 con 0x7f5d4c0b2f50 2024-05-10T04:22:55.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.713+0000 7f5d51200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0c7e90 con 0x7f5d4c0d0d40 2024-05-10T04:22:55.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.713+0000 7f5d51200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0c8170 con 0x7f5d4c0d3030 2024-05-10T04:22:55.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.713+0000 7f5d49e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d4c0b2f50 0x7f5d4c1501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:55.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.713+0000 7f5d49e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d4c0b2f50 0x7f5d4c1501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35846/0 (socket says 172.21.15.80:35846) 2024-05-10T04:22:55.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.713+0000 7f5d49e00700 1 -- 172.21.15.80:0/1355221493 learned_addr learned my addr 172.21.15.80:0/1355221493 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:55.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.713+0000 7f5d49400700 1 --2- 172.21.15.80:0/1355221493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d4c0d0d40 0x7f5d4c0cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:55.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.713+0000 7f5d4a800700 1 --2- 172.21.15.80:0/1355221493 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d4c0d3030 0x7f5d4c0cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:55.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.713+0000 7f5d49e00700 1 -- 172.21.15.80:0/1355221493 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d4c0d3030 msgr2=0x7f5d4c0cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:55.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.713+0000 7f5d49e00700 1 --2- 172.21.15.80:0/1355221493 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d4c0d3030 0x7f5d4c0cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.713+0000 7f5d49e00700 1 -- 172.21.15.80:0/1355221493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d4c0d0d40 msgr2=0x7f5d4c0cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:55.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.713+0000 7f5d49e00700 1 --2- 172.21.15.80:0/1355221493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d4c0d0d40 0x7f5d4c0cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.713+0000 7f5d49e00700 1 -- 172.21.15.80:0/1355221493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c0094a0 con 0x7f5d4c0b2f50 2024-05-10T04:22:55.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.713+0000 7f5d49400700 1 --2- 172.21.15.80:0/1355221493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d4c0d0d40 0x7f5d4c0cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:55.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.714+0000 7f5d49e00700 1 --2- 172.21.15.80:0/1355221493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d4c0b2f50 0x7f5d4c1501a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00e9b0 tx=0x7f5d3c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:55.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.714+0000 7f5d42000700 1 -- 172.21.15.80:0/1355221493 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c00c850 con 0x7f5d4c0b2f50 2024-05-10T04:22:55.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.714+0000 7f5d42000700 1 -- 172.21.15.80:0/1355221493 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c00c9b0 con 0x7f5d4c0b2f50 2024-05-10T04:22:55.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.714+0000 7f5d42000700 1 -- 172.21.15.80:0/1355221493 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c00cd20 con 0x7f5d4c0b2f50 2024-05-10T04:22:55.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.714+0000 7f5d51200700 1 -- 172.21.15.80:0/1355221493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d44009a70 con 0x7f5d4c0b2f50 2024-05-10T04:22:55.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.714+0000 7f5d51200700 1 -- 172.21.15.80:0/1355221493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4c0cd220 con 0x7f5d4c0b2f50 2024-05-10T04:22:55.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.715+0000 7f5d51200700 1 -- 172.21.15.80:0/1355221493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4c0c9780 con 0x7f5d4c0b2f50 2024-05-10T04:22:55.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.716+0000 7f5d42000700 1 -- 172.21.15.80:0/1355221493 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5d3c013470 con 0x7f5d4c0b2f50 2024-05-10T04:22:55.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.717+0000 7f5d42000700 1 --2- 172.21.15.80:0/1355221493 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5d2c06acc0 0x7f5d2c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:55.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.717+0000 7f5d42000700 1 -- 172.21.15.80:0/1355221493 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d3c0893a0 con 0x7f5d4c0b2f50 2024-05-10T04:22:55.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.717+0000 7f5d49400700 1 --2- 172.21.15.80:0/1355221493 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5d2c06acc0 0x7f5d2c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:55.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.718+0000 7f5d49400700 1 --2- 172.21.15.80:0/1355221493 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5d2c06acc0 0x7f5d2c06d1d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c161610 tx=0x7f5d38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.721+0000 7f5d42000700 1 -- 172.21.15.80:0/1355221493 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5d4c0c9780 con 0x7f5d4c0b2f50 2024-05-10T04:22:55.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.926+0000 7f5d51200700 1 -- 172.21.15.80:0/1355221493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d4c0c9780 con 0x7f5d4c0b2f50 2024-05-10T04:22:55.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.928+0000 7f5d42000700 1 -- 172.21.15.80:0/1355221493 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f5d4c0c9780 con 0x7f5d4c0b2f50 2024-05-10T04:22:55.929 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:55.929 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:38.485422+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:22:55.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.930+0000 7f5d51200700 1 -- 172.21.15.80:0/1355221493 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5d2c06acc0 msgr2=0x7f5d2c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:55.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.930+0000 7f5d51200700 1 --2- 172.21.15.80:0/1355221493 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5d2c06acc0 0x7f5d2c06d1d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c161610 tx=0x7f5d38009040 comp rx=0 tx=0).stop 2024-05-10T04:22:55.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.930+0000 7f5d51200700 1 -- 172.21.15.80:0/1355221493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d4c0b2f50 msgr2=0x7f5d4c1501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:55.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.930+0000 7f5d51200700 1 --2- 172.21.15.80:0/1355221493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d4c0b2f50 0x7f5d4c1501a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00e9b0 tx=0x7f5d3c00ecc0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.930+0000 7f5d51200700 1 -- 172.21.15.80:0/1355221493 shutdown_connections 2024-05-10T04:22:55.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.930+0000 7f5d51200700 1 --2- 172.21.15.80:0/1355221493 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5d2c06acc0 0x7f5d2c06d1d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.930+0000 7f5d51200700 1 --2- 172.21.15.80:0/1355221493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d4c0b2f50 0x7f5d4c1501a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.930+0000 7f5d51200700 1 --2- 172.21.15.80:0/1355221493 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d4c0d3030 0x7f5d4c0cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.930+0000 7f5d51200700 1 --2- 172.21.15.80:0/1355221493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d4c0d0d40 0x7f5d4c0cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:55.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.930+0000 7f5d51200700 1 -- 172.21.15.80:0/1355221493 >> 172.21.15.80:0/1355221493 conn(0x7f5d4c06c3f0 msgr2=0x7f5d4c0b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:55.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.930+0000 7f5d51200700 1 -- 172.21.15.80:0/1355221493 shutdown_connections 2024-05-10T04:22:55.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:55.930+0000 7f5d51200700 1 -- 172.21.15.80:0/1355221493 wait complete. 2024-05-10T04:22:55.958 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:22:56.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.214+0000 7efd12e00700 1 Processor -- start 2024-05-10T04:22:56.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.215+0000 7efd12e00700 1 -- start start 2024-05-10T04:22:56.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.216+0000 7efd12e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efd0c162970 0x7efd0c0d2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:56.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.216+0000 7efd12e00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0c161f20 con 0x7efd0c0d0e60 2024-05-10T04:22:56.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.216+0000 7efd12e00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0c15f3f0 con 0x7efd0c0cf510 2024-05-10T04:22:56.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.216+0000 7efd12e00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd0c15f6d0 con 0x7efd0c162970 2024-05-10T04:22:56.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.216+0000 7efd10e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efd0c162970 0x7efd0c0d2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:56.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.216+0000 7efd03e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efd0c0d0e60 0x7efd0c0d2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48654/0 (socket says 172.21.15.80:48654) 2024-05-10T04:22:56.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.216+0000 7efd03e00700 1 -- 172.21.15.80:0/1407951817 learned_addr learned my addr 172.21.15.80:0/1407951817 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:56.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.217+0000 7efd0b400700 1 -- 172.21.15.80:0/1407951817 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676654101 0 0) 0x7efd0c161f20 con 0x7efd0c0d0e60 2024-05-10T04:22:56.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.217+0000 7efd0b400700 1 -- 172.21.15.80:0/1407951817 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcf00035b0 con 0x7efd0c0d0e60 2024-05-10T04:22:56.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.217+0000 7efd10e00700 1 -- 172.21.15.80:0/1407951817 >> v1:172.21.15.106:6789/0 conn(0x7efd0c0cf510 legacy=0x7efd0c0d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:56.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.217+0000 7efd10e00700 1 -- 172.21.15.80:0/1407951817 >> v1:172.21.15.80:6789/0 conn(0x7efd0c0d0e60 legacy=0x7efd0c0d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:56.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.217+0000 7efd10e00700 1 -- 172.21.15.80:0/1407951817 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c162170 con 0x7efd0c162970 2024-05-10T04:22:56.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.217+0000 7efd10e00700 1 --2- 172.21.15.80:0/1407951817 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd0c162970 0x7efd0c0d2e90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efd04009d90 tx=0x7efd0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd28819ae847e10 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:56.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.217+0000 7efd0b400700 1 -- 172.21.15.80:0/1407951817 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0400e070 con 0x7efd0c162970 2024-05-10T04:22:56.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.217+0000 7efd0b400700 1 -- 172.21.15.80:0/1407951817 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0400bb20 con 0x7efd0c162970 2024-05-10T04:22:56.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.217+0000 7efd0b400700 1 -- 172.21.15.80:0/1407951817 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd04012430 con 0x7efd0c162970 2024-05-10T04:22:56.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.218+0000 7efd12e00700 1 -- 172.21.15.80:0/1407951817 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd0c162970 msgr2=0x7efd0c0d2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:56.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.218+0000 7efd12e00700 1 --2- 172.21.15.80:0/1407951817 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd0c162970 0x7efd0c0d2e90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efd04009d90 tx=0x7efd0400b330 comp rx=0 tx=0).stop 2024-05-10T04:22:56.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.218+0000 7efd12e00700 1 -- 172.21.15.80:0/1407951817 shutdown_connections 2024-05-10T04:22:56.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.218+0000 7efd12e00700 1 --2- 172.21.15.80:0/1407951817 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd0c162970 0x7efd0c0d2e90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:56.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.218+0000 7efd12e00700 1 -- 172.21.15.80:0/1407951817 >> 172.21.15.80:0/1407951817 conn(0x7efd0c06c410 msgr2=0x7efd0c06c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:56.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.218+0000 7efd12e00700 1 -- 172.21.15.80:0/1407951817 shutdown_connections 2024-05-10T04:22:56.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.218+0000 7efd12e00700 1 -- 172.21.15.80:0/1407951817 wait complete. 2024-05-10T04:22:56.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.220+0000 7efd12e00700 1 Processor -- start 2024-05-10T04:22:56.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.221+0000 7efd12e00700 1 -- start start 2024-05-10T04:22:56.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.222+0000 7efd12e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd0c0cf510 0x7efd0c161290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:56.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.222+0000 7efd12e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0c0d0e60 0x7efd0c0b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:56.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.222+0000 7efd12e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd0c162970 0x7efd0c0b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:56.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.222+0000 7efd12e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0ca150 con 0x7efd0c0cf510 2024-05-10T04:22:56.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.222+0000 7efd12e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0cb040 con 0x7efd0c0d0e60 2024-05-10T04:22:56.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.222+0000 7efd12e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0c8980 con 0x7efd0c162970 2024-05-10T04:22:56.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.222+0000 7efd0be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd0c0cf510 0x7efd0c161290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:56.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.222+0000 7efd0be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd0c0cf510 0x7efd0c161290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35862/0 (socket says 172.21.15.80:35862) 2024-05-10T04:22:56.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.222+0000 7efd0be00700 1 -- 172.21.15.80:0/1735503558 learned_addr learned my addr 172.21.15.80:0/1735503558 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:56.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.222+0000 7efd03e00700 1 --2- 172.21.15.80:0/1735503558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0c0d0e60 0x7efd0c0b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:56.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.222+0000 7efd10e00700 1 --2- 172.21.15.80:0/1735503558 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd0c162970 0x7efd0c0b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:56.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.223+0000 7efd0be00700 1 -- 172.21.15.80:0/1735503558 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd0c162970 msgr2=0x7efd0c0b4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:56.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.223+0000 7efd0be00700 1 --2- 172.21.15.80:0/1735503558 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd0c162970 0x7efd0c0b4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:56.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.223+0000 7efd0be00700 1 -- 172.21.15.80:0/1735503558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0c0d0e60 msgr2=0x7efd0c0b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:56.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.223+0000 7efd0be00700 1 --2- 172.21.15.80:0/1735503558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0c0d0e60 0x7efd0c0b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:56.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.223+0000 7efd0be00700 1 -- 172.21.15.80:0/1735503558 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd04009a70 con 0x7efd0c0cf510 2024-05-10T04:22:56.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.223+0000 7efd10e00700 1 --2- 172.21.15.80:0/1735503558 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd0c162970 0x7efd0c0b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:56.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.223+0000 7efd0be00700 1 --2- 172.21.15.80:0/1735503558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd0c0cf510 0x7efd0c161290 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c480 tx=0x7efcfc00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:56.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.223+0000 7efd08c00700 1 -- 172.21.15.80:0/1735503558 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0052d0 con 0x7efd0c0cf510 2024-05-10T04:22:56.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.223+0000 7efd08c00700 1 -- 172.21.15.80:0/1735503558 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc005430 con 0x7efd0c0cf510 2024-05-10T04:22:56.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.223+0000 7efd12e00700 1 -- 172.21.15.80:0/1735503558 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0c0cae20 con 0x7efd0c0cf510 2024-05-10T04:22:56.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.223+0000 7efd08c00700 1 -- 172.21.15.80:0/1735503558 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0038c0 con 0x7efd0c0cf510 2024-05-10T04:22:56.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.223+0000 7efd12e00700 1 -- 172.21.15.80:0/1735503558 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0c0cb290 con 0x7efd0c0cf510 2024-05-10T04:22:56.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.224+0000 7efd12e00700 1 -- 172.21.15.80:0/1735503558 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0c074af0 con 0x7efd0c0cf510 2024-05-10T04:22:56.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.225+0000 7efd08c00700 1 -- 172.21.15.80:0/1735503558 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efcfc003a20 con 0x7efd0c0cf510 2024-05-10T04:22:56.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.226+0000 7efd08c00700 1 --2- 172.21.15.80:0/1735503558 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efce806acc0 0x7efce806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:56.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.226+0000 7efd08c00700 1 -- 172.21.15.80:0/1735503558 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcfc0887e0 con 0x7efd0c0cf510 2024-05-10T04:22:56.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.227+0000 7efd03e00700 1 --2- 172.21.15.80:0/1735503558 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efce806acc0 0x7efce806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:56.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.227+0000 7efd03e00700 1 --2- 172.21.15.80:0/1735503558 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efce806acc0 0x7efce806d1d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efd0c0d4960 tx=0x7efcf4007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:56.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.231+0000 7efd08c00700 1 -- 172.21.15.80:0/1735503558 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7efcfc053890 con 0x7efd0c0cf510 2024-05-10T04:22:56.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.478+0000 7efd12e00700 1 -- 172.21.15.80:0/1735503558 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd0c0c8ac0 con 0x7efd0c0cf510 2024-05-10T04:22:56.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.478+0000 7efd08c00700 1 -- 172.21.15.80:0/1735503558 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4731 (secure 0 0 0) 0x7efcfc017090 con 0x7efd0c0cf510 2024-05-10T04:22:56.479 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:22:56.479 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4189316245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4189316245},{"type":"v1","addr":"172.21.15.106:6836","nonce":4189316245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/4150483341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":4150483341},{"type":"v1","addr":"172.21.15.80:6833","nonce":4150483341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1287697381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1287697381},{"type":"v1","addr":"172.21.15.80:6835","nonce":1287697381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:22:37.482943+0000","modified":"2024-05-10T04:22:40.916280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/961352916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":961352916},{"type":"v1","addr":"172.21.15.106:6837","nonce":961352916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:22:56.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.480+0000 7efd12e00700 1 -- 172.21.15.80:0/1735503558 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efce806acc0 msgr2=0x7efce806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:56.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.480+0000 7efd12e00700 1 --2- 172.21.15.80:0/1735503558 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efce806acc0 0x7efce806d1d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efd0c0d4960 tx=0x7efcf4007dc0 comp rx=0 tx=0).stop 2024-05-10T04:22:56.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.480+0000 7efd12e00700 1 -- 172.21.15.80:0/1735503558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd0c0cf510 msgr2=0x7efd0c161290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:56.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.480+0000 7efd12e00700 1 --2- 172.21.15.80:0/1735503558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd0c0cf510 0x7efd0c161290 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c480 tx=0x7efcfc00c790 comp rx=0 tx=0).stop 2024-05-10T04:22:56.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.481+0000 7efd12e00700 1 -- 172.21.15.80:0/1735503558 shutdown_connections 2024-05-10T04:22:56.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.481+0000 7efd12e00700 1 --2- 172.21.15.80:0/1735503558 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efce806acc0 0x7efce806d1d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:56.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.481+0000 7efd12e00700 1 --2- 172.21.15.80:0/1735503558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd0c0cf510 0x7efd0c161290 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:56.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.481+0000 7efd12e00700 1 --2- 172.21.15.80:0/1735503558 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd0c162970 0x7efd0c0b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:56.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.481+0000 7efd12e00700 1 --2- 172.21.15.80:0/1735503558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0c0d0e60 0x7efd0c0b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:56.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.481+0000 7efd12e00700 1 -- 172.21.15.80:0/1735503558 >> 172.21.15.80:0/1735503558 conn(0x7efd0c06c410 msgr2=0x7efd0c0d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:56.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.481+0000 7efd12e00700 1 -- 172.21.15.80:0/1735503558 shutdown_connections 2024-05-10T04:22:56.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:56.481+0000 7efd12e00700 1 -- 172.21.15.80:0/1735503558 wait complete. 2024-05-10T04:22:56.483 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2024-05-10T04:22:56.910 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T04:22:37.482943+0000', 'modified': '2024-05-10T04:22:40.916280+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.106:6837/961352916', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6835', 'nonce': 961352916}, {'type': 'v1', 'addr': '172.21.15.106:6837', 'nonce': 961352916}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-10T04:22:56.911 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T04:22:56.911 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-10T04:22:57.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.177+0000 7f909ea00700 1 Processor -- start 2024-05-10T04:22:57.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.177+0000 7f909ea00700 1 -- start start 2024-05-10T04:22:57.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.178+0000 7f909ea00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9098162150 0x7f909815e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.178+0000 7f909ea00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90980d2c00 con 0x7f90980cf4d0 2024-05-10T04:22:57.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.178+0000 7f909ea00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9098162630 con 0x7f909806c160 2024-05-10T04:22:57.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.178+0000 7f909ea00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9098162910 con 0x7f9098162150 2024-05-10T04:22:57.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.179+0000 7f908fe00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f90980cf4d0 0x7f90980b73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48658/0 (socket says 172.21.15.80:48658) 2024-05-10T04:22:57.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.179+0000 7f908fe00700 1 -- 172.21.15.80:0/857890939 learned_addr learned my addr 172.21.15.80:0/857890939 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:57.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.179+0000 7f9097e00700 1 --2- 172.21.15.80:0/857890939 >> v2:172.21.15.106:3300/0 conn(0x7f9098162150 0x7f909815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.179+0000 7f9097400700 1 -- 172.21.15.80:0/857890939 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115704988 0 0) 0x7f90980d2c00 con 0x7f90980cf4d0 2024-05-10T04:22:57.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.179+0000 7f9097400700 1 -- 172.21.15.80:0/857890939 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f907c0035b0 con 0x7f90980cf4d0 2024-05-10T04:22:57.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.179+0000 7f9097400700 1 -- 172.21.15.80:0/857890939 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276009934 0 0) 0x7f9098162630 con 0x7f909806c160 2024-05-10T04:22:57.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.179+0000 7f9097400700 1 -- 172.21.15.80:0/857890939 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90980d2c00 con 0x7f909806c160 2024-05-10T04:22:57.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.179+0000 7f9097400700 1 -- 172.21.15.80:0/857890939 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1692006266 0 0) 0x7f907c0035b0 con 0x7f90980cf4d0 2024-05-10T04:22:57.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.179+0000 7f9097400700 1 -- 172.21.15.80:0/857890939 >> v2:172.21.15.106:3300/0 conn(0x7f9098162150 msgr2=0x7f909815e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:57.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.179+0000 7f9097400700 1 --2- 172.21.15.80:0/857890939 >> v2:172.21.15.106:3300/0 conn(0x7f9098162150 0x7f909815e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.179+0000 7f9097400700 1 -- 172.21.15.80:0/857890939 >> v1:172.21.15.106:6789/0 conn(0x7f909806c160 legacy=0x7f909806c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:57.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.179+0000 7f9097400700 1 -- 172.21.15.80:0/857890939 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9098162bf0 con 0x7f90980cf4d0 2024-05-10T04:22:57.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.179+0000 7f9097400700 1 -- 172.21.15.80:0/857890939 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7f9080001670 con 0x7f90980cf4d0 2024-05-10T04:22:57.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.179+0000 7f9097e00700 1 --2- 172.21.15.80:0/857890939 >> v2:172.21.15.106:3300/0 conn(0x7f9098162150 0x7f909815e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:57.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f9097400700 1 -- 172.21.15.80:0/857890939 >> v1:172.21.15.80:6789/0 conn(0x7f90980cf4d0 legacy=0x7f90980b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:57.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f9097400700 1 --2- 172.21.15.80:0/857890939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f907c003be0 0x7f907c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f9097400700 1 --2- 172.21.15.80:0/857890939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f907c004850 0x7f907c004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f9097400700 1 --2- 172.21.15.80:0/857890939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f907c005370 0x7f907c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f9097400700 1 -- 172.21.15.80:0/857890939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9098162910 con 0x7f907c003be0 2024-05-10T04:22:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f9097400700 1 -- 172.21.15.80:0/857890939 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907c00c310 con 0x7f907c004850 2024-05-10T04:22:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f9097400700 1 -- 172.21.15.80:0/857890939 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907c00c4d0 con 0x7f907c005370 2024-05-10T04:22:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f9097e00700 1 --2- 172.21.15.80:0/857890939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f907c003be0 0x7f907c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f908fe00700 1 --2- 172.21.15.80:0/857890939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f907c004850 0x7f907c004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f909ca00700 1 --2- 172.21.15.80:0/857890939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f907c005370 0x7f907c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f9097e00700 1 -- 172.21.15.80:0/857890939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f907c005370 msgr2=0x7f907c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f9097e00700 1 --2- 172.21.15.80:0/857890939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f907c005370 0x7f907c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f9097e00700 1 -- 172.21.15.80:0/857890939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f907c004850 msgr2=0x7f907c004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f9097e00700 1 --2- 172.21.15.80:0/857890939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f907c004850 0x7f907c004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f9097e00700 1 -- 172.21.15.80:0/857890939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907c0035b0 con 0x7f907c003be0 2024-05-10T04:22:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f909ca00700 1 -- 172.21.15.80:0/857890939 reap_dead start 2024-05-10T04:22:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f908fe00700 1 --2- 172.21.15.80:0/857890939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f907c004850 0x7f907c004c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.180+0000 7f9097e00700 1 --2- 172.21.15.80:0/857890939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f907c003be0 0x7f907c004030 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9088009d00 tx=0x7f907c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b83f6ba3b7f9cc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.181+0000 7f9097400700 1 -- 172.21.15.80:0/857890939 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9088009e50 con 0x7f907c003be0 2024-05-10T04:22:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.181+0000 7f9097400700 1 -- 172.21.15.80:0/857890939 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908800e9a0 con 0x7f907c003be0 2024-05-10T04:22:57.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.181+0000 7f9097400700 1 -- 172.21.15.80:0/857890939 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908800ed10 con 0x7f907c003be0 2024-05-10T04:22:57.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.181+0000 7f909ea00700 1 -- 172.21.15.80:0/857890939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f907c003be0 msgr2=0x7f907c004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:57.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.181+0000 7f909ea00700 1 --2- 172.21.15.80:0/857890939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f907c003be0 0x7f907c004030 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9088009d00 tx=0x7f907c005880 comp rx=0 tx=0).stop 2024-05-10T04:22:57.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.181+0000 7f909ea00700 1 -- 172.21.15.80:0/857890939 shutdown_connections 2024-05-10T04:22:57.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.181+0000 7f909ea00700 1 --2- 172.21.15.80:0/857890939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f907c003be0 0x7f907c004030 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.181+0000 7f909ea00700 1 -- 172.21.15.80:0/857890939 >> 172.21.15.80:0/857890939 conn(0x7f90980d3e10 msgr2=0x7f90980d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:57.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.182+0000 7f909ea00700 1 -- 172.21.15.80:0/857890939 shutdown_connections 2024-05-10T04:22:57.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.182+0000 7f909ea00700 1 -- 172.21.15.80:0/857890939 wait complete. 2024-05-10T04:22:57.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.184+0000 7f909ea00700 1 Processor -- start 2024-05-10T04:22:57.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.184+0000 7f909ea00700 1 -- start start 2024-05-10T04:22:57.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.185+0000 7f909ea00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f907c003be0 0x7f90981491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.185+0000 7f909ea00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f909815c500 0x7f9098160d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.185+0000 7f909ea00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f909815c910 0x7f9098161270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.185+0000 7f909ea00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90981f57d0 con 0x7f909815c910 2024-05-10T04:22:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.185+0000 7f909ea00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90981e8910 con 0x7f907c003be0 2024-05-10T04:22:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.185+0000 7f909ea00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90981e8bb0 con 0x7f909815c500 2024-05-10T04:22:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.186+0000 7f909ca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f909815c910 0x7f9098161270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.186+0000 7f909ca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f909815c910 0x7f9098161270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35870/0 (socket says 172.21.15.80:35870) 2024-05-10T04:22:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.186+0000 7f909ca00700 1 -- 172.21.15.80:0/1847016229 learned_addr learned my addr 172.21.15.80:0/1847016229 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.186+0000 7f9097e00700 1 --2- 172.21.15.80:0/1847016229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f907c003be0 0x7f90981491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.186+0000 7f908fe00700 1 --2- 172.21.15.80:0/1847016229 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f909815c500 0x7f9098160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.186+0000 7f909ca00700 1 -- 172.21.15.80:0/1847016229 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f909815c500 msgr2=0x7f9098160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.186+0000 7f909ca00700 1 --2- 172.21.15.80:0/1847016229 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f909815c500 0x7f9098160d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.186+0000 7f909ca00700 1 -- 172.21.15.80:0/1847016229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f907c003be0 msgr2=0x7f90981491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.186+0000 7f909ca00700 1 --2- 172.21.15.80:0/1847016229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f907c003be0 0x7f90981491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.186+0000 7f909ca00700 1 -- 172.21.15.80:0/1847016229 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90981e8e90 con 0x7f909815c910 2024-05-10T04:22:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.186+0000 7f909ca00700 1 --2- 172.21.15.80:0/1847016229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f909815c910 0x7f9098161270 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f907c005830 tx=0x7f909000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.187+0000 7f9094c00700 1 -- 172.21.15.80:0/1847016229 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090003c10 con 0x7f909815c910 2024-05-10T04:22:57.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.187+0000 7f9094c00700 1 -- 172.21.15.80:0/1847016229 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9090003d70 con 0x7f909815c910 2024-05-10T04:22:57.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.187+0000 7f9094c00700 1 -- 172.21.15.80:0/1847016229 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090005310 con 0x7f909815c910 2024-05-10T04:22:57.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.187+0000 7f909ea00700 1 -- 172.21.15.80:0/1847016229 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90981e9170 con 0x7f909815c910 2024-05-10T04:22:57.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.187+0000 7f909ea00700 1 -- 172.21.15.80:0/1847016229 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90981e9730 con 0x7f909815c910 2024-05-10T04:22:57.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.189+0000 7f9094c00700 1 -- 172.21.15.80:0/1847016229 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9090005470 con 0x7f909815c910 2024-05-10T04:22:57.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.190+0000 7f9094c00700 1 --2- 172.21.15.80:0/1847016229 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f907406acc0 0x7f907406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.190+0000 7f9094c00700 1 -- 172.21.15.80:0/1847016229 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90900892d0 con 0x7f909815c910 2024-05-10T04:22:57.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.191+0000 7f9097e00700 1 --2- 172.21.15.80:0/1847016229 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f907406acc0 0x7f907406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.191+0000 7f9097e00700 1 --2- 172.21.15.80:0/1847016229 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f907406acc0 0x7f907406d1d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f90880090b0 tx=0x7f908801e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:57.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.192+0000 7f90b6994b80 1 Processor -- start 2024-05-10T04:22:57.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.192+0000 7f90b6994b80 1 -- start start 2024-05-10T04:22:57.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.194+0000 7f90b6994b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef109410 0x55a6ef0ed180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.194+0000 7f90b6994b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0ed6c0 0x55a6ef0c2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.194+0000 7f90b6994b80 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef0edad0 0x55a6ef0c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.194+0000 7f90b6994b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6eefe9100 con 0x55a6ef0ed6c0 2024-05-10T04:22:57.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.194+0000 7f90b6994b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6eefe6ac0 con 0x55a6ef109410 2024-05-10T04:22:57.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.194+0000 7f90b6994b80 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a6eefe23b0 con 0x55a6ef0edad0 2024-05-10T04:22:57.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.194+0000 7f908fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0ed6c0 0x55a6ef0c2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.194+0000 7f908fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0ed6c0 0x55a6ef0c2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35882/0 (socket says 172.21.15.80:35882) 2024-05-10T04:22:57.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.194+0000 7f9097e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef109410 0x55a6ef0ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.194+0000 7f908fe00700 1 -- 172.21.15.80:0/1929900305 learned_addr learned my addr 172.21.15.80:0/1929900305 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:57.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.194+0000 7f909ca00700 1 --2- 172.21.15.80:0/1929900305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef0edad0 0x55a6ef0c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.194+0000 7f908fe00700 1 -- 172.21.15.80:0/1929900305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef0edad0 msgr2=0x55a6ef0c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:57.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.194+0000 7f908fe00700 1 --2- 172.21.15.80:0/1929900305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef0edad0 0x55a6ef0c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.194+0000 7f908fe00700 1 -- 172.21.15.80:0/1929900305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef109410 msgr2=0x55a6ef0ed180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:57.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.194+0000 7f908fe00700 1 --2- 172.21.15.80:0/1929900305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef109410 0x55a6ef0ed180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.194+0000 7f908fe00700 1 -- 172.21.15.80:0/1929900305 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6eee63360 con 0x55a6ef0ed6c0 2024-05-10T04:22:57.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.195+0000 7f908fe00700 1 --2- 172.21.15.80:0/1929900305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0ed6c0 0x55a6ef0c2a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f90980644e0 tx=0x7f9080001180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5e1b151910eb14 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:57.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.195+0000 7f9087e00700 1 -- 172.21.15.80:0/1929900305 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800136c0 con 0x55a6ef0ed6c0 2024-05-10T04:22:57.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.195+0000 7f9087e00700 1 -- 172.21.15.80:0/1929900305 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9080013820 con 0x55a6ef0ed6c0 2024-05-10T04:22:57.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.195+0000 7f9087e00700 1 -- 172.21.15.80:0/1929900305 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080013bb0 con 0x55a6ef0ed6c0 2024-05-10T04:22:57.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.196+0000 7f90b6994b80 1 -- 172.21.15.80:0/1929900305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0ed6c0 msgr2=0x55a6ef0c2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:57.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.196+0000 7f90b6994b80 1 --2- 172.21.15.80:0/1929900305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0ed6c0 0x55a6ef0c2a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f90980644e0 tx=0x7f9080001180 comp rx=0 tx=0).stop 2024-05-10T04:22:57.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.196+0000 7f90b6994b80 1 -- 172.21.15.80:0/1929900305 shutdown_connections 2024-05-10T04:22:57.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.196+0000 7f90b6994b80 1 --2- 172.21.15.80:0/1929900305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef0edad0 0x55a6ef0c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.196+0000 7f90b6994b80 1 --2- 172.21.15.80:0/1929900305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef109410 0x55a6ef0ed180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.196+0000 7f90b6994b80 1 --2- 172.21.15.80:0/1929900305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0ed6c0 0x55a6ef0c2a20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.196+0000 7f90b6994b80 1 -- 172.21.15.80:0/1929900305 >> 172.21.15.80:0/1929900305 conn(0x55a6ef024a10 msgr2=0x55a6ef107f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:57.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.196+0000 7f90b6994b80 1 -- 172.21.15.80:0/1929900305 shutdown_connections 2024-05-10T04:22:57.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.196+0000 7f90b6994b80 1 -- 172.21.15.80:0/1929900305 wait complete. 2024-05-10T04:22:57.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.197+0000 7f90b6994b80 1 -- start start 2024-05-10T04:22:57.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.197+0000 7f90b6994b80 1 Processor -- start 2024-05-10T04:22:57.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.199+0000 7f90b6994b80 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef0ed6c0 0x55a6ef108480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.199+0000 7f90b6994b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0edad0 0x55a6ef0e3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.199+0000 7f90b6994b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef109410 0x55a6ef105ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.199+0000 7f90b6994b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6eef7e510 con 0x55a6ef0edad0 2024-05-10T04:22:57.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.199+0000 7f90b6994b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6eef7e1b0 con 0x55a6ef109410 2024-05-10T04:22:57.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.199+0000 7f90b6994b80 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a6eee65650 con 0x55a6ef0ed6c0 2024-05-10T04:22:57.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.199+0000 7f90b6994b80 10 client.0 _ll_register_callbacks cb 0x55a6eef87ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T04:22:57.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.199+0000 7f908fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0edad0 0x55a6ef0e3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.199+0000 7f908fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0edad0 0x55a6ef0e3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35884/0 (socket says 172.21.15.80:35884) 2024-05-10T04:22:57.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.199+0000 7f908fe00700 1 -- 172.21.15.80:0/2113648399 learned_addr learned my addr 172.21.15.80:0/2113648399 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:57.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.199+0000 7f9097e00700 1 --2- 172.21.15.80:0/2113648399 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef0ed6c0 0x55a6ef108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.199+0000 7f909ca00700 1 --2- 172.21.15.80:0/2113648399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef109410 0x55a6ef105ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.199+0000 7f908fe00700 1 -- 172.21.15.80:0/2113648399 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef0ed6c0 msgr2=0x55a6ef108480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:57.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.199+0000 7f908fe00700 1 --2- 172.21.15.80:0/2113648399 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef0ed6c0 0x55a6ef108480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.199+0000 7f908fe00700 1 -- 172.21.15.80:0/2113648399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef109410 msgr2=0x55a6ef105ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:57.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.199+0000 7f908fe00700 1 --2- 172.21.15.80:0/2113648399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef109410 0x55a6ef105ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.199+0000 7f908fe00700 1 -- 172.21.15.80:0/2113648399 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908000f040 con 0x55a6ef0edad0 2024-05-10T04:22:57.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.200+0000 7f908fe00700 1 --2- 172.21.15.80:0/2113648399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0edad0 0x55a6ef0e3a90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55a6ef0be000 tx=0x7f9080001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8195f60d329a00 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:57.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.200+0000 7f9084c00700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-05-10T04:22:57.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.200+0000 7f9084c00700 1 -- 172.21.15.80:0/2113648399 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080001b60 con 0x55a6ef0edad0 2024-05-10T04:22:57.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.200+0000 7f9084c00700 1 -- 172.21.15.80:0/2113648399 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9080015680 con 0x55a6ef0edad0 2024-05-10T04:22:57.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.200+0000 7f90b6994b80 1 -- 172.21.15.80:0/2113648399 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a6eef3b220 con 0x55a6ef0edad0 2024-05-10T04:22:57.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.200+0000 7f9084c00700 1 -- 172.21.15.80:0/2113648399 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9080015840 con 0x55a6ef0edad0 2024-05-10T04:22:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.200+0000 7f90b6994b80 10 client.4626 fetch_fsmap learned FSMap version 8 2024-05-10T04:22:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.200+0000 7f90b6994b80 1 -- 172.21.15.80:0/2113648399 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a6eee0fb10 con 0x55a6ef0edad0 2024-05-10T04:22:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.200+0000 7f9084c00700 1 -- 172.21.15.80:0/2113648399 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a6eef3b220 con 0x55a6ef0edad0 2024-05-10T04:22:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.201+0000 7f9084c00700 1 -- 172.21.15.80:0/2113648399 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f90800159a0 con 0x55a6ef0edad0 2024-05-10T04:22:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.201+0000 7f90b6994b80 10 client.4626 fetch_fsmap finished waiting for FSMap version 8 2024-05-10T04:22:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.201+0000 7f90b6994b80 10 client.4626 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T04:22:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.201+0000 7f90b6994b80 20 client.4626 populate_metadata read hostname 'smithi080' 2024-05-10T04:22:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.201+0000 7f90b6994b80 1 --2- 172.21.15.80:0/2113648399 >> [v2:172.21.15.106:6835/961352916,v1:172.21.15.106:6837/961352916] conn(0x55a6ef0f01c0 0x55a6ef0f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.201+0000 7f90b6994b80 4 client.4626 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T04:22:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.201+0000 7f90b6994b80 1 -- 172.21.15.80:0/2113648399 --> [v2:172.21.15.106:6835/961352916,v1:172.21.15.106:6837/961352916] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a6ef091700 con 0x55a6ef0f01c0 2024-05-10T04:22:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.201+0000 7f9097e00700 1 --2- 172.21.15.80:0/2113648399 >> [v2:172.21.15.106:6835/961352916,v1:172.21.15.106:6837/961352916] conn(0x55a6ef0f01c0 0x55a6ef0f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.202+0000 7f9084c00700 10 client.4626 ms_handle_connect on v2:172.21.15.106:6835/961352916 2024-05-10T04:22:57.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.202+0000 7f9097e00700 1 --2- 172.21.15.80:0/2113648399 >> [v2:172.21.15.106:6835/961352916,v1:172.21.15.106:6837/961352916] conn(0x55a6ef0f01c0 0x55a6ef0f05d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91e2fc0c5299a24d server_cookie=bf5d0513ea7f8543 in_seq=0 out_seq=0 2024-05-10T04:22:57.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.203+0000 7f9084c00700 1 -- 172.21.15.80:0/2113648399 <== mds.0 v2:172.21.15.106:6835/961352916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a6ef091700 con 0x55a6ef0f01c0 2024-05-10T04:22:57.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.203+0000 7f9084c00700 10 client.4626 handle_command_reply: tid=0 2024-05-10T04:22:57.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.203+0000 7f90b6994b80 1 client.4626 shutdown 2024-05-10T04:22:57.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.203+0000 7f90b6994b80 1 -- 172.21.15.80:0/2113648399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0edad0 msgr2=0x55a6ef0e3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:57.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.203+0000 7f90b6994b80 1 --2- 172.21.15.80:0/2113648399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0edad0 0x55a6ef0e3a90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55a6ef0be000 tx=0x7f9080001930 comp rx=0 tx=0).stop 2024-05-10T04:22:57.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.203+0000 7f90b6994b80 1 -- 172.21.15.80:0/2113648399 shutdown_connections 2024-05-10T04:22:57.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.203+0000 7f90b6994b80 1 --2- 172.21.15.80:0/2113648399 >> [v2:172.21.15.106:6835/961352916,v1:172.21.15.106:6837/961352916] conn(0x55a6ef0f01c0 0x55a6ef0f05d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.203+0000 7f90b6994b80 1 --2- 172.21.15.80:0/2113648399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef109410 0x55a6ef105ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.203+0000 7f9084c00700 0 client.4626 ms_handle_reset on v2:172.21.15.106:6835/961352916 2024-05-10T04:22:57.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.203+0000 7f90b6994b80 1 --2- 172.21.15.80:0/2113648399 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef0ed6c0 0x55a6ef108480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.203+0000 7f90b6994b80 1 --2- 172.21.15.80:0/2113648399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0edad0 0x55a6ef0e3a90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.203+0000 7f90b6994b80 1 -- 172.21.15.80:0/2113648399 >> 172.21.15.80:0/2113648399 conn(0x55a6ef024a10 msgr2=0x55a6ef10be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:57.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.203+0000 7f90b6994b80 1 -- 172.21.15.80:0/2113648399 shutdown_connections 2024-05-10T04:22:57.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.203+0000 7f90b6994b80 1 -- 172.21.15.80:0/2113648399 wait complete. 2024-05-10T04:22:57.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.204+0000 7f90b6994b80 20 client.4626 trim_cache size 0 max 16384 2024-05-10T04:22:57.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.222+0000 7f90b6994b80 1 Processor -- start 2024-05-10T04:22:57.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.223+0000 7f90b6994b80 1 -- start start 2024-05-10T04:22:57.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.224+0000 7f90b6994b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef0ed6c0 0x55a6ef10fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.224+0000 7f90b6994b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0edad0 0x55a6ef110200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.224+0000 7f90b6994b80 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef109410 0x55a6ef0bbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.224+0000 7f90b6994b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6ef0bed40 con 0x55a6ef0edad0 2024-05-10T04:22:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.224+0000 7f90b6994b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6ef108510 con 0x55a6ef0ed6c0 2024-05-10T04:22:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.224+0000 7f90b6994b80 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a6ef108300 con 0x55a6ef109410 2024-05-10T04:22:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.224+0000 7f908fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0edad0 0x55a6ef110200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.224+0000 7f908fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0edad0 0x55a6ef110200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35896/0 (socket says 172.21.15.80:35896) 2024-05-10T04:22:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.224+0000 7f908fe00700 1 -- 172.21.15.80:0/2050710824 learned_addr learned my addr 172.21.15.80:0/2050710824 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.225+0000 7f9097e00700 1 --2- 172.21.15.80:0/2050710824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef0ed6c0 0x55a6ef10fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.225+0000 7f909ca00700 1 --2- 172.21.15.80:0/2050710824 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef109410 0x55a6ef0bbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.225+0000 7f908fe00700 1 -- 172.21.15.80:0/2050710824 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef109410 msgr2=0x55a6ef0bbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.225+0000 7f908fe00700 1 --2- 172.21.15.80:0/2050710824 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef109410 0x55a6ef0bbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.225+0000 7f908fe00700 1 -- 172.21.15.80:0/2050710824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef0ed6c0 msgr2=0x55a6ef10fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.225+0000 7f908fe00700 1 --2- 172.21.15.80:0/2050710824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef0ed6c0 0x55a6ef10fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.225+0000 7f908fe00700 1 -- 172.21.15.80:0/2050710824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6eefa8510 con 0x55a6ef0edad0 2024-05-10T04:22:57.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.225+0000 7f9097e00700 1 --2- 172.21.15.80:0/2050710824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef0ed6c0 0x55a6ef10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:22:57.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.225+0000 7f909ca00700 1 --2- 172.21.15.80:0/2050710824 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef109410 0x55a6ef0bbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:22:57.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.225+0000 7f908fe00700 1 --2- 172.21.15.80:0/2050710824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0edad0 0x55a6ef110200 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9080001970 tx=0x7f9080022070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb307dffcca5514 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:57.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.225+0000 7f908d200700 1 -- 172.21.15.80:0/2050710824 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080001b60 con 0x55a6ef0edad0 2024-05-10T04:22:57.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.225+0000 7f908d200700 1 -- 172.21.15.80:0/2050710824 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908000b030 con 0x55a6ef0edad0 2024-05-10T04:22:57.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.225+0000 7f908d200700 1 -- 172.21.15.80:0/2050710824 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800158a0 con 0x55a6ef0edad0 2024-05-10T04:22:57.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.226+0000 7f90b6994b80 1 -- 172.21.15.80:0/2050710824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0edad0 msgr2=0x55a6ef110200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:57.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.226+0000 7f90b6994b80 1 --2- 172.21.15.80:0/2050710824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0edad0 0x55a6ef110200 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9080001970 tx=0x7f9080022070 comp rx=0 tx=0).stop 2024-05-10T04:22:57.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.226+0000 7f90b6994b80 1 -- 172.21.15.80:0/2050710824 shutdown_connections 2024-05-10T04:22:57.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.226+0000 7f90b6994b80 1 --2- 172.21.15.80:0/2050710824 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef109410 0x55a6ef0bbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.226+0000 7f90b6994b80 1 --2- 172.21.15.80:0/2050710824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef0ed6c0 0x55a6ef10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.226+0000 7f90b6994b80 1 --2- 172.21.15.80:0/2050710824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef0edad0 0x55a6ef110200 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.226+0000 7f90b6994b80 1 -- 172.21.15.80:0/2050710824 >> 172.21.15.80:0/2050710824 conn(0x55a6ef024a10 msgr2=0x55a6ef0ea940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:57.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.226+0000 7f90b6994b80 1 -- 172.21.15.80:0/2050710824 shutdown_connections 2024-05-10T04:22:57.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.226+0000 7f90b6994b80 1 -- 172.21.15.80:0/2050710824 wait complete. 2024-05-10T04:22:57.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.227+0000 7f90b6994b80 1 -- start start 2024-05-10T04:22:57.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.227+0000 7f90b6994b80 1 Processor -- start 2024-05-10T04:22:57.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f90b6994b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef0ed6c0 0x55a6ef0ff610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f90b6994b80 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef0edad0 0x55a6ef0c0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f90b6994b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef109410 0x55a6ef170b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f90b6994b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6ef0ed180 con 0x55a6ef109410 2024-05-10T04:22:57.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f90b6994b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6ef0c2170 con 0x55a6ef0ed6c0 2024-05-10T04:22:57.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f90b6994b80 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a6ef0e5200 con 0x55a6ef0edad0 2024-05-10T04:22:57.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f90b6994b80 10 client.0 _ll_register_callbacks cb 0x55a6eef87ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T04:22:57.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f909ca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef109410 0x55a6ef170b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f909ca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef109410 0x55a6ef170b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35910/0 (socket says 172.21.15.80:35910) 2024-05-10T04:22:57.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f909ca00700 1 -- 172.21.15.80:0/949627180 learned_addr learned my addr 172.21.15.80:0/949627180 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:57.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f9097e00700 1 --2- 172.21.15.80:0/949627180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef0ed6c0 0x55a6ef0ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f908fe00700 1 --2- 172.21.15.80:0/949627180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef0edad0 0x55a6ef0c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f909ca00700 1 -- 172.21.15.80:0/949627180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef0edad0 msgr2=0x55a6ef0c0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:57.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f909ca00700 1 --2- 172.21.15.80:0/949627180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef0edad0 0x55a6ef0c0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f909ca00700 1 -- 172.21.15.80:0/949627180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef0ed6c0 msgr2=0x55a6ef0ff610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:22:57.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f909ca00700 1 --2- 172.21.15.80:0/949627180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef0ed6c0 0x55a6ef0ff610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f909ca00700 1 -- 172.21.15.80:0/949627180 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a6eee0fb10 con 0x55a6ef109410 2024-05-10T04:22:57.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f908fe00700 1 --2- 172.21.15.80:0/949627180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef0edad0 0x55a6ef0c0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:22:57.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f909ca00700 1 --2- 172.21.15.80:0/949627180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef109410 0x55a6ef170b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f90900580a0 tx=0x7f90900581e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1706739ff508a585 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:57.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.230+0000 7f9084c00700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-05-10T04:22:57.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.231+0000 7f9084c00700 1 -- 172.21.15.80:0/949627180 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090056500 con 0x55a6ef109410 2024-05-10T04:22:57.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.231+0000 7f9084c00700 1 -- 172.21.15.80:0/949627180 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f909005e0b0 con 0x55a6ef109410 2024-05-10T04:22:57.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.231+0000 7f90b6994b80 1 -- 172.21.15.80:0/949627180 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9080013820 con 0x55a6ef109410 2024-05-10T04:22:57.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.231+0000 7f9084c00700 1 -- 172.21.15.80:0/949627180 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f909005e270 con 0x55a6ef109410 2024-05-10T04:22:57.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.231+0000 7f90b6994b80 10 client.4632 fetch_fsmap learned FSMap version 8 2024-05-10T04:22:57.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.231+0000 7f90b6994b80 1 -- 172.21.15.80:0/949627180 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a6eee67c80 con 0x55a6ef109410 2024-05-10T04:22:57.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.231+0000 7f9084c00700 1 -- 172.21.15.80:0/949627180 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9080013820 con 0x55a6ef109410 2024-05-10T04:22:57.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.231+0000 7f9084c00700 1 -- 172.21.15.80:0/949627180 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f90900583c0 con 0x55a6ef109410 2024-05-10T04:22:57.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.231+0000 7f90b6994b80 10 client.4632 fetch_fsmap finished waiting for FSMap version 8 2024-05-10T04:22:57.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.231+0000 7f90b6994b80 10 client.4632 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T04:22:57.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.231+0000 7f90b6994b80 20 client.4632 populate_metadata read hostname 'smithi080' 2024-05-10T04:22:57.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.231+0000 7f90b6994b80 1 --2- 172.21.15.80:0/949627180 >> [v2:172.21.15.106:6835/961352916,v1:172.21.15.106:6837/961352916] conn(0x55a6ef0e24d0 0x55a6ef0e28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:57.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.231+0000 7f90b6994b80 4 client.4632 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T04:22:57.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.231+0000 7f90b6994b80 1 -- 172.21.15.80:0/949627180 --> [v2:172.21.15.106:6835/961352916,v1:172.21.15.106:6837/961352916] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a6eefdae70 con 0x55a6ef0e24d0 2024-05-10T04:22:57.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.232+0000 7f9097e00700 1 --2- 172.21.15.80:0/949627180 >> [v2:172.21.15.106:6835/961352916,v1:172.21.15.106:6837/961352916] conn(0x55a6ef0e24d0 0x55a6ef0e28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:57.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.232+0000 7f9084c00700 10 client.4632 ms_handle_connect on v2:172.21.15.106:6835/961352916 2024-05-10T04:22:57.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.232+0000 7f9097e00700 1 --2- 172.21.15.80:0/949627180 >> [v2:172.21.15.106:6835/961352916,v1:172.21.15.106:6837/961352916] conn(0x55a6ef0e24d0 0x55a6ef0e28e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c4c039d73d4ff7b server_cookie=6a05ce8e9e6255b0 in_seq=0 out_seq=0 2024-05-10T04:22:57.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.232+0000 7f9084c00700 1 -- 172.21.15.80:0/949627180 <== mds.0 v2:172.21.15.106:6835/961352916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55a6eefdae70 con 0x55a6ef0e24d0 2024-05-10T04:22:57.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.232+0000 7f9084c00700 10 client.4632 handle_command_reply: tid=0 2024-05-10T04:22:57.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.232+0000 7f90b6994b80 1 client.4632 shutdown 2024-05-10T04:22:57.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.232+0000 7f90b6994b80 1 -- 172.21.15.80:0/949627180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef109410 msgr2=0x55a6ef170b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:57.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.232+0000 7f90b6994b80 1 --2- 172.21.15.80:0/949627180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef109410 0x55a6ef170b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f90900580a0 tx=0x7f90900581e0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.233+0000 7f90b6994b80 1 -- 172.21.15.80:0/949627180 shutdown_connections 2024-05-10T04:22:57.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.233+0000 7f90b6994b80 1 --2- 172.21.15.80:0/949627180 >> [v2:172.21.15.106:6835/961352916,v1:172.21.15.106:6837/961352916] conn(0x55a6ef0e24d0 0x55a6ef0e28e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.233+0000 7f90b6994b80 1 --2- 172.21.15.80:0/949627180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6ef109410 0x55a6ef170b50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.233+0000 7f90b6994b80 1 --2- 172.21.15.80:0/949627180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a6ef0ed6c0 0x55a6ef0ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.233+0000 7f9084c00700 0 client.4632 ms_handle_reset on v2:172.21.15.106:6835/961352916 2024-05-10T04:22:57.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.233+0000 7f90b6994b80 1 --2- 172.21.15.80:0/949627180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a6ef0edad0 0x55a6ef0c0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.233+0000 7f90b6994b80 1 -- 172.21.15.80:0/949627180 >> 172.21.15.80:0/949627180 conn(0x55a6ef024a10 msgr2=0x55a6ef0bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:57.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.233+0000 7f90b6994b80 1 -- 172.21.15.80:0/949627180 shutdown_connections 2024-05-10T04:22:57.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.233+0000 7f90b6994b80 1 -- 172.21.15.80:0/949627180 wait complete. 2024-05-10T04:22:57.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.233+0000 7f90b6994b80 20 client.4632 trim_cache size 0 max 16384 2024-05-10T04:22:57.238 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-10T04:22:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "7fdf09a1-1b63-4484-b77e-59e97b1b5367", 2024-05-10T04:22:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-05-10T04:22:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 4296, 2024-05-10T04:22:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-05-10T04:22:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-05-10T04:22:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-05-10T04:22:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 19.747842294000002, 2024-05-10T04:22:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 8, 2024-05-10T04:22:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 20, 2024-05-10T04:22:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 20, 2024-05-10T04:22:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 25.030600847999999 2024-05-10T04:22:57.239 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-10T04:22:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.233+0000 7f909ea00700 1 -- 172.21.15.80:0/1847016229 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f907406acc0 msgr2=0x7f907406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.233+0000 7f909ea00700 1 --2- 172.21.15.80:0/1847016229 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f907406acc0 0x7f907406d1d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f90880090b0 tx=0x7f908801e040 comp rx=0 tx=0).stop 2024-05-10T04:22:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.233+0000 7f909ea00700 1 -- 172.21.15.80:0/1847016229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f909815c910 msgr2=0x7f9098161270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.233+0000 7f909ea00700 1 --2- 172.21.15.80:0/1847016229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f909815c910 0x7f9098161270 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f907c005830 tx=0x7f909000ee00 comp rx=0 tx=0).stop 2024-05-10T04:22:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.234+0000 7f909ea00700 1 -- 172.21.15.80:0/1847016229 shutdown_connections 2024-05-10T04:22:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.234+0000 7f909ea00700 1 --2- 172.21.15.80:0/1847016229 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f907406acc0 0x7f907406d1d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.234+0000 7f909ea00700 1 --2- 172.21.15.80:0/1847016229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f909815c910 0x7f9098161270 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.234+0000 7f909ea00700 1 --2- 172.21.15.80:0/1847016229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f907c003be0 0x7f90981491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.234+0000 7f909ea00700 1 --2- 172.21.15.80:0/1847016229 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f909815c500 0x7f9098160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.234+0000 7f909ea00700 1 -- 172.21.15.80:0/1847016229 >> 172.21.15.80:0/1847016229 conn(0x7f90980d3e10 msgr2=0x7f909815f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.234+0000 7f909ea00700 1 -- 172.21.15.80:0/1847016229 shutdown_connections 2024-05-10T04:22:57.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:57.234+0000 7f909ea00700 1 -- 172.21.15.80:0/1847016229 wait complete. 2024-05-10T04:22:57.263 INFO:teuthology.run_tasks:Running task sequential... 2024-05-10T04:22:57.273 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-10T04:22:57.273 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-10T04:22:57.273 INFO:teuthology.task.print:Enabling mgr modules 2024-05-10T04:22:57.273 INFO:teuthology.run_tasks:Running task kclient... 2024-05-10T04:22:57.303 INFO:tasks.kclient:Mounting kernel clients... 2024-05-10T04:22:57.303 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-10T04:22:57.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:22:57.304 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-05-10T04:22:57.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:22:57.347 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-05-10T04:22:57.456 INFO:teuthology.orchestra.run.smithi080.stderr:Cannot find device "ceph-brx" 2024-05-10T04:22:57.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:22:57.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:22:57.460 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-05-10T04:22:57.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:22:57.504 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-05-10T04:22:57.611 INFO:teuthology.orchestra.run.smithi080.stderr:Cannot find device "ceph-brx" 2024-05-10T04:22:57.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:22:57.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:22:57.615 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-05-10T04:22:57.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:22:57.664 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2024-05-10T04:22:57.736 INFO:teuthology.orchestra.run.smithi106.stderr:Cannot find device "ceph-brx" 2024-05-10T04:22:57.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:22:57.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:22:57.740 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-05-10T04:22:57.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:22:57.782 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2024-05-10T04:22:57.890 INFO:teuthology.orchestra.run.smithi106.stderr:Cannot find device "ceph-brx" 2024-05-10T04:22:57.893 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:22:57.893 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-05-10T04:22:57.893 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T04:22:57.893 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T04:22:57.893 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T04:22:58.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.151+0000 7fdbe4a00700 1 Processor -- start 2024-05-10T04:22:58.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.151+0000 7fdbe4a00700 1 -- start start 2024-05-10T04:22:58.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.153+0000 7fdbe4a00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdbe01627f0 0x7fdbe00b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:58.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.153+0000 7fdbe4a00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe00d2730 con 0x7fdbe00b5fc0 2024-05-10T04:22:58.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.153+0000 7fdbe4a00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe00d2fd0 con 0x7fdbe00d3460 2024-05-10T04:22:58.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.153+0000 7fdbe4a00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe0162c00 con 0x7fdbe01627f0 2024-05-10T04:22:58.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.153+0000 7fdbd7e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdbe00b5fc0 0x7fdbe01620e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48664/0 (socket says 172.21.15.80:48664) 2024-05-10T04:22:58.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.153+0000 7fdbd7e00700 1 -- 172.21.15.80:0/3516028540 learned_addr learned my addr 172.21.15.80:0/3516028540 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:22:58.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.153+0000 7fdbde800700 1 --2- 172.21.15.80:0/3516028540 >> v2:172.21.15.106:3300/0 conn(0x7fdbe01627f0 0x7fdbe00b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:58.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.153+0000 7fdbdd400700 1 -- 172.21.15.80:0/3516028540 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812862002 0 0) 0x7fdbe00d2730 con 0x7fdbe00b5fc0 2024-05-10T04:22:58.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.154+0000 7fdbdd400700 1 -- 172.21.15.80:0/3516028540 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbc40035b0 con 0x7fdbe00b5fc0 2024-05-10T04:22:58.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.154+0000 7fdbdd400700 1 -- 172.21.15.80:0/3516028540 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665315077 0 0) 0x7fdbe00d2fd0 con 0x7fdbe00d3460 2024-05-10T04:22:58.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.154+0000 7fdbdd400700 1 -- 172.21.15.80:0/3516028540 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbe00d2730 con 0x7fdbe00d3460 2024-05-10T04:22:58.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.154+0000 7fdbde800700 1 -- 172.21.15.80:0/3516028540 >> v1:172.21.15.106:6789/0 conn(0x7fdbe00d3460 legacy=0x7fdbe00b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:58.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.154+0000 7fdbde800700 1 -- 172.21.15.80:0/3516028540 >> v1:172.21.15.80:6789/0 conn(0x7fdbe00b5fc0 legacy=0x7fdbe01620e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:58.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.154+0000 7fdbde800700 1 -- 172.21.15.80:0/3516028540 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe0162e10 con 0x7fdbe01627f0 2024-05-10T04:22:58.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.154+0000 7fdbde800700 1 --2- 172.21.15.80:0/3516028540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe01627f0 0x7fdbe00b31e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009d90 tx=0x7fdbd800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0177a704a746c5f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:58.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.154+0000 7fdbdd400700 1 -- 172.21.15.80:0/3516028540 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd800e070 con 0x7fdbe01627f0 2024-05-10T04:22:58.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.154+0000 7fdbdd400700 1 -- 172.21.15.80:0/3516028540 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd800bb20 con 0x7fdbe01627f0 2024-05-10T04:22:58.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.154+0000 7fdbdd400700 1 -- 172.21.15.80:0/3516028540 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8012430 con 0x7fdbe01627f0 2024-05-10T04:22:58.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.155+0000 7fdbe4a00700 1 -- 172.21.15.80:0/3516028540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe01627f0 msgr2=0x7fdbe00b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:58.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.155+0000 7fdbe4a00700 1 --2- 172.21.15.80:0/3516028540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe01627f0 0x7fdbe00b31e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009d90 tx=0x7fdbd800b330 comp rx=0 tx=0).stop 2024-05-10T04:22:58.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.155+0000 7fdbe4a00700 1 -- 172.21.15.80:0/3516028540 shutdown_connections 2024-05-10T04:22:58.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.155+0000 7fdbe4a00700 1 --2- 172.21.15.80:0/3516028540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe01627f0 0x7fdbe00b31e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.155+0000 7fdbe4a00700 1 -- 172.21.15.80:0/3516028540 >> 172.21.15.80:0/3516028540 conn(0x7fdbe00d0a90 msgr2=0x7fdbe00d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.155+0000 7fdbe4a00700 1 -- 172.21.15.80:0/3516028540 shutdown_connections 2024-05-10T04:22:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.155+0000 7fdbe4a00700 1 -- 172.21.15.80:0/3516028540 wait complete. 2024-05-10T04:22:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.157+0000 7fdbe4a00700 1 Processor -- start 2024-05-10T04:22:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.157+0000 7fdbe4a00700 1 -- start start 2024-05-10T04:22:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.159+0000 7fdbe4a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbe00d3460 0x7fdbe01502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.159+0000 7fdbe4a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe01627f0 0x7fdbe01546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.159+0000 7fdbe4a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe0153120 0x7fdbe0154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.159+0000 7fdbe4a00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe01542a0 con 0x7fdbe00d3460 2024-05-10T04:22:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.159+0000 7fdbe4a00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe0150bb0 con 0x7fdbe0153120 2024-05-10T04:22:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.159+0000 7fdbe4a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe00cd0d0 con 0x7fdbe01627f0 2024-05-10T04:22:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.159+0000 7fdbdde00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbe00d3460 0x7fdbe01502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.159+0000 7fdbdde00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbe00d3460 0x7fdbe01502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35912/0 (socket says 172.21.15.80:35912) 2024-05-10T04:22:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.159+0000 7fdbdde00700 1 -- 172.21.15.80:0/3177314678 learned_addr learned my addr 172.21.15.80:0/3177314678 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:22:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.159+0000 7fdbd7e00700 1 --2- 172.21.15.80:0/3177314678 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe01627f0 0x7fdbe01546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.159+0000 7fdbde800700 1 --2- 172.21.15.80:0/3177314678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe0153120 0x7fdbe0154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.160+0000 7fdbdde00700 1 -- 172.21.15.80:0/3177314678 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe01627f0 msgr2=0x7fdbe01546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.160+0000 7fdbdde00700 1 --2- 172.21.15.80:0/3177314678 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe01627f0 0x7fdbe01546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.160+0000 7fdbdde00700 1 -- 172.21.15.80:0/3177314678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe0153120 msgr2=0x7fdbe0154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.160+0000 7fdbdde00700 1 --2- 172.21.15.80:0/3177314678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe0153120 0x7fdbe0154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.160+0000 7fdbdde00700 1 -- 172.21.15.80:0/3177314678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd8009a70 con 0x7fdbe00d3460 2024-05-10T04:22:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.160+0000 7fdbd7e00700 1 --2- 172.21.15.80:0/3177314678 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe01627f0 0x7fdbe01546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.160+0000 7fdbde800700 1 --2- 172.21.15.80:0/3177314678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe0153120 0x7fdbe0154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:22:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.160+0000 7fdbdde00700 1 --2- 172.21.15.80:0/3177314678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbe00d3460 0x7fdbe01502f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdbd000c500 tx=0x7fdbd000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.160+0000 7fdbd6000700 1 -- 172.21.15.80:0/3177314678 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd00052d0 con 0x7fdbe00d3460 2024-05-10T04:22:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.160+0000 7fdbd6000700 1 -- 172.21.15.80:0/3177314678 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd0005450 con 0x7fdbe00d3460 2024-05-10T04:22:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.160+0000 7fdbe4a00700 1 -- 172.21.15.80:0/3177314678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe00cd3b0 con 0x7fdbe00d3460 2024-05-10T04:22:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.160+0000 7fdbd6000700 1 -- 172.21.15.80:0/3177314678 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd00038c0 con 0x7fdbe00d3460 2024-05-10T04:22:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.160+0000 7fdbe4a00700 1 -- 172.21.15.80:0/3177314678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe0153ec0 con 0x7fdbe00d3460 2024-05-10T04:22:58.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.161+0000 7fdbe4a00700 1 -- 172.21.15.80:0/3177314678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe0154080 con 0x7fdbe00d3460 2024-05-10T04:22:58.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.162+0000 7fdbd6000700 1 -- 172.21.15.80:0/3177314678 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdbd0003a20 con 0x7fdbe00d3460 2024-05-10T04:22:58.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.163+0000 7fdbd6000700 1 --2- 172.21.15.80:0/3177314678 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdbbc06ac90 0x7fdbbc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:22:58.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.163+0000 7fdbd6000700 1 -- 172.21.15.80:0/3177314678 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbd00887d0 con 0x7fdbe00d3460 2024-05-10T04:22:58.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.163+0000 7fdbd7e00700 1 --2- 172.21.15.80:0/3177314678 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdbbc06ac90 0x7fdbbc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:22:58.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.164+0000 7fdbd7e00700 1 --2- 172.21.15.80:0/3177314678 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdbbc06ac90 0x7fdbbc06d1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00b60c0 tx=0x7fdbc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:22:58.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.168+0000 7fdbd6000700 1 -- 172.21.15.80:0/3177314678 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdbd0053880 con 0x7fdbe00d3460 2024-05-10T04:22:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.419+0000 7fdbe4a00700 1 -- 172.21.15.80:0/3177314678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdbe00732b0 con 0x7fdbe00d3460 2024-05-10T04:22:58.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.419+0000 7fdbd6000700 1 -- 172.21.15.80:0/3177314678 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdbd0017070 con 0x7fdbe00d3460 2024-05-10T04:22:58.421 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T04:22:58.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.422+0000 7fdbe4a00700 1 -- 172.21.15.80:0/3177314678 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdbbc06ac90 msgr2=0x7fdbbc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:58.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.422+0000 7fdbe4a00700 1 --2- 172.21.15.80:0/3177314678 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdbbc06ac90 0x7fdbbc06d1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00b60c0 tx=0x7fdbc8009040 comp rx=0 tx=0).stop 2024-05-10T04:22:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.422+0000 7fdbe4a00700 1 -- 172.21.15.80:0/3177314678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbe00d3460 msgr2=0x7fdbe01502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:22:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.422+0000 7fdbe4a00700 1 --2- 172.21.15.80:0/3177314678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbe00d3460 0x7fdbe01502f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdbd000c500 tx=0x7fdbd000c810 comp rx=0 tx=0).stop 2024-05-10T04:22:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.422+0000 7fdbe4a00700 1 -- 172.21.15.80:0/3177314678 shutdown_connections 2024-05-10T04:22:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.422+0000 7fdbe4a00700 1 --2- 172.21.15.80:0/3177314678 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdbbc06ac90 0x7fdbbc06d1a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.422+0000 7fdbe4a00700 1 --2- 172.21.15.80:0/3177314678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbe00d3460 0x7fdbe01502f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.422+0000 7fdbe4a00700 1 --2- 172.21.15.80:0/3177314678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe0153120 0x7fdbe0154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.422+0000 7fdbe4a00700 1 --2- 172.21.15.80:0/3177314678 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe01627f0 0x7fdbe01546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:22:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.422+0000 7fdbe4a00700 1 -- 172.21.15.80:0/3177314678 >> 172.21.15.80:0/3177314678 conn(0x7fdbe00d0a90 msgr2=0x7fdbe0156310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:22:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.422+0000 7fdbe4a00700 1 -- 172.21.15.80:0/3177314678 shutdown_connections 2024-05-10T04:22:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:22:58.422+0000 7fdbe4a00700 1 -- 172.21.15.80:0/3177314678 wait complete. 2024-05-10T04:22:58.448 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T04:22:58.448 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T04:22:58.448 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-05-10T04:22:58.448 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T04:22:58.448 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T04:22:58.448 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T04:22:58.449 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T04:22:58.449 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T04:22:58.449 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T04:22:58.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:22:58.449 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-05-10T04:22:58.491 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:22:58.491 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:22:58.491 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:22:58.491 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:22:58.491 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-05-10T04:22:58.491 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:22:58.492 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:22:58.492 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:22:58.492 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-05-10T04:22:58.492 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:22:58.492 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:22:58.492 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-05-10T04:22:58.492 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:22:58.492 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:22:58.492 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T04:22:58.492 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:22:58.492 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-10T04:22:58.492 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42145sec preferred_lft 42145sec 2024-05-10T04:22:58.492 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::ec4:7aff:fe8f:cba9/64 scope link 2024-05-10T04:22:58.492 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:22:58.493 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T04:22:58.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:22:58.493 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-10T04:22:58.493 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-10T04:22:58.493 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add name ceph-brx type bridge 2024-05-10T04:22:58.493 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr flush dev ceph-brx 2024-05-10T04:22:58.494 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set ceph-brx up 2024-05-10T04:22:58.494 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T04:22:58.494 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-10T04:22:58.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:22:58.979 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T04:22:59.049 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-05-10T04:22:59.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:22:59.055 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-05-10T04:22:59.115 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-05-10T04:22:59.115 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T04:22:59.116 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T04:22:59.116 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T04:22:59.116 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T04:22:59.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:22:59.117 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-10T04:22:59.117 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-10T04:22:59.117 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T04:22:59.117 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T04:22:59.117 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T04:22:59.117 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-10T04:22:59.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:22:59.894 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-05-10T04:22:59.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:22:59.938 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list-id 2024-05-10T04:23:00.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:00.020 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-10T04:23:00.020 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-10T04:23:00.021 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T04:23:00.021 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-10T04:23:00.021 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-10T04:23:00.198 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-10T04:23:00.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:00.198 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-10T04:23:00.198 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-10T04:23:00.198 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-10T04:23:00.198 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T04:23:00.198 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-10T04:23:00.198 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-10T04:23:00.199 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-10T04:23:00.199 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-10T04:23:00.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:00.457 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-10T04:23:00.457 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-10T04:23:00.457 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-05-10T04:23:00.457 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T04:23:00.457 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-10T04:23:00.623 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:23:00.624 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T04:23:00.665 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T04:23:00.665 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:23:00.666 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T04:23:00.748 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-10T04:23:00.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:00.748 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:23:00.963 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:23:00.963 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-10T04:23:01.691 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:23:01.691 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-10T04:23:01.691 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.106:3300,172.21.15.106:3301" 2024-05-10T04:23:01.691 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with new device syntax: 0@7fdf09a1-1b63-4484-b77e-59e97b1b5367.cephfs=/ 2024-05-10T04:23:01.691 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.80:3300/172.21.15.106:3300/172.21.15.106:3301" will pass to kernel 2024-05-10T04:23:01.697 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T04:23:01.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:01.697 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T04:23:01.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:01.765 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:23:01.891 INFO:teuthology.orchestra.run.smithi080.stdout:client4550 2024-05-10T04:23:01.891 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:23:01.891 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:23:01.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:01.933 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:23:02.086 INFO:teuthology.orchestra.run.smithi080.stdout:client4550 2024-05-10T04:23:02.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:02.087 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:23:02.191 INFO:teuthology.orchestra.run.smithi080.stdout:client4550 2024-05-10T04:23:02.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:02.192 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/7fdf09a1-1b63-4484-b77e-59e97b1b5367.client4550/status') 2024-05-10T04:23:02.294 INFO:teuthology.orchestra.run.smithi080.stdout:instance: client.4550 (3)172.21.15.80:0/373926054 2024-05-10T04:23:02.294 INFO:teuthology.orchestra.run.smithi080.stdout:blocklisted: false 2024-05-10T04:23:02.295 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records in 2024-05-10T04:23:02.295 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records out 2024-05-10T04:23:02.295 INFO:teuthology.orchestra.run.smithi080.stderr:69 bytes copied, 6.322e-05 s, 1.1 MB/s 2024-05-10T04:23:02.298 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-05-10T04:23:02.298 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T04:23:02.298 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-10T04:23:02.298 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T04:23:02.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.558+0000 7f5a3fe00700 1 Processor -- start 2024-05-10T04:23:02.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.558+0000 7f5a3fe00700 1 -- start start 2024-05-10T04:23:02.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.560+0000 7f5a3fe00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a400cf360 0x7f5a400b9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:02.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.560+0000 7f5a3fe00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5a400b7120 0x7f5a400b7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:02.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.560+0000 7f5a3fe00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a400d2850 con 0x7f5a40161d10 2024-05-10T04:23:02.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.560+0000 7f5a3fe00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a400d25b0 con 0x7f5a400cf360 2024-05-10T04:23:02.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.560+0000 7f5a3fe00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a400b7a70 con 0x7f5a400b7120 2024-05-10T04:23:02.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.560+0000 7f5a3ea00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a400cf360 0x7f5a400b9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:02.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.561+0000 7f5a3ea00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a400cf360 0x7f5a400b9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35920/0 (socket says 172.21.15.80:35920) 2024-05-10T04:23:02.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.561+0000 7f5a3ea00700 1 -- 172.21.15.80:0/2237896062 learned_addr learned my addr 172.21.15.80:0/2237896062 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:02.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.561+0000 7f5a3f400700 1 --2- 172.21.15.80:0/2237896062 >> v2:172.21.15.106:3300/0 conn(0x7f5a400b7120 0x7f5a400b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:02.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.561+0000 7f5a3ea00700 1 -- 172.21.15.80:0/2237896062 >> v2:172.21.15.106:3300/0 conn(0x7f5a400b7120 msgr2=0x7f5a400b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:02.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.561+0000 7f5a3ea00700 1 --2- 172.21.15.80:0/2237896062 >> v2:172.21.15.106:3300/0 conn(0x7f5a400b7120 0x7f5a400b7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:02.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.561+0000 7f5a3ea00700 1 -- 172.21.15.80:0/2237896062 >> v1:172.21.15.106:6789/0 conn(0x7f5a40161d10 legacy=0x7f5a400d2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:02.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.561+0000 7f5a3ea00700 1 -- 172.21.15.80:0/2237896062 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a400cf770 con 0x7f5a400cf360 2024-05-10T04:23:02.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.561+0000 7f5a3f400700 1 --2- 172.21.15.80:0/2237896062 >> v2:172.21.15.106:3300/0 conn(0x7f5a400b7120 0x7f5a400b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:02.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.561+0000 7f5a3ea00700 1 --2- 172.21.15.80:0/2237896062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a400cf360 0x7f5a400b9420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5a4008c420 tx=0x7f5a30009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9806df89766261bb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:02.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.561+0000 7f5a3e000700 1 -- 172.21.15.80:0/2237896062 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30004230 con 0x7f5a400cf360 2024-05-10T04:23:02.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.561+0000 7f5a3e000700 1 -- 172.21.15.80:0/2237896062 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a30004390 con 0x7f5a400cf360 2024-05-10T04:23:02.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.562+0000 7f5a3e000700 1 -- 172.21.15.80:0/2237896062 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300036a0 con 0x7f5a400cf360 2024-05-10T04:23:02.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.562+0000 7f5a3fe00700 1 -- 172.21.15.80:0/2237896062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a400cf360 msgr2=0x7f5a400b9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:02.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.562+0000 7f5a3fe00700 1 --2- 172.21.15.80:0/2237896062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a400cf360 0x7f5a400b9420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5a4008c420 tx=0x7f5a30009bd0 comp rx=0 tx=0).stop 2024-05-10T04:23:02.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.562+0000 7f5a3fe00700 1 -- 172.21.15.80:0/2237896062 shutdown_connections 2024-05-10T04:23:02.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.562+0000 7f5a3fe00700 1 --2- 172.21.15.80:0/2237896062 >> v2:172.21.15.106:3300/0 conn(0x7f5a400b7120 0x7f5a400b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:02.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.562+0000 7f5a3fe00700 1 --2- 172.21.15.80:0/2237896062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a400cf360 0x7f5a400b9420 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:02.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.562+0000 7f5a3fe00700 1 -- 172.21.15.80:0/2237896062 >> 172.21.15.80:0/2237896062 conn(0x7f5a4006c4e0 msgr2=0x7f5a4006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:02.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.562+0000 7f5a3fe00700 1 -- 172.21.15.80:0/2237896062 shutdown_connections 2024-05-10T04:23:02.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.562+0000 7f5a3fe00700 1 -- 172.21.15.80:0/2237896062 wait complete. 2024-05-10T04:23:02.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.565+0000 7f5a3fe00700 1 Processor -- start 2024-05-10T04:23:02.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.566+0000 7f5a3fe00700 1 -- start start 2024-05-10T04:23:02.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.567+0000 7f5a3fe00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a400b7120 0x7f5a4015a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:02.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.567+0000 7f5a3fe00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a400cf360 0x7f5a40157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:02.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.567+0000 7f5a3fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a40161d10 0x7f5a400cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:02.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.567+0000 7f5a3fe00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400cdb00 con 0x7f5a40161d10 2024-05-10T04:23:02.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.567+0000 7f5a3fe00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4015b240 con 0x7f5a400cf360 2024-05-10T04:23:02.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.567+0000 7f5a3fe00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400cacc0 con 0x7f5a400b7120 2024-05-10T04:23:02.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.568+0000 7f5a3f400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a40161d10 0x7f5a400cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:02.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.568+0000 7f5a3ea00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a400b7120 0x7f5a4015a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:02.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.568+0000 7f5a37e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a400cf360 0x7f5a40157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:02.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.568+0000 7f5a3ea00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a400b7120 0x7f5a4015a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:45974/0 (socket says 172.21.15.80:45974) 2024-05-10T04:23:02.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.568+0000 7f5a3ea00700 1 -- 172.21.15.80:0/1406274331 learned_addr learned my addr 172.21.15.80:0/1406274331 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:02.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.568+0000 7f5a3f400700 1 -- 172.21.15.80:0/1406274331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a400b7120 msgr2=0x7f5a4015a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:02.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.568+0000 7f5a3f400700 1 --2- 172.21.15.80:0/1406274331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a400b7120 0x7f5a4015a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:02.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.568+0000 7f5a3f400700 1 -- 172.21.15.80:0/1406274331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a400cf360 msgr2=0x7f5a40157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:02.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.568+0000 7f5a3f400700 1 --2- 172.21.15.80:0/1406274331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a400cf360 0x7f5a40157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:02.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.568+0000 7f5a3f400700 1 -- 172.21.15.80:0/1406274331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a30009550 con 0x7f5a40161d10 2024-05-10T04:23:02.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.568+0000 7f5a3f400700 1 --2- 172.21.15.80:0/1406274331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a40161d10 0x7f5a400cbfb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800ccc0 tx=0x7f5a3800a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:02.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.569+0000 7f5a36a00700 1 -- 172.21.15.80:0/1406274331 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800ace0 con 0x7f5a40161d10 2024-05-10T04:23:02.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.569+0000 7f5a36a00700 1 -- 172.21.15.80:0/1406274331 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3800ae60 con 0x7f5a40161d10 2024-05-10T04:23:02.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.569+0000 7f5a36a00700 1 -- 172.21.15.80:0/1406274331 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800f6c0 con 0x7f5a40161d10 2024-05-10T04:23:02.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.569+0000 7f5a3fe00700 1 -- 172.21.15.80:0/1406274331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a400caf10 con 0x7f5a40161d10 2024-05-10T04:23:02.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.569+0000 7f5a3fe00700 1 -- 172.21.15.80:0/1406274331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a400cb4d0 con 0x7f5a40161d10 2024-05-10T04:23:02.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.570+0000 7f5a3fe00700 1 -- 172.21.15.80:0/1406274331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a40074af0 con 0x7f5a40161d10 2024-05-10T04:23:02.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.571+0000 7f5a36a00700 1 -- 172.21.15.80:0/1406274331 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5a3800b040 con 0x7f5a40161d10 2024-05-10T04:23:02.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.572+0000 7f5a36a00700 1 --2- 172.21.15.80:0/1406274331 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5a1c06ac90 0x7f5a1c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:02.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.572+0000 7f5a36a00700 1 -- 172.21.15.80:0/1406274331 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a380899b0 con 0x7f5a40161d10 2024-05-10T04:23:02.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.572+0000 7f5a3ea00700 1 --2- 172.21.15.80:0/1406274331 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5a1c06ac90 0x7f5a1c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:02.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.573+0000 7f5a3ea00700 1 --2- 172.21.15.80:0/1406274331 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5a1c06ac90 0x7f5a1c06d1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009c10 tx=0x7f5a30008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:02.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.576+0000 7f5a36a00700 1 -- 172.21.15.80:0/1406274331 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5a38054ba0 con 0x7f5a40161d10 2024-05-10T04:23:02.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.829+0000 7f5a3fe00700 1 -- 172.21.15.80:0/1406274331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5a40161310 con 0x7f5a40161d10 2024-05-10T04:23:02.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.829+0000 7f5a36a00700 1 -- 172.21.15.80:0/1406274331 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5a380581c0 con 0x7f5a40161d10 2024-05-10T04:23:02.830 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T04:23:02.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.832+0000 7f5a3fe00700 1 -- 172.21.15.80:0/1406274331 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5a1c06ac90 msgr2=0x7f5a1c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:02.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.832+0000 7f5a3fe00700 1 --2- 172.21.15.80:0/1406274331 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5a1c06ac90 0x7f5a1c06d1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009c10 tx=0x7f5a30008030 comp rx=0 tx=0).stop 2024-05-10T04:23:02.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.832+0000 7f5a3fe00700 1 -- 172.21.15.80:0/1406274331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a40161d10 msgr2=0x7f5a400cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:02.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.832+0000 7f5a3fe00700 1 --2- 172.21.15.80:0/1406274331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a40161d10 0x7f5a400cbfb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800ccc0 tx=0x7f5a3800a280 comp rx=0 tx=0).stop 2024-05-10T04:23:02.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.832+0000 7f5a3fe00700 1 -- 172.21.15.80:0/1406274331 shutdown_connections 2024-05-10T04:23:02.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.832+0000 7f5a3fe00700 1 --2- 172.21.15.80:0/1406274331 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5a1c06ac90 0x7f5a1c06d1a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:02.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.832+0000 7f5a3fe00700 1 --2- 172.21.15.80:0/1406274331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a40161d10 0x7f5a400cbfb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:02.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.832+0000 7f5a3fe00700 1 --2- 172.21.15.80:0/1406274331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a400b7120 0x7f5a4015a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:02.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.832+0000 7f5a3fe00700 1 --2- 172.21.15.80:0/1406274331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a400cf360 0x7f5a40157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:02.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.832+0000 7f5a3fe00700 1 -- 172.21.15.80:0/1406274331 >> 172.21.15.80:0/1406274331 conn(0x7f5a4006c4e0 msgr2=0x7f5a4006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:02.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.832+0000 7f5a3fe00700 1 -- 172.21.15.80:0/1406274331 shutdown_connections 2024-05-10T04:23:02.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:02.832+0000 7f5a3fe00700 1 -- 172.21.15.80:0/1406274331 wait complete. 2024-05-10T04:23:02.861 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T04:23:02.861 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T04:23:02.861 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-05-10T04:23:02.861 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-10T04:23:02.861 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-10T04:23:02.861 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T04:23:02.861 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T04:23:02.861 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T04:23:02.861 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-10T04:23:02.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:02.862 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-05-10T04:23:02.904 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:23:02.904 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:23:02.905 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:23:02.905 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:02.905 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-05-10T04:23:02.905 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:02.905 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:23:02.905 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:23:02.905 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-05-10T04:23:02.905 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:23:02.905 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:23:02.905 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-05-10T04:23:02.905 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:23:02.905 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:23:02.905 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T04:23:02.906 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:23:02.906 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-10T04:23:02.906 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42141sec preferred_lft 42141sec 2024-05-10T04:23:02.906 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::ec4:7aff:fe8f:cba9/64 scope link 2024-05-10T04:23:02.906 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:02.906 INFO:teuthology.orchestra.run.smithi080.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T04:23:02.906 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 7a:a0:0d:92:85:4e brd ff:ff:ff:ff:ff:ff 2024-05-10T04:23:02.906 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T04:23:02.906 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:02.906 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::d0f9:bbff:fedc:adfa/64 scope link 2024-05-10T04:23:02.906 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:02.906 INFO:teuthology.orchestra.run.smithi080.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T04:23:02.906 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 7a:a0:0d:92:85:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T04:23:02.906 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::78a0:dff:fe92:854e/64 scope link 2024-05-10T04:23:02.907 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:02.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:02.907 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T04:23:03.007 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-05-10T04:23:03.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:03.011 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-05-10T04:23:03.057 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-05-10T04:23:03.057 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T04:23:03.057 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T04:23:03.057 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T04:23:03.057 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T04:23:03.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:03.057 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-10T04:23:03.057 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-10T04:23:03.058 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T04:23:03.058 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T04:23:03.058 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T04:23:03.058 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-10T04:23:03.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:03.272 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-05-10T04:23:03.314 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T04:23:03.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:03.315 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list-id 2024-05-10T04:23:03.396 INFO:teuthology.orchestra.run.smithi080.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-10T04:23:03.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:03.398 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-10T04:23:03.398 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-10T04:23:03.398 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T04:23:03.398 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-10T04:23:03.398 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-10T04:23:03.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:03.573 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-10T04:23:03.640 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:23:03.640 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:23:03.640 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:23:03.640 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:03.640 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-05-10T04:23:03.640 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:03.641 INFO:teuthology.orchestra.run.smithi080.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T04:23:03.641 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 9e:23:29:ef:af:f1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T04:23:03.641 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T04:23:03.641 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:03.641 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::9c23:29ff:feef:aff1/64 scope link 2024-05-10T04:23:03.641 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:03.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:03.643 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-10T04:23:03.708 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:23:03.709 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:23:03.709 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:23:03.709 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:03.709 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-05-10T04:23:03.709 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:03.709 INFO:teuthology.orchestra.run.smithi080.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T04:23:03.709 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 9e:23:29:ef:af:f1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T04:23:03.709 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T04:23:03.709 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:03.709 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::9c23:29ff:feef:aff1/64 scope link 2024-05-10T04:23:03.709 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:03.712 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-10T04:23:03.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:03.712 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-10T04:23:03.712 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-10T04:23:03.712 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-10T04:23:03.712 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-10T04:23:03.712 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-10T04:23:03.712 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-10T04:23:03.713 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-10T04:23:03.713 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-10T04:23:03.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:03.954 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-10T04:23:03.954 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-10T04:23:03.954 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.1 up 2024-05-10T04:23:03.954 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set dev brx.1 master ceph-brx 2024-05-10T04:23:03.954 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-10T04:23:04.121 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:23:04.122 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-10T04:23:04.164 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-10T04:23:04.164 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:23:04.165 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-10T04:23:04.246 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-05-10T04:23:04.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:04.246 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:23:04.456 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:23:04.456 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-10T04:23:04.499 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:23:04.499 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-10T04:23:04.499 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.106:3300,172.21.15.106:3301" 2024-05-10T04:23:04.499 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with new device syntax: 2@7fdf09a1-1b63-4484-b77e-59e97b1b5367.cephfs=/ 2024-05-10T04:23:04.500 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.80:3300/172.21.15.106:3300/172.21.15.106:3301" will pass to kernel 2024-05-10T04:23:04.504 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T04:23:04.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:04.505 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-10T04:23:04.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:04.569 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:23:04.651 INFO:teuthology.orchestra.run.smithi080.stdout:client4647 2024-05-10T04:23:04.651 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:23:04.651 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:23:04.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:04.693 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:23:04.816 INFO:teuthology.orchestra.run.smithi080.stdout:client4647 2024-05-10T04:23:04.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:04.817 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:23:04.898 INFO:teuthology.orchestra.run.smithi080.stdout:client4647 2024-05-10T04:23:04.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:04.899 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/7fdf09a1-1b63-4484-b77e-59e97b1b5367.client4647/status') 2024-05-10T04:23:05.000 INFO:teuthology.orchestra.run.smithi080.stdout:instance: client.4647 (3)192.168.0.2:0/1934827728 2024-05-10T04:23:05.000 INFO:teuthology.orchestra.run.smithi080.stdout:blocklisted: false 2024-05-10T04:23:05.000 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records in 2024-05-10T04:23:05.000 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records out 2024-05-10T04:23:05.000 INFO:teuthology.orchestra.run.smithi080.stderr:69 bytes copied, 5.3131e-05 s, 1.3 MB/s 2024-05-10T04:23:05.003 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-05-10T04:23:05.003 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T04:23:05.003 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-10T04:23:05.004 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T04:23:05.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.265+0000 7f205bc00700 1 Processor -- start 2024-05-10T04:23:05.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.265+0000 7f205bc00700 1 -- start start 2024-05-10T04:23:05.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.267+0000 7f205bc00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20540ce370 0x7f20540ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:05.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.267+0000 7f205bc00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20540cfeb0 con 0x7f205406d740 2024-05-10T04:23:05.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.267+0000 7f205bc00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20540cecc0 con 0x7f205415e9e0 2024-05-10T04:23:05.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.267+0000 7f205bc00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2054162f30 con 0x7f20540ce370 2024-05-10T04:23:05.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.267+0000 7f2053e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20540ce370 0x7f20540ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:05.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.267+0000 7f2053e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20540ce370 0x7f20540ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42768/0 (socket says 172.21.15.80:42768) 2024-05-10T04:23:05.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.267+0000 7f2053e00700 1 -- 172.21.15.80:0/1578718009 learned_addr learned my addr 172.21.15.80:0/1578718009 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:05.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.267+0000 7f2059200700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f205406d740 0x7f20540cf7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35670/0 (socket says 172.21.15.80:35670) 2024-05-10T04:23:05.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.267+0000 7f2053e00700 1 -- 172.21.15.80:0/1578718009 >> v1:172.21.15.106:6789/0 conn(0x7f205415e9e0 legacy=0x7f205415edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:05.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.267+0000 7f2053e00700 1 -- 172.21.15.80:0/1578718009 >> v1:172.21.15.80:6789/0 conn(0x7f205406d740 legacy=0x7f20540cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:05.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.267+0000 7f2053e00700 1 -- 172.21.15.80:0/1578718009 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2054162170 con 0x7f20540ce370 2024-05-10T04:23:05.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.267+0000 7f2053400700 1 -- 172.21.15.80:0/1578718009 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942059883 0 0) 0x7f20540cfeb0 con 0x7f205406d740 2024-05-10T04:23:05.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.268+0000 7f2053e00700 1 --2- 172.21.15.80:0/1578718009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20540ce370 0x7f20540ce780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f20400098f0 tx=0x7f2040009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7647089209ecf1c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:05.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.268+0000 7f2053400700 1 -- 172.21.15.80:0/1578718009 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204000b8a0 con 0x7f20540ce370 2024-05-10T04:23:05.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.268+0000 7f2053400700 1 -- 172.21.15.80:0/1578718009 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204000ba00 con 0x7f20540ce370 2024-05-10T04:23:05.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.268+0000 7f2053400700 1 -- 172.21.15.80:0/1578718009 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204000bd90 con 0x7f20540ce370 2024-05-10T04:23:05.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.269+0000 7f205bc00700 1 -- 172.21.15.80:0/1578718009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20540ce370 msgr2=0x7f20540ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:05.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.269+0000 7f205bc00700 1 --2- 172.21.15.80:0/1578718009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20540ce370 0x7f20540ce780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f20400098f0 tx=0x7f2040009c00 comp rx=0 tx=0).stop 2024-05-10T04:23:05.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.269+0000 7f205bc00700 1 -- 172.21.15.80:0/1578718009 shutdown_connections 2024-05-10T04:23:05.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.269+0000 7f205bc00700 1 --2- 172.21.15.80:0/1578718009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20540ce370 0x7f20540ce780 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:05.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.269+0000 7f205bc00700 1 -- 172.21.15.80:0/1578718009 >> 172.21.15.80:0/1578718009 conn(0x7f205406f810 msgr2=0x7f205406fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:05.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.269+0000 7f205bc00700 1 -- 172.21.15.80:0/1578718009 shutdown_connections 2024-05-10T04:23:05.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.269+0000 7f205bc00700 1 -- 172.21.15.80:0/1578718009 wait complete. 2024-05-10T04:23:05.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.271+0000 7f205bc00700 1 Processor -- start 2024-05-10T04:23:05.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.271+0000 7f205bc00700 1 -- start start 2024-05-10T04:23:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.273+0000 7f205bc00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f205406d740 0x7f20541f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.273+0000 7f205bc00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20540ce370 0x7f20540b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.273+0000 7f205bc00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f205415e9e0 0x7f20540b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.273+0000 7f205bc00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20540d0110 con 0x7f205415e9e0 2024-05-10T04:23:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.273+0000 7f205bc00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20540b6a40 con 0x7f205406d740 2024-05-10T04:23:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.273+0000 7f205bc00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205415ac70 con 0x7f20540ce370 2024-05-10T04:23:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.273+0000 7f2059c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f205415e9e0 0x7f20540b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.273+0000 7f2059200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f205406d740 0x7f20541f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.273+0000 7f2059c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f205415e9e0 0x7f20540b5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42776/0 (socket says 172.21.15.80:42776) 2024-05-10T04:23:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.273+0000 7f2059200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f205406d740 0x7f20541f7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:60058/0 (socket says 172.21.15.80:60058) 2024-05-10T04:23:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.273+0000 7f2059c00700 1 -- 172.21.15.80:0/520197062 learned_addr learned my addr 172.21.15.80:0/520197062 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.273+0000 7f2053e00700 1 --2- 172.21.15.80:0/520197062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20540ce370 0x7f20540b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.274+0000 7f2059c00700 1 -- 172.21.15.80:0/520197062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20540ce370 msgr2=0x7f20540b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.274+0000 7f2059c00700 1 --2- 172.21.15.80:0/520197062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20540ce370 0x7f20540b5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.274+0000 7f2059c00700 1 -- 172.21.15.80:0/520197062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f205406d740 msgr2=0x7f20541f7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.274+0000 7f2059c00700 1 --2- 172.21.15.80:0/520197062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f205406d740 0x7f20541f7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.274+0000 7f2059c00700 1 -- 172.21.15.80:0/520197062 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2040009550 con 0x7f205415e9e0 2024-05-10T04:23:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.274+0000 7f2059c00700 1 --2- 172.21.15.80:0/520197062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f205415e9e0 0x7f20540b5d50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f204c00cbd0 tx=0x7f204c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.274+0000 7f2050c00700 1 -- 172.21.15.80:0/520197062 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c003c00 con 0x7f205415e9e0 2024-05-10T04:23:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.274+0000 7f2050c00700 1 -- 172.21.15.80:0/520197062 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204c003d60 con 0x7f205415e9e0 2024-05-10T04:23:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.274+0000 7f2050c00700 1 -- 172.21.15.80:0/520197062 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c00aa80 con 0x7f205415e9e0 2024-05-10T04:23:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.274+0000 7f205bc00700 1 -- 172.21.15.80:0/520197062 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f205415aec0 con 0x7f205415e9e0 2024-05-10T04:23:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.274+0000 7f205bc00700 1 -- 172.21.15.80:0/520197062 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f205415b480 con 0x7f205415e9e0 2024-05-10T04:23:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.275+0000 7f205bc00700 1 -- 172.21.15.80:0/520197062 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f205406ca80 con 0x7f205415e9e0 2024-05-10T04:23:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.277+0000 7f2050c00700 1 -- 172.21.15.80:0/520197062 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f204c00abe0 con 0x7f205415e9e0 2024-05-10T04:23:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.278+0000 7f2050c00700 1 --2- 172.21.15.80:0/520197062 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f203406ac90 0x7f203406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.278+0000 7f2050c00700 1 -- 172.21.15.80:0/520197062 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f204c0893a0 con 0x7f205415e9e0 2024-05-10T04:23:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.278+0000 7f2059200700 1 --2- 172.21.15.80:0/520197062 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f203406ac90 0x7f203406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:05.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.279+0000 7f2059200700 1 --2- 172.21.15.80:0/520197062 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f203406ac90 0x7f203406d1a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2048000f60 tx=0x7f2048004a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:05.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.283+0000 7f2050c00700 1 -- 172.21.15.80:0/520197062 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f204c054450 con 0x7f205415e9e0 2024-05-10T04:23:05.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.534+0000 7f205bc00700 1 -- 172.21.15.80:0/520197062 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2054074af0 con 0x7f205415e9e0 2024-05-10T04:23:05.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.535+0000 7f2050c00700 1 -- 172.21.15.80:0/520197062 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f204c057a70 con 0x7f205415e9e0 2024-05-10T04:23:05.536 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T04:23:05.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.537+0000 7f205bc00700 1 -- 172.21.15.80:0/520197062 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f203406ac90 msgr2=0x7f203406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.537+0000 7f205bc00700 1 --2- 172.21.15.80:0/520197062 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f203406ac90 0x7f203406d1a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2048000f60 tx=0x7f2048004a50 comp rx=0 tx=0).stop 2024-05-10T04:23:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.537+0000 7f205bc00700 1 -- 172.21.15.80:0/520197062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f205415e9e0 msgr2=0x7f20540b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.537+0000 7f205bc00700 1 --2- 172.21.15.80:0/520197062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f205415e9e0 0x7f20540b5d50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f204c00cbd0 tx=0x7f204c00cee0 comp rx=0 tx=0).stop 2024-05-10T04:23:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.537+0000 7f205bc00700 1 -- 172.21.15.80:0/520197062 shutdown_connections 2024-05-10T04:23:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.537+0000 7f205bc00700 1 --2- 172.21.15.80:0/520197062 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f203406ac90 0x7f203406d1a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.537+0000 7f205bc00700 1 --2- 172.21.15.80:0/520197062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f205415e9e0 0x7f20540b5d50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.537+0000 7f205bc00700 1 --2- 172.21.15.80:0/520197062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f205406d740 0x7f20541f7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.537+0000 7f205bc00700 1 --2- 172.21.15.80:0/520197062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20540ce370 0x7f20540b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.537+0000 7f205bc00700 1 -- 172.21.15.80:0/520197062 >> 172.21.15.80:0/520197062 conn(0x7f205406f810 msgr2=0x7f2054161370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.537+0000 7f205bc00700 1 -- 172.21.15.80:0/520197062 shutdown_connections 2024-05-10T04:23:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:05.537+0000 7f205bc00700 1 -- 172.21.15.80:0/520197062 wait complete. 2024-05-10T04:23:05.566 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T04:23:05.567 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T04:23:05.567 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2024-05-10T04:23:05.567 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-10T04:23:05.567 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-10T04:23:05.567 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T04:23:05.567 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T04:23:05.567 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T04:23:05.567 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-10T04:23:05.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:05.567 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2024-05-10T04:23:05.613 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:23:05.613 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:23:05.614 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:23:05.614 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:05.614 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-05-10T04:23:05.614 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:05.614 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:23:05.614 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2024-05-10T04:23:05.614 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2024-05-10T04:23:05.614 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:23:05.614 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2024-05-10T04:23:05.614 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2024-05-10T04:23:05.614 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:23:05.614 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2024-05-10T04:23:05.615 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T04:23:05.615 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2024-05-10T04:23:05.615 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-10T04:23:05.615 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42123sec preferred_lft 42123sec 2024-05-10T04:23:05.615 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2024-05-10T04:23:05.615 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:05.616 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T04:23:05.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:05.616 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-05-10T04:23:05.616 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-05-10T04:23:05.616 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add name ceph-brx type bridge 2024-05-10T04:23:05.616 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr flush dev ceph-brx 2024-05-10T04:23:05.617 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set ceph-brx up 2024-05-10T04:23:05.617 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T04:23:05.617 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-05-10T04:23:06.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:06.068 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T04:23:06.135 INFO:teuthology.orchestra.run.smithi106.stdout:1 2024-05-10T04:23:06.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:06.139 DEBUG:teuthology.orchestra.run.smithi106:> route 2024-05-10T04:23:06.196 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2024-05-10T04:23:06.196 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T04:23:06.197 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T04:23:06.197 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T04:23:06.197 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T04:23:06.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:06.197 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-05-10T04:23:06.197 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-05-10T04:23:06.197 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T04:23:06.197 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T04:23:06.197 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T04:23:06.198 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-05-10T04:23:06.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:06.886 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-05-10T04:23:06.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:06.929 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list-id 2024-05-10T04:23:07.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:07.011 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-05-10T04:23:07.012 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-05-10T04:23:07.012 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-10T04:23:07.012 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-10T04:23:07.012 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-05-10T04:23:07.189 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-10T04:23:07.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:07.189 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-05-10T04:23:07.189 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-05-10T04:23:07.189 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-10T04:23:07.189 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T04:23:07.189 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-10T04:23:07.190 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-10T04:23:07.190 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-10T04:23:07.190 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-05-10T04:23:07.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:07.466 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-05-10T04:23:07.466 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-05-10T04:23:07.466 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.0 up 2024-05-10T04:23:07.466 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T04:23:07.467 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-05-10T04:23:07.633 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:23:07.633 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-10T04:23:07.675 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-10T04:23:07.676 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:23:07.676 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-10T04:23:07.757 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-10T04:23:07.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:07.757 DEBUG:teuthology.orchestra.run.smithi106:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:23:07.969 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:23:07.970 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-10T04:23:08.717 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:23:08.717 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-10T04:23:08.718 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.106:3300,172.21.15.106:3301" 2024-05-10T04:23:08.718 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: trying mount with new device syntax: 1@7fdf09a1-1b63-4484-b77e-59e97b1b5367.cephfs=/ 2024-05-10T04:23:08.718 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.80:3300/172.21.15.106:3300/172.21.15.106:3301" will pass to kernel 2024-05-10T04:23:08.724 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T04:23:08.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:08.724 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-10T04:23:08.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:08.794 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:23:08.882 INFO:teuthology.orchestra.run.smithi106.stdout:client4559 2024-05-10T04:23:08.883 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:23:08.883 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:23:08.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:08.924 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:23:09.050 INFO:teuthology.orchestra.run.smithi106.stdout:client4559 2024-05-10T04:23:09.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:09.051 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:23:09.132 INFO:teuthology.orchestra.run.smithi106.stdout:client4559 2024-05-10T04:23:09.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:09.132 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/7fdf09a1-1b63-4484-b77e-59e97b1b5367.client4559/status') 2024-05-10T04:23:09.234 INFO:teuthology.orchestra.run.smithi106.stdout:instance: client.4559 (3)192.168.0.1:0/2469247938 2024-05-10T04:23:09.234 INFO:teuthology.orchestra.run.smithi106.stdout:blocklisted: false 2024-05-10T04:23:09.235 INFO:teuthology.orchestra.run.smithi106.stderr:0+1 records in 2024-05-10T04:23:09.235 INFO:teuthology.orchestra.run.smithi106.stderr:0+1 records out 2024-05-10T04:23:09.235 INFO:teuthology.orchestra.run.smithi106.stderr:69 bytes copied, 5.4422e-05 s, 1.3 MB/s 2024-05-10T04:23:09.237 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-05-10T04:23:09.238 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T04:23:09.238 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-10T04:23:09.238 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T04:23:09.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.510+0000 7f29cd400700 1 Processor -- start 2024-05-10T04:23:09.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.510+0000 7f29cd400700 1 -- start start 2024-05-10T04:23:09.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.512+0000 7f29cd400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29c80b9420 0x7f29c80d2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:09.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.512+0000 7f29cd400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29c80d3220 0x7f29c80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:09.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.512+0000 7f29cd400700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c80d2850 con 0x7f29c80cf360 2024-05-10T04:23:09.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.512+0000 7f29cd400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c80d3630 con 0x7f29c80d3220 2024-05-10T04:23:09.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.512+0000 7f29cd400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80d25b0 con 0x7f29c80b9420 2024-05-10T04:23:09.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.512+0000 7f29cca00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29c80d3220 0x7f29c80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:09.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.512+0000 7f29c7400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29c80b9420 0x7f29c80d2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:09.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.512+0000 7f29c7e00700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f29c80cf360 0x7f29c8161d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:36214/0 (socket says 172.21.15.80:36214) 2024-05-10T04:23:09.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.512+0000 7f29c7e00700 1 -- 172.21.15.80:0/4085029304 learned_addr learned my addr 172.21.15.80:0/4085029304 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:09.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.513+0000 7f29cca00700 1 -- 172.21.15.80:0/4085029304 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29c80b9420 msgr2=0x7f29c80d2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:09.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.513+0000 7f29cca00700 1 --2- 172.21.15.80:0/4085029304 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29c80b9420 0x7f29c80d2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:09.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.513+0000 7f29cca00700 1 -- 172.21.15.80:0/4085029304 >> v1:172.21.15.106:6789/0 conn(0x7f29c80cf360 legacy=0x7f29c8161d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:09.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.513+0000 7f29cca00700 1 -- 172.21.15.80:0/4085029304 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c80cf770 con 0x7f29c80d3220 2024-05-10T04:23:09.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.513+0000 7f29c6a00700 1 -- 172.21.15.80:0/4085029304 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286737670 0 0) 0x7f29c80d2850 con 0x7f29c80cf360 2024-05-10T04:23:09.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.513+0000 7f29c7400700 1 --2- 172.21.15.80:0/4085029304 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29c80b9420 0x7f29c80d2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:23:09.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.513+0000 7f29cca00700 1 --2- 172.21.15.80:0/4085029304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29c80d3220 0x7f29c80b7120 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009d90 tx=0x7f29c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5070adeee994ed32 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:09.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.514+0000 7f29c6a00700 1 -- 172.21.15.80:0/4085029304 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c000e070 con 0x7f29c80d3220 2024-05-10T04:23:09.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.514+0000 7f29c6a00700 1 -- 172.21.15.80:0/4085029304 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c000bb20 con 0x7f29c80d3220 2024-05-10T04:23:09.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.514+0000 7f29c6a00700 1 -- 172.21.15.80:0/4085029304 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c0012430 con 0x7f29c80d3220 2024-05-10T04:23:09.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.514+0000 7f29cd400700 1 -- 172.21.15.80:0/4085029304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29c80d3220 msgr2=0x7f29c80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:09.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.514+0000 7f29cd400700 1 --2- 172.21.15.80:0/4085029304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29c80d3220 0x7f29c80b7120 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009d90 tx=0x7f29c000b330 comp rx=0 tx=0).stop 2024-05-10T04:23:09.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.514+0000 7f29cd400700 1 -- 172.21.15.80:0/4085029304 shutdown_connections 2024-05-10T04:23:09.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.514+0000 7f29cd400700 1 --2- 172.21.15.80:0/4085029304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29c80d3220 0x7f29c80b7120 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:09.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.514+0000 7f29cd400700 1 --2- 172.21.15.80:0/4085029304 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29c80b9420 0x7f29c80d2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:09.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.514+0000 7f29cd400700 1 -- 172.21.15.80:0/4085029304 >> 172.21.15.80:0/4085029304 conn(0x7f29c806c4e0 msgr2=0x7f29c806c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:09.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.514+0000 7f29cd400700 1 -- 172.21.15.80:0/4085029304 shutdown_connections 2024-05-10T04:23:09.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.515+0000 7f29cd400700 1 -- 172.21.15.80:0/4085029304 wait complete. 2024-05-10T04:23:09.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.517+0000 7f29cd400700 1 Processor -- start 2024-05-10T04:23:09.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.517+0000 7f29cd400700 1 -- start start 2024-05-10T04:23:09.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.519+0000 7f29cd400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29c80b9420 0x7f29c81f11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:09.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.519+0000 7f29cd400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29c80cf360 0x7f29c80cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:09.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.519+0000 7f29cd400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29c80d3220 0x7f29c80ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:09.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.519+0000 7f29cd400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c81f1700 con 0x7f29c80d3220 2024-05-10T04:23:09.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.519+0000 7f29cd400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80c8a60 con 0x7f29c80b9420 2024-05-10T04:23:09.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.519+0000 7f29cd400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c81f81f0 con 0x7f29c80cf360 2024-05-10T04:23:09.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.519+0000 7f29cca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29c80d3220 0x7f29c80ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:09.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.519+0000 7f29c7400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29c80cf360 0x7f29c80cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:09.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.519+0000 7f29cca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29c80d3220 0x7f29c80ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42796/0 (socket says 172.21.15.80:42796) 2024-05-10T04:23:09.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.519+0000 7f29cca00700 1 -- 172.21.15.80:0/2867722141 learned_addr learned my addr 172.21.15.80:0/2867722141 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:09.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.519+0000 7f29c7400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29c80cf360 0x7f29c80cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:37322/0 (socket says 172.21.15.80:37322) 2024-05-10T04:23:09.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.519+0000 7f29c7e00700 1 --2- 172.21.15.80:0/2867722141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29c80b9420 0x7f29c81f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:09.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.519+0000 7f29cca00700 1 -- 172.21.15.80:0/2867722141 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29c80cf360 msgr2=0x7f29c80cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:09.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.519+0000 7f29cca00700 1 --2- 172.21.15.80:0/2867722141 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29c80cf360 0x7f29c80cca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:09.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.519+0000 7f29cca00700 1 -- 172.21.15.80:0/2867722141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29c80b9420 msgr2=0x7f29c81f11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:09.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.519+0000 7f29cca00700 1 --2- 172.21.15.80:0/2867722141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29c80b9420 0x7f29c81f11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:09.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.520+0000 7f29cca00700 1 -- 172.21.15.80:0/2867722141 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40094a0 con 0x7f29c80d3220 2024-05-10T04:23:09.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.520+0000 7f29cca00700 1 --2- 172.21.15.80:0/2867722141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29c80d3220 0x7f29c80ccf80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f29c80b6800 tx=0x7f29c0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:09.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.520+0000 7f29bfe00700 1 -- 172.21.15.80:0/2867722141 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c0003c20 con 0x7f29c80d3220 2024-05-10T04:23:09.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.520+0000 7f29bfe00700 1 -- 172.21.15.80:0/2867722141 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c0020070 con 0x7f29c80d3220 2024-05-10T04:23:09.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.520+0000 7f29cd400700 1 -- 172.21.15.80:0/2867722141 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c0009a70 con 0x7f29c80d3220 2024-05-10T04:23:09.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.520+0000 7f29bfe00700 1 -- 172.21.15.80:0/2867722141 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c00098f0 con 0x7f29c80d3220 2024-05-10T04:23:09.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.520+0000 7f29cd400700 1 -- 172.21.15.80:0/2867722141 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c81f4050 con 0x7f29c80d3220 2024-05-10T04:23:09.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.521+0000 7f29cd400700 1 -- 172.21.15.80:0/2867722141 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c81f4980 con 0x7f29c80d3220 2024-05-10T04:23:09.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.523+0000 7f29bfe00700 1 -- 172.21.15.80:0/2867722141 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f29c001b610 con 0x7f29c80d3220 2024-05-10T04:23:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.523+0000 7f29bfe00700 1 --2- 172.21.15.80:0/2867722141 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f29a806ac90 0x7f29a806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.523+0000 7f29bfe00700 1 -- 172.21.15.80:0/2867722141 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29c0022070 con 0x7f29c80d3220 2024-05-10T04:23:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.524+0000 7f29c7e00700 1 --2- 172.21.15.80:0/2867722141 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f29a806ac90 0x7f29a806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.524+0000 7f29c7e00700 1 --2- 172.21.15.80:0/2867722141 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f29a806ac90 0x7f29a806d1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f29b8000f60 tx=0x7f29b8007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:09.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.529+0000 7f29bfe00700 1 -- 172.21.15.80:0/2867722141 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f29c00564d0 con 0x7f29c80d3220 2024-05-10T04:23:09.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.779+0000 7f29cd400700 1 -- 172.21.15.80:0/2867722141 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f29c81f4b30 con 0x7f29c80d3220 2024-05-10T04:23:09.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.780+0000 7f29bfe00700 1 -- 172.21.15.80:0/2867722141 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f29c81f4b30 con 0x7f29c80d3220 2024-05-10T04:23:09.781 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T04:23:09.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.782+0000 7f29cd400700 1 -- 172.21.15.80:0/2867722141 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f29a806ac90 msgr2=0x7f29a806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:09.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.782+0000 7f29cd400700 1 --2- 172.21.15.80:0/2867722141 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f29a806ac90 0x7f29a806d1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f29b8000f60 tx=0x7f29b8007e70 comp rx=0 tx=0).stop 2024-05-10T04:23:09.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.782+0000 7f29cd400700 1 -- 172.21.15.80:0/2867722141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29c80d3220 msgr2=0x7f29c80ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:09.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.782+0000 7f29cd400700 1 --2- 172.21.15.80:0/2867722141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29c80d3220 0x7f29c80ccf80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f29c80b6800 tx=0x7f29c0004ad0 comp rx=0 tx=0).stop 2024-05-10T04:23:09.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.782+0000 7f29cd400700 1 -- 172.21.15.80:0/2867722141 shutdown_connections 2024-05-10T04:23:09.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.782+0000 7f29cd400700 1 --2- 172.21.15.80:0/2867722141 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f29a806ac90 0x7f29a806d1a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:09.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.782+0000 7f29cd400700 1 --2- 172.21.15.80:0/2867722141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29c80d3220 0x7f29c80ccf80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:09.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.782+0000 7f29cd400700 1 --2- 172.21.15.80:0/2867722141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29c80b9420 0x7f29c81f11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:09.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.782+0000 7f29cd400700 1 --2- 172.21.15.80:0/2867722141 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29c80cf360 0x7f29c80cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:09.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.782+0000 7f29cd400700 1 -- 172.21.15.80:0/2867722141 >> 172.21.15.80:0/2867722141 conn(0x7f29c806c4e0 msgr2=0x7f29c80b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:09.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.782+0000 7f29cd400700 1 -- 172.21.15.80:0/2867722141 shutdown_connections 2024-05-10T04:23:09.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:09.782+0000 7f29cd400700 1 -- 172.21.15.80:0/2867722141 wait complete. 2024-05-10T04:23:09.808 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T04:23:09.808 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T04:23:09.808 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2024-05-10T04:23:09.808 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-10T04:23:09.809 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-10T04:23:09.809 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T04:23:09.809 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T04:23:09.809 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T04:23:09.809 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-10T04:23:09.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:09.809 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2024-05-10T04:23:09.852 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:23:09.852 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:23:09.852 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:23:09.852 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:09.852 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-05-10T04:23:09.852 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:09.853 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:23:09.853 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2024-05-10T04:23:09.853 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2024-05-10T04:23:09.853 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:23:09.853 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2024-05-10T04:23:09.853 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2024-05-10T04:23:09.853 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:23:09.853 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2024-05-10T04:23:09.853 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T04:23:09.853 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2024-05-10T04:23:09.853 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-10T04:23:09.853 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42119sec preferred_lft 42119sec 2024-05-10T04:23:09.853 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2024-05-10T04:23:09.853 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:09.854 INFO:teuthology.orchestra.run.smithi106.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T04:23:09.854 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 56:e9:d5:a5:98:13 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:23:09.854 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T04:23:09.854 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:09.854 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::2483:bbff:fe08:7cb6/64 scope link 2024-05-10T04:23:09.854 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:09.854 INFO:teuthology.orchestra.run.smithi106.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T04:23:09.854 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 56:e9:d5:a5:98:13 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-10T04:23:09.854 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::54e9:d5ff:fea5:9813/64 scope link 2024-05-10T04:23:09.855 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:09.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:09.856 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T04:23:09.959 INFO:teuthology.orchestra.run.smithi106.stdout:1 2024-05-10T04:23:09.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:09.962 DEBUG:teuthology.orchestra.run.smithi106:> route 2024-05-10T04:23:10.006 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2024-05-10T04:23:10.006 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T04:23:10.007 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T04:23:10.007 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T04:23:10.007 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T04:23:10.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:10.007 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-05-10T04:23:10.007 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-05-10T04:23:10.007 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T04:23:10.007 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T04:23:10.007 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T04:23:10.007 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-05-10T04:23:10.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:10.210 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-05-10T04:23:10.252 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-10T04:23:10.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:10.253 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list-id 2024-05-10T04:23:10.334 INFO:teuthology.orchestra.run.smithi106.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-10T04:23:10.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:10.336 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-05-10T04:23:10.336 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-05-10T04:23:10.336 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-10T04:23:10.336 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-10T04:23:10.336 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-05-10T04:23:10.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:10.511 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-10T04:23:10.577 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:23:10.577 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:23:10.577 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:23:10.577 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:10.577 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-05-10T04:23:10.577 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:10.578 INFO:teuthology.orchestra.run.smithi106.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T04:23:10.578 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 16:a0:25:33:b5:88 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T04:23:10.578 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T04:23:10.578 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:10.578 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::14a0:25ff:fe33:b588/64 scope link 2024-05-10T04:23:10.578 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:10.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:10.580 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-10T04:23:10.646 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:23:10.646 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:23:10.646 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:23:10.646 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:10.646 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-05-10T04:23:10.646 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:10.646 INFO:teuthology.orchestra.run.smithi106.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T04:23:10.647 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 16:a0:25:33:b5:88 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T04:23:10.647 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T04:23:10.647 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:10.647 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::14a0:25ff:fe33:b588/64 scope link 2024-05-10T04:23:10.647 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:23:10.649 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-10T04:23:10.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:10.649 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-05-10T04:23:10.649 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-05-10T04:23:10.649 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-10T04:23:10.649 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-10T04:23:10.650 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-10T04:23:10.650 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-10T04:23:10.650 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-10T04:23:10.650 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-05-10T04:23:10.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:10.895 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-05-10T04:23:10.895 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-05-10T04:23:10.895 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.1 up 2024-05-10T04:23:10.895 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set dev brx.1 master ceph-brx 2024-05-10T04:23:10.896 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-05-10T04:23:11.061 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:23:11.061 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-10T04:23:11.103 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-10T04:23:11.103 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:23:11.103 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-10T04:23:11.184 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-05-10T04:23:11.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:11.184 DEBUG:teuthology.orchestra.run.smithi106:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:23:11.395 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:23:11.395 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-10T04:23:11.434 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:23:11.434 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-10T04:23:11.434 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.106:3300,172.21.15.106:3301" 2024-05-10T04:23:11.434 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: trying mount with new device syntax: 3@7fdf09a1-1b63-4484-b77e-59e97b1b5367.cephfs=/ 2024-05-10T04:23:11.434 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.80:3300/172.21.15.106:3300/172.21.15.106:3301" will pass to kernel 2024-05-10T04:23:11.439 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T04:23:11.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:11.439 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-10T04:23:11.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:11.504 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:23:11.585 INFO:teuthology.orchestra.run.smithi106.stdout:client4636 2024-05-10T04:23:11.586 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:23:11.586 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:23:11.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:11.628 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:23:11.749 INFO:teuthology.orchestra.run.smithi106.stdout:client4636 2024-05-10T04:23:11.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:11.750 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:23:11.832 INFO:teuthology.orchestra.run.smithi106.stdout:client4636 2024-05-10T04:23:11.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:11.832 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/7fdf09a1-1b63-4484-b77e-59e97b1b5367.client4636/status') 2024-05-10T04:23:11.933 INFO:teuthology.orchestra.run.smithi106.stdout:instance: client.4636 (3)192.168.0.2:0/1015432274 2024-05-10T04:23:11.934 INFO:teuthology.orchestra.run.smithi106.stdout:blocklisted: false 2024-05-10T04:23:11.934 INFO:teuthology.orchestra.run.smithi106.stderr:0+1 records in 2024-05-10T04:23:11.934 INFO:teuthology.orchestra.run.smithi106.stderr:0+1 records out 2024-05-10T04:23:11.934 INFO:teuthology.orchestra.run.smithi106.stderr:69 bytes copied, 6.9394e-05 s, 994 kB/s 2024-05-10T04:23:11.937 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-10T04:23:11.956 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:23:12.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.227+0000 7faf8e400700 1 Processor -- start 2024-05-10T04:23:12.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.228+0000 7faf8e400700 1 -- start start 2024-05-10T04:23:12.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.229+0000 7faf8e400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faf880cf360 0x7faf880b9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:12.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.229+0000 7faf8e400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faf88161d10 0x7faf880d2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:12.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.229+0000 7faf8e400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf880d3220 0x7faf880b7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:12.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.229+0000 7faf8e400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf880d3630 con 0x7faf88161d10 2024-05-10T04:23:12.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.229+0000 7faf8e400700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf880d25b0 con 0x7faf880cf360 2024-05-10T04:23:12.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.229+0000 7faf8e400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf880d2850 con 0x7faf880d3220 2024-05-10T04:23:12.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.230+0000 7faf87e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faf88161d10 0x7faf880d2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:12.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.230+0000 7faf87e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faf88161d10 0x7faf880d2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42802/0 (socket says 172.21.15.80:42802) 2024-05-10T04:23:12.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.230+0000 7faf87e00700 1 -- 172.21.15.80:0/1931239085 learned_addr learned my addr 172.21.15.80:0/1931239085 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:12.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.230+0000 7faf8da00700 1 --2- 172.21.15.80:0/1931239085 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf880d3220 0x7faf880b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:12.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.230+0000 7faf8d000700 1 --2- 172.21.15.80:0/1931239085 >> v2:172.21.15.106:3300/0 conn(0x7faf880cf360 0x7faf880b9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:12.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.230+0000 7faf87e00700 1 -- 172.21.15.80:0/1931239085 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf880d3220 msgr2=0x7faf880b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:12.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.230+0000 7faf87e00700 1 --2- 172.21.15.80:0/1931239085 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf880d3220 0x7faf880b7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.230+0000 7faf87e00700 1 -- 172.21.15.80:0/1931239085 >> v2:172.21.15.106:3300/0 conn(0x7faf880cf360 msgr2=0x7faf880b9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:12.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.230+0000 7faf87e00700 1 --2- 172.21.15.80:0/1931239085 >> v2:172.21.15.106:3300/0 conn(0x7faf880cf360 0x7faf880b9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.230+0000 7faf87e00700 1 -- 172.21.15.80:0/1931239085 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf880cf770 con 0x7faf88161d10 2024-05-10T04:23:12.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.230+0000 7faf87e00700 1 --2- 172.21.15.80:0/1931239085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf88161d10 0x7faf880d2ce0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faf8808c6a0 tx=0x7faf74009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1ef80457e06d90 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:12.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.231+0000 7faf87400700 1 -- 172.21.15.80:0/1931239085 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74011830 con 0x7faf88161d10 2024-05-10T04:23:12.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.231+0000 7faf87400700 1 -- 172.21.15.80:0/1931239085 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf74011990 con 0x7faf88161d10 2024-05-10T04:23:12.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.231+0000 7faf87400700 1 -- 172.21.15.80:0/1931239085 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74011d20 con 0x7faf88161d10 2024-05-10T04:23:12.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.231+0000 7faf8e400700 1 -- 172.21.15.80:0/1931239085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf88161d10 msgr2=0x7faf880d2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:12.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.231+0000 7faf8e400700 1 --2- 172.21.15.80:0/1931239085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf88161d10 0x7faf880d2ce0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faf8808c6a0 tx=0x7faf74009bd0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.231+0000 7faf8e400700 1 -- 172.21.15.80:0/1931239085 shutdown_connections 2024-05-10T04:23:12.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.231+0000 7faf8e400700 1 --2- 172.21.15.80:0/1931239085 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf880d3220 0x7faf880b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.231+0000 7faf8e400700 1 --2- 172.21.15.80:0/1931239085 >> v2:172.21.15.106:3300/0 conn(0x7faf880cf360 0x7faf880b9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.231+0000 7faf8e400700 1 --2- 172.21.15.80:0/1931239085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf88161d10 0x7faf880d2ce0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.231+0000 7faf8e400700 1 -- 172.21.15.80:0/1931239085 >> 172.21.15.80:0/1931239085 conn(0x7faf8806c4e0 msgr2=0x7faf8806c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:12.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.231+0000 7faf8e400700 1 -- 172.21.15.80:0/1931239085 shutdown_connections 2024-05-10T04:23:12.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.231+0000 7faf8e400700 1 -- 172.21.15.80:0/1931239085 wait complete. 2024-05-10T04:23:12.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.234+0000 7faf8e400700 1 Processor -- start 2024-05-10T04:23:12.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.234+0000 7faf8e400700 1 -- start start 2024-05-10T04:23:12.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.235+0000 7faf8e400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf880cf360 0x7faf88155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:12.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.235+0000 7faf8e400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf880d3220 0x7faf88156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:12.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.235+0000 7faf8e400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf88161d10 0x7faf88157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:12.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.235+0000 7faf8e400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf88156fe0 con 0x7faf880d3220 2024-05-10T04:23:12.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.235+0000 7faf8e400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8815b520 con 0x7faf880cf360 2024-05-10T04:23:12.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.235+0000 7faf8e400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf88159680 con 0x7faf88161d10 2024-05-10T04:23:12.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.236+0000 7faf87e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf880d3220 0x7faf88156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:12.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.236+0000 7faf87e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf880d3220 0x7faf88156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42818/0 (socket says 172.21.15.80:42818) 2024-05-10T04:23:12.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.236+0000 7faf87e00700 1 -- 172.21.15.80:0/3223400744 learned_addr learned my addr 172.21.15.80:0/3223400744 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:12.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.236+0000 7faf8d000700 1 --2- 172.21.15.80:0/3223400744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf880cf360 0x7faf88155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:12.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.236+0000 7faf8da00700 1 --2- 172.21.15.80:0/3223400744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf88161d10 0x7faf88157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.236+0000 7faf87e00700 1 -- 172.21.15.80:0/3223400744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf88161d10 msgr2=0x7faf88157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.236+0000 7faf87e00700 1 --2- 172.21.15.80:0/3223400744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf88161d10 0x7faf88157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.236+0000 7faf87e00700 1 -- 172.21.15.80:0/3223400744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf880cf360 msgr2=0x7faf88155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.236+0000 7faf87e00700 1 --2- 172.21.15.80:0/3223400744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf880cf360 0x7faf88155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.236+0000 7faf87e00700 1 -- 172.21.15.80:0/3223400744 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf74009550 con 0x7faf880d3220 2024-05-10T04:23:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.236+0000 7faf8d000700 1 --2- 172.21.15.80:0/3223400744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf880cf360 0x7faf88155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.236+0000 7faf8da00700 1 --2- 172.21.15.80:0/3223400744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf88161d10 0x7faf88157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.236+0000 7faf87e00700 1 --2- 172.21.15.80:0/3223400744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf880d3220 0x7faf88156aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faf74014040 tx=0x7faf74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.236+0000 7faf84c00700 1 -- 172.21.15.80:0/3223400744 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74004510 con 0x7faf880d3220 2024-05-10T04:23:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.236+0000 7faf84c00700 1 -- 172.21.15.80:0/3223400744 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7401e070 con 0x7faf880d3220 2024-05-10T04:23:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.237+0000 7faf8e400700 1 -- 172.21.15.80:0/3223400744 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf881598d0 con 0x7faf880d3220 2024-05-10T04:23:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.237+0000 7faf84c00700 1 -- 172.21.15.80:0/3223400744 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf740038e0 con 0x7faf880d3220 2024-05-10T04:23:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.237+0000 7faf8e400700 1 -- 172.21.15.80:0/3223400744 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf880cb110 con 0x7faf880d3220 2024-05-10T04:23:12.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.238+0000 7faf8e400700 1 -- 172.21.15.80:0/3223400744 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf88074af0 con 0x7faf880d3220 2024-05-10T04:23:12.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.239+0000 7faf84c00700 1 -- 172.21.15.80:0/3223400744 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faf74003a40 con 0x7faf880d3220 2024-05-10T04:23:12.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.240+0000 7faf84c00700 1 --2- 172.21.15.80:0/3223400744 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7faf6806acc0 0x7faf6806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:12.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.241+0000 7faf84c00700 1 -- 172.21.15.80:0/3223400744 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf7408a230 con 0x7faf880d3220 2024-05-10T04:23:12.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.241+0000 7faf8d000700 1 --2- 172.21.15.80:0/3223400744 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7faf6806acc0 0x7faf6806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:12.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.241+0000 7faf8d000700 1 --2- 172.21.15.80:0/3223400744 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7faf6806acc0 0x7faf6806d1d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faf880b3620 tx=0x7faf7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:12.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.246+0000 7faf84c00700 1 -- 172.21.15.80:0/3223400744 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7faf74055370 con 0x7faf880d3220 2024-05-10T04:23:12.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.453+0000 7faf8e400700 1 -- 172.21.15.80:0/3223400744 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf88157160 con 0x7faf880d3220 2024-05-10T04:23:12.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.454+0000 7faf84c00700 1 -- 172.21.15.80:0/3223400744 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7faf74058990 con 0x7faf880d3220 2024-05-10T04:23:12.456 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:12.456 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:38.485422+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:23:12.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.457+0000 7faf8e400700 1 -- 172.21.15.80:0/3223400744 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7faf6806acc0 msgr2=0x7faf6806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:12.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.457+0000 7faf8e400700 1 --2- 172.21.15.80:0/3223400744 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7faf6806acc0 0x7faf6806d1d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faf880b3620 tx=0x7faf7c008040 comp rx=0 tx=0).stop 2024-05-10T04:23:12.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.457+0000 7faf8e400700 1 -- 172.21.15.80:0/3223400744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf880d3220 msgr2=0x7faf88156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:12.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.457+0000 7faf8e400700 1 --2- 172.21.15.80:0/3223400744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf880d3220 0x7faf88156aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faf74014040 tx=0x7faf74004750 comp rx=0 tx=0).stop 2024-05-10T04:23:12.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.457+0000 7faf8e400700 1 -- 172.21.15.80:0/3223400744 shutdown_connections 2024-05-10T04:23:12.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.457+0000 7faf8e400700 1 --2- 172.21.15.80:0/3223400744 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7faf6806acc0 0x7faf6806d1d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.457+0000 7faf8e400700 1 --2- 172.21.15.80:0/3223400744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf88161d10 0x7faf88157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.457+0000 7faf8e400700 1 --2- 172.21.15.80:0/3223400744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf880cf360 0x7faf88155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.457+0000 7faf8e400700 1 --2- 172.21.15.80:0/3223400744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf880d3220 0x7faf88156aa0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.457+0000 7faf8e400700 1 -- 172.21.15.80:0/3223400744 >> 172.21.15.80:0/3223400744 conn(0x7faf8806c4e0 msgr2=0x7faf880b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:12.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.457+0000 7faf8e400700 1 -- 172.21.15.80:0/3223400744 shutdown_connections 2024-05-10T04:23:12.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.457+0000 7faf8e400700 1 -- 172.21.15.80:0/3223400744 wait complete. 2024-05-10T04:23:12.483 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:22:26.793377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:22:35.751764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:22:36.465587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:23:12.483 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:23:12.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.745+0000 7fadd6800700 1 Processor -- start 2024-05-10T04:23:12.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.746+0000 7fadd6800700 1 -- start start 2024-05-10T04:23:12.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.747+0000 7fadd6800700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fadd015e610 0x7fadd00b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:12.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.747+0000 7fadd6800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fadd00b7910 0x7fadd006c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:12.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.747+0000 7fadd6800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd00d2c00 con 0x7fadd0162150 2024-05-10T04:23:12.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.747+0000 7fadd6800700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd015ea20 con 0x7fadd00b7910 2024-05-10T04:23:12.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.747+0000 7fadd6800700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd0162630 con 0x7fadd015e610 2024-05-10T04:23:12.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.748+0000 7fadcf400700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fadd0162150 0x7fadd00cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35674/0 (socket says 172.21.15.80:35674) 2024-05-10T04:23:12.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.748+0000 7fadcf400700 1 -- 172.21.15.80:0/1473949095 learned_addr learned my addr 172.21.15.80:0/1473949095 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:12.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.748+0000 7fadcfe00700 1 --2- 172.21.15.80:0/1473949095 >> v2:172.21.15.80:3300/0 conn(0x7fadd00b7910 0x7fadd006c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.748+0000 7fadc7e00700 1 --2- 172.21.15.80:0/1473949095 >> v2:172.21.15.106:3300/0 conn(0x7fadd015e610 0x7fadd00b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.748+0000 7fadcfe00700 1 -- 172.21.15.80:0/1473949095 >> v2:172.21.15.106:3300/0 conn(0x7fadd015e610 msgr2=0x7fadd00b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.748+0000 7fadcfe00700 1 --2- 172.21.15.80:0/1473949095 >> v2:172.21.15.106:3300/0 conn(0x7fadd015e610 0x7fadd00b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.748+0000 7fadcea00700 1 -- 172.21.15.80:0/1473949095 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2238606048 0 0) 0x7fadd00d2c00 con 0x7fadd0162150 2024-05-10T04:23:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.748+0000 7fadcfe00700 1 -- 172.21.15.80:0/1473949095 >> v1:172.21.15.80:6789/0 conn(0x7fadd0162150 legacy=0x7fadd00cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.748+0000 7fadcfe00700 1 -- 172.21.15.80:0/1473949095 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd0162910 con 0x7fadd00b7910 2024-05-10T04:23:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.748+0000 7fadcfe00700 1 --2- 172.21.15.80:0/1473949095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd00b7910 0x7fadd006c160 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fadd00c7520 tx=0x7fadc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c187c198e9525695 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.749+0000 7fadcea00700 1 -- 172.21.15.80:0/1473949095 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800e070 con 0x7fadd00b7910 2024-05-10T04:23:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.749+0000 7fadcea00700 1 -- 172.21.15.80:0/1473949095 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc800bbd0 con 0x7fadd00b7910 2024-05-10T04:23:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.749+0000 7fadcea00700 1 -- 172.21.15.80:0/1473949095 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8012430 con 0x7fadd00b7910 2024-05-10T04:23:12.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.749+0000 7fadd6800700 1 -- 172.21.15.80:0/1473949095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd00b7910 msgr2=0x7fadd006c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:12.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.749+0000 7fadd6800700 1 --2- 172.21.15.80:0/1473949095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd00b7910 0x7fadd006c160 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fadd00c7520 tx=0x7fadc800b330 comp rx=0 tx=0).stop 2024-05-10T04:23:12.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.749+0000 7fadd6800700 1 -- 172.21.15.80:0/1473949095 shutdown_connections 2024-05-10T04:23:12.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.749+0000 7fadd6800700 1 --2- 172.21.15.80:0/1473949095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd00b7910 0x7fadd006c160 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.749+0000 7fadd6800700 1 --2- 172.21.15.80:0/1473949095 >> v2:172.21.15.106:3300/0 conn(0x7fadd015e610 0x7fadd00b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.749+0000 7fadd6800700 1 -- 172.21.15.80:0/1473949095 >> 172.21.15.80:0/1473949095 conn(0x7fadd00d3e10 msgr2=0x7fadd00d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:12.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.749+0000 7fadd6800700 1 -- 172.21.15.80:0/1473949095 shutdown_connections 2024-05-10T04:23:12.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.750+0000 7fadd6800700 1 -- 172.21.15.80:0/1473949095 wait complete. 2024-05-10T04:23:12.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.752+0000 7fadd6800700 1 Processor -- start 2024-05-10T04:23:12.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.752+0000 7fadd6800700 1 -- start start 2024-05-10T04:23:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.753+0000 7fadd6800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd00b7910 0x7fadd01f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.753+0000 7fadd6800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fadd015e610 0x7fadd00cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.753+0000 7fadd6800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadd0162150 0x7fadd00c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.753+0000 7fadd6800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd00ce650 con 0x7fadd00b7910 2024-05-10T04:23:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.753+0000 7fadd6800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd00ca8d0 con 0x7fadd0162150 2024-05-10T04:23:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.753+0000 7fadd6800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd00ce400 con 0x7fadd015e610 2024-05-10T04:23:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.754+0000 7fadcf400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd00b7910 0x7fadd01f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.754+0000 7fadcf400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd00b7910 0x7fadd01f47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42842/0 (socket says 172.21.15.80:42842) 2024-05-10T04:23:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.754+0000 7fadcf400700 1 -- 172.21.15.80:0/7910155 learned_addr learned my addr 172.21.15.80:0/7910155 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.754+0000 7fadcfe00700 1 --2- 172.21.15.80:0/7910155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadd0162150 0x7fadd00c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.754+0000 7fadc7e00700 1 --2- 172.21.15.80:0/7910155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fadd015e610 0x7fadd00cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.754+0000 7fadcf400700 1 -- 172.21.15.80:0/7910155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fadd015e610 msgr2=0x7fadd00cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.754+0000 7fadcf400700 1 --2- 172.21.15.80:0/7910155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fadd015e610 0x7fadd00cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.754+0000 7fadcf400700 1 -- 172.21.15.80:0/7910155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadd0162150 msgr2=0x7fadd00c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.754+0000 7fadcf400700 1 --2- 172.21.15.80:0/7910155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadd0162150 0x7fadd00c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.754+0000 7fadcf400700 1 -- 172.21.15.80:0/7910155 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc8009a70 con 0x7fadd00b7910 2024-05-10T04:23:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.754+0000 7fadcf400700 1 --2- 172.21.15.80:0/7910155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd00b7910 0x7fadd01f47d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c580 tx=0x7fadc000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.755+0000 7fadc7400700 1 -- 172.21.15.80:0/7910155 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0004c80 con 0x7fadd00b7910 2024-05-10T04:23:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.755+0000 7fadc7400700 1 -- 172.21.15.80:0/7910155 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc0004e00 con 0x7fadd00b7910 2024-05-10T04:23:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.755+0000 7fadc7400700 1 -- 172.21.15.80:0/7910155 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0007310 con 0x7fadd00b7910 2024-05-10T04:23:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.755+0000 7fadd6800700 1 -- 172.21.15.80:0/7910155 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd00c71d0 con 0x7fadd00b7910 2024-05-10T04:23:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.755+0000 7fadd6800700 1 -- 172.21.15.80:0/7910155 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd00c79d0 con 0x7fadd00b7910 2024-05-10T04:23:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.756+0000 7fadd6800700 1 -- 172.21.15.80:0/7910155 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd0074af0 con 0x7fadd00b7910 2024-05-10T04:23:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.757+0000 7fadc7400700 1 -- 172.21.15.80:0/7910155 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fadc0007470 con 0x7fadd00b7910 2024-05-10T04:23:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.758+0000 7fadc7400700 1 --2- 172.21.15.80:0/7910155 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fadac06ac90 0x7fadac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:12.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.758+0000 7fadc7400700 1 -- 172.21.15.80:0/7910155 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadc0089160 con 0x7fadd00b7910 2024-05-10T04:23:12.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.758+0000 7fadc7e00700 1 --2- 172.21.15.80:0/7910155 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fadac06ac90 0x7fadac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:12.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.759+0000 7fadc7e00700 1 --2- 172.21.15.80:0/7910155 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fadac06ac90 0x7fadac06d1a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fadd0158d10 tx=0x7fadb8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:12.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.762+0000 7fadc7400700 1 -- 172.21.15.80:0/7910155 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fadc0054210 con 0x7fadd00b7910 2024-05-10T04:23:12.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.965+0000 7fadd6800700 1 -- 172.21.15.80:0/7910155 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fadd00c98b0 con 0x7fadd00b7910 2024-05-10T04:23:12.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.965+0000 7fadc7400700 1 -- 172.21.15.80:0/7910155 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fadc0057830 con 0x7fadd00b7910 2024-05-10T04:23:12.966 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-10T04:23:12.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.967+0000 7fadd6800700 1 -- 172.21.15.80:0/7910155 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fadac06ac90 msgr2=0x7fadac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:12.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.967+0000 7fadd6800700 1 --2- 172.21.15.80:0/7910155 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fadac06ac90 0x7fadac06d1a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fadd0158d10 tx=0x7fadb8008040 comp rx=0 tx=0).stop 2024-05-10T04:23:12.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.967+0000 7fadd6800700 1 -- 172.21.15.80:0/7910155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd00b7910 msgr2=0x7fadd01f47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:12.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.967+0000 7fadd6800700 1 --2- 172.21.15.80:0/7910155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd00b7910 0x7fadd01f47d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c580 tx=0x7fadc000c940 comp rx=0 tx=0).stop 2024-05-10T04:23:12.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.967+0000 7fadd6800700 1 -- 172.21.15.80:0/7910155 shutdown_connections 2024-05-10T04:23:12.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.967+0000 7fadd6800700 1 --2- 172.21.15.80:0/7910155 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fadac06ac90 0x7fadac06d1a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.967+0000 7fadd6800700 1 --2- 172.21.15.80:0/7910155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd00b7910 0x7fadd01f47d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.967+0000 7fadd6800700 1 --2- 172.21.15.80:0/7910155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadd0162150 0x7fadd00c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.967+0000 7fadd6800700 1 --2- 172.21.15.80:0/7910155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fadd015e610 0x7fadd00cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:12.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.967+0000 7fadd6800700 1 -- 172.21.15.80:0/7910155 >> 172.21.15.80:0/7910155 conn(0x7fadd00d3e10 msgr2=0x7fadd00d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:12.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.968+0000 7fadd6800700 1 -- 172.21.15.80:0/7910155 shutdown_connections 2024-05-10T04:23:12.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:12.968+0000 7fadd6800700 1 -- 172.21.15.80:0/7910155 wait complete. 2024-05-10T04:23:12.995 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:23:13.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.257+0000 7ff8c7200700 1 Processor -- start 2024-05-10T04:23:13.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.257+0000 7ff8c7200700 1 -- start start 2024-05-10T04:23:13.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.259+0000 7ff8c7200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8c80b98e0 0x7ff8c80d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:13.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.259+0000 7ff8c7200700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c80d2e50 con 0x7ff8c80b6230 2024-05-10T04:23:13.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.259+0000 7ff8c7200700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c80d3130 con 0x7ff8c80d0c90 2024-05-10T04:23:13.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.259+0000 7ff8c7200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c80d3410 con 0x7ff8c80b98e0 2024-05-10T04:23:13.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.259+0000 7ff8bfe00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff8c80b6230 0x7ff8c80d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33986/0 (socket says 172.21.15.80:33986) 2024-05-10T04:23:13.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.259+0000 7ff8bfe00700 1 -- 172.21.15.80:0/718306883 learned_addr learned my addr 172.21.15.80:0/718306883 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:13.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.260+0000 7ff8c5e00700 1 --2- 172.21.15.80:0/718306883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8c80b98e0 0x7ff8c80d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:13.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.260+0000 7ff8c5400700 1 -- 172.21.15.80:0/718306883 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002003269 0 0) 0x7ff8c80d2e50 con 0x7ff8c80b6230 2024-05-10T04:23:13.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.260+0000 7ff8c5400700 1 -- 172.21.15.80:0/718306883 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8ac0035b0 con 0x7ff8c80b6230 2024-05-10T04:23:13.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.260+0000 7ff8c5400700 1 -- 172.21.15.80:0/718306883 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205198141 0 0) 0x7ff8c80d3130 con 0x7ff8c80d0c90 2024-05-10T04:23:13.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.260+0000 7ff8c5400700 1 -- 172.21.15.80:0/718306883 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8c80d2e50 con 0x7ff8c80d0c90 2024-05-10T04:23:13.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.260+0000 7ff8c5e00700 1 -- 172.21.15.80:0/718306883 >> v1:172.21.15.106:6789/0 conn(0x7ff8c80d0c90 legacy=0x7ff8c815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:13.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.260+0000 7ff8c5400700 1 -- 172.21.15.80:0/718306883 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3991825343 0 0) 0x7ff8ac0035b0 con 0x7ff8c80b6230 2024-05-10T04:23:13.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.260+0000 7ff8c5e00700 1 -- 172.21.15.80:0/718306883 >> v1:172.21.15.80:6789/0 conn(0x7ff8c80b6230 legacy=0x7ff8c80d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:13.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.260+0000 7ff8c5e00700 1 -- 172.21.15.80:0/718306883 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c80b7470 con 0x7ff8c80b98e0 2024-05-10T04:23:13.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.261+0000 7ff8c5e00700 1 --2- 172.21.15.80:0/718306883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8c80b98e0 0x7ff8c80d2520 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009870 tx=0x7ff8b8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d8a1bb1b6187768 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:13.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.261+0000 7ff8c5400700 1 -- 172.21.15.80:0/718306883 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0001690 con 0x7ff8c80b98e0 2024-05-10T04:23:13.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.261+0000 7ff8c5400700 1 -- 172.21.15.80:0/718306883 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b8004030 con 0x7ff8c80b98e0 2024-05-10T04:23:13.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.261+0000 7ff8c5400700 1 -- 172.21.15.80:0/718306883 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b80043c0 con 0x7ff8c80b98e0 2024-05-10T04:23:13.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.262+0000 7ff8c7200700 1 -- 172.21.15.80:0/718306883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8c80b98e0 msgr2=0x7ff8c80d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:13.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.262+0000 7ff8c7200700 1 --2- 172.21.15.80:0/718306883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8c80b98e0 0x7ff8c80d2520 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009870 tx=0x7ff8b8009b80 comp rx=0 tx=0).stop 2024-05-10T04:23:13.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.262+0000 7ff8c7200700 1 -- 172.21.15.80:0/718306883 shutdown_connections 2024-05-10T04:23:13.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.262+0000 7ff8c7200700 1 --2- 172.21.15.80:0/718306883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8c80b98e0 0x7ff8c80d2520 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:13.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.262+0000 7ff8c7200700 1 -- 172.21.15.80:0/718306883 >> 172.21.15.80:0/718306883 conn(0x7ff8c80676c0 msgr2=0x7ff8c806c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:13.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.262+0000 7ff8c7200700 1 -- 172.21.15.80:0/718306883 shutdown_connections 2024-05-10T04:23:13.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.262+0000 7ff8c7200700 1 -- 172.21.15.80:0/718306883 wait complete. 2024-05-10T04:23:13.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.264+0000 7ff8c7200700 1 Processor -- start 2024-05-10T04:23:13.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.264+0000 7ff8c7200700 1 -- start start 2024-05-10T04:23:13.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.266+0000 7ff8c7200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8c80b6230 0x7ff8c80cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.266+0000 7ff8c7200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8c80b98e0 0x7ff8c815f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.266+0000 7ff8c7200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8c80d0c90 0x7ff8c815b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.266+0000 7ff8c7200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c80cd1f0 con 0x7ff8c80b98e0 2024-05-10T04:23:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.266+0000 7ff8c7200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c81f5060 con 0x7ff8c80d0c90 2024-05-10T04:23:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.266+0000 7ff8c7200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c80ce4a0 con 0x7ff8c80b6230 2024-05-10T04:23:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.266+0000 7ff8bfe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8c80b98e0 0x7ff8c815f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.266+0000 7ff8bfe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8c80b98e0 0x7ff8c815f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53682/0 (socket says 172.21.15.80:53682) 2024-05-10T04:23:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.266+0000 7ff8bfe00700 1 -- 172.21.15.80:0/543129533 learned_addr learned my addr 172.21.15.80:0/543129533 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.266+0000 7ff8c5e00700 1 --2- 172.21.15.80:0/543129533 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8c80b6230 0x7ff8c80cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.266+0000 7ff8c6800700 1 --2- 172.21.15.80:0/543129533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8c80d0c90 0x7ff8c815b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.267+0000 7ff8bfe00700 1 -- 172.21.15.80:0/543129533 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8c80b6230 msgr2=0x7ff8c80cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.267+0000 7ff8bfe00700 1 --2- 172.21.15.80:0/543129533 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8c80b6230 0x7ff8c80cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:13.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.267+0000 7ff8bfe00700 1 -- 172.21.15.80:0/543129533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8c80d0c90 msgr2=0x7ff8c815b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:13.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.267+0000 7ff8bfe00700 1 --2- 172.21.15.80:0/543129533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8c80d0c90 0x7ff8c815b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:13.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.267+0000 7ff8bfe00700 1 -- 172.21.15.80:0/543129533 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b80094a0 con 0x7ff8c80b98e0 2024-05-10T04:23:13.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.267+0000 7ff8c6800700 1 --2- 172.21.15.80:0/543129533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8c80d0c90 0x7ff8c815b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:13.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.267+0000 7ff8bfe00700 1 --2- 172.21.15.80:0/543129533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8c80b98e0 0x7ff8c815f5f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000c6d0 tx=0x7ff8b000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:13.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.267+0000 7ff8be000700 1 -- 172.21.15.80:0/543129533 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0004d40 con 0x7ff8c80b98e0 2024-05-10T04:23:13.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.267+0000 7ff8be000700 1 -- 172.21.15.80:0/543129533 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b00070d0 con 0x7ff8c80b98e0 2024-05-10T04:23:13.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.267+0000 7ff8c7200700 1 -- 172.21.15.80:0/543129533 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c80cd400 con 0x7ff8c80b98e0 2024-05-10T04:23:13.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.267+0000 7ff8be000700 1 -- 172.21.15.80:0/543129533 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0004ea0 con 0x7ff8c80b98e0 2024-05-10T04:23:13.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.267+0000 7ff8c7200700 1 -- 172.21.15.80:0/543129533 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c80cdca0 con 0x7ff8c80b98e0 2024-05-10T04:23:13.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.268+0000 7ff8c7200700 1 -- 172.21.15.80:0/543129533 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c8074af0 con 0x7ff8c80b98e0 2024-05-10T04:23:13.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.269+0000 7ff8be000700 1 -- 172.21.15.80:0/543129533 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff8b0007460 con 0x7ff8c80b98e0 2024-05-10T04:23:13.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.270+0000 7ff8be000700 1 --2- 172.21.15.80:0/543129533 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff8a406acc0 0x7ff8a406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:13.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.270+0000 7ff8be000700 1 -- 172.21.15.80:0/543129533 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8b00890b0 con 0x7ff8c80b98e0 2024-05-10T04:23:13.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.271+0000 7ff8c5e00700 1 --2- 172.21.15.80:0/543129533 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff8a406acc0 0x7ff8a406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:13.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.272+0000 7ff8c5e00700 1 --2- 172.21.15.80:0/543129533 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff8a406acc0 0x7ff8a406d1d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80097c0 tx=0x7ff8b8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:13.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.275+0000 7ff8be000700 1 -- 172.21.15.80:0/543129533 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff8b0054280 con 0x7ff8c80b98e0 2024-05-10T04:23:13.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.482+0000 7ff8c7200700 1 -- 172.21.15.80:0/543129533 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff8c80cbb60 con 0x7ff8c80b98e0 2024-05-10T04:23:13.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.482+0000 7ff8be000700 1 -- 172.21.15.80:0/543129533 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff8b00578a0 con 0x7ff8c80b98e0 2024-05-10T04:23:13.483 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-10T04:23:13.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.485+0000 7ff8c7200700 1 -- 172.21.15.80:0/543129533 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff8a406acc0 msgr2=0x7ff8a406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:13.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.485+0000 7ff8c7200700 1 --2- 172.21.15.80:0/543129533 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff8a406acc0 0x7ff8a406d1d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80097c0 tx=0x7ff8b8008030 comp rx=0 tx=0).stop 2024-05-10T04:23:13.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.485+0000 7ff8c7200700 1 -- 172.21.15.80:0/543129533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8c80b98e0 msgr2=0x7ff8c815f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.485+0000 7ff8c7200700 1 --2- 172.21.15.80:0/543129533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8c80b98e0 0x7ff8c815f5f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000c6d0 tx=0x7ff8b000c9e0 comp rx=0 tx=0).stop 2024-05-10T04:23:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.485+0000 7ff8c7200700 1 -- 172.21.15.80:0/543129533 shutdown_connections 2024-05-10T04:23:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.485+0000 7ff8c7200700 1 --2- 172.21.15.80:0/543129533 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff8a406acc0 0x7ff8a406d1d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.485+0000 7ff8c7200700 1 --2- 172.21.15.80:0/543129533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8c80d0c90 0x7ff8c815b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.485+0000 7ff8c7200700 1 --2- 172.21.15.80:0/543129533 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8c80b6230 0x7ff8c80cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.485+0000 7ff8c7200700 1 --2- 172.21.15.80:0/543129533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8c80b98e0 0x7ff8c815f5f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.485+0000 7ff8c7200700 1 -- 172.21.15.80:0/543129533 >> 172.21.15.80:0/543129533 conn(0x7ff8c80676c0 msgr2=0x7ff8c80d3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.485+0000 7ff8c7200700 1 -- 172.21.15.80:0/543129533 shutdown_connections 2024-05-10T04:23:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.485+0000 7ff8c7200700 1 -- 172.21.15.80:0/543129533 wait complete. 2024-05-10T04:23:13.514 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:23:13.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.778+0000 7fcd5e400700 1 Processor -- start 2024-05-10T04:23:13.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.778+0000 7fcd5e400700 1 -- start start 2024-05-10T04:23:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.780+0000 7fcd5e400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcd58162150 0x7fcd5815e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.780+0000 7fcd5e400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd580cf4d0 0x7fcd580b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.780+0000 7fcd5e400700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd580d2c00 con 0x7fcd580b7910 2024-05-10T04:23:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.780+0000 7fcd5e400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd58162630 con 0x7fcd58162150 2024-05-10T04:23:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.780+0000 7fcd5e400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd58162910 con 0x7fcd580cf4d0 2024-05-10T04:23:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.780+0000 7fcd57400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcd58162150 0x7fcd5815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.780+0000 7fcd57400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcd58162150 0x7fcd5815e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53684/0 (socket says 172.21.15.80:53684) 2024-05-10T04:23:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.780+0000 7fcd57400700 1 -- 172.21.15.80:0/3290019241 learned_addr learned my addr 172.21.15.80:0/3290019241 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.781+0000 7fcd4fe00700 1 --2- 172.21.15.80:0/3290019241 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd580cf4d0 0x7fcd580b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.781+0000 7fcd57400700 1 -- 172.21.15.80:0/3290019241 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd580cf4d0 msgr2=0x7fcd580b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.781+0000 7fcd57400700 1 --2- 172.21.15.80:0/3290019241 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd580cf4d0 0x7fcd580b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.781+0000 7fcd57400700 1 -- 172.21.15.80:0/3290019241 >> v1:172.21.15.106:6789/0 conn(0x7fcd580b7910 legacy=0x7fcd5806c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.781+0000 7fcd57400700 1 -- 172.21.15.80:0/3290019241 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd58162bf0 con 0x7fcd58162150 2024-05-10T04:23:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.781+0000 7fcd56a00700 1 -- 172.21.15.80:0/3290019241 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16807983 0 0) 0x7fcd580d2c00 con 0x7fcd580b7910 2024-05-10T04:23:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.781+0000 7fcd57400700 1 --2- 172.21.15.80:0/3290019241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd58162150 0x7fcd5815e610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcd480098f0 tx=0x7fcd48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a178f297947831 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.782+0000 7fcd56a00700 1 -- 172.21.15.80:0/3290019241 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48011830 con 0x7fcd58162150 2024-05-10T04:23:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.782+0000 7fcd56a00700 1 -- 172.21.15.80:0/3290019241 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd48011990 con 0x7fcd58162150 2024-05-10T04:23:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.782+0000 7fcd56a00700 1 -- 172.21.15.80:0/3290019241 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48011d20 con 0x7fcd58162150 2024-05-10T04:23:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.782+0000 7fcd5e400700 1 -- 172.21.15.80:0/3290019241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd58162150 msgr2=0x7fcd5815e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.782+0000 7fcd5e400700 1 --2- 172.21.15.80:0/3290019241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd58162150 0x7fcd5815e610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcd480098f0 tx=0x7fcd48009c00 comp rx=0 tx=0).stop 2024-05-10T04:23:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.782+0000 7fcd5e400700 1 -- 172.21.15.80:0/3290019241 shutdown_connections 2024-05-10T04:23:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.782+0000 7fcd5e400700 1 --2- 172.21.15.80:0/3290019241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd58162150 0x7fcd5815e610 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.782+0000 7fcd5e400700 1 --2- 172.21.15.80:0/3290019241 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd580cf4d0 0x7fcd580b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.782+0000 7fcd5e400700 1 -- 172.21.15.80:0/3290019241 >> 172.21.15.80:0/3290019241 conn(0x7fcd580d3e10 msgr2=0x7fcd580d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.782+0000 7fcd5e400700 1 -- 172.21.15.80:0/3290019241 shutdown_connections 2024-05-10T04:23:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.782+0000 7fcd5e400700 1 -- 172.21.15.80:0/3290019241 wait complete. 2024-05-10T04:23:13.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.785+0000 7fcd5e400700 1 Processor -- start 2024-05-10T04:23:13.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.785+0000 7fcd5e400700 1 -- start start 2024-05-10T04:23:13.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.786+0000 7fcd5e400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd580b7910 0x7fcd580c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:13.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.786+0000 7fcd5e400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd580cf4d0 0x7fcd581f4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:13.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.786+0000 7fcd5e400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd58162150 0x7fcd58155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:13.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.786+0000 7fcd5e400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd581f4b90 con 0x7fcd580cf4d0 2024-05-10T04:23:13.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.786+0000 7fcd5e400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd58155ec0 con 0x7fcd58162150 2024-05-10T04:23:13.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.786+0000 7fcd5e400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd58152750 con 0x7fcd580b7910 2024-05-10T04:23:13.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.786+0000 7fcd4fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd580cf4d0 0x7fcd581f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:13.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.786+0000 7fcd4fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd580cf4d0 0x7fcd581f4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53692/0 (socket says 172.21.15.80:53692) 2024-05-10T04:23:13.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.786+0000 7fcd4fe00700 1 -- 172.21.15.80:0/2817509572 learned_addr learned my addr 172.21.15.80:0/2817509572 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:13.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.787+0000 7fcd57e00700 1 --2- 172.21.15.80:0/2817509572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd58162150 0x7fcd58155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:13.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.787+0000 7fcd57400700 1 --2- 172.21.15.80:0/2817509572 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd580b7910 0x7fcd580c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:13.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.787+0000 7fcd4fe00700 1 -- 172.21.15.80:0/2817509572 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd580b7910 msgr2=0x7fcd580c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:13.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.787+0000 7fcd4fe00700 1 --2- 172.21.15.80:0/2817509572 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd580b7910 0x7fcd580c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:13.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.787+0000 7fcd4fe00700 1 -- 172.21.15.80:0/2817509572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd58162150 msgr2=0x7fcd58155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:13.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.787+0000 7fcd4fe00700 1 --2- 172.21.15.80:0/2817509572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd58162150 0x7fcd58155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:13.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.787+0000 7fcd4fe00700 1 -- 172.21.15.80:0/2817509572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd48009550 con 0x7fcd580cf4d0 2024-05-10T04:23:13.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.787+0000 7fcd57400700 1 --2- 172.21.15.80:0/2817509572 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd580b7910 0x7fcd580c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:13.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.787+0000 7fcd57e00700 1 --2- 172.21.15.80:0/2817509572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd58162150 0x7fcd58155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:13.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.787+0000 7fcd4fe00700 1 --2- 172.21.15.80:0/2817509572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd580cf4d0 0x7fcd581f4650 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000e870 tx=0x7fcd4000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:13.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.787+0000 7fcd4f400700 1 -- 172.21.15.80:0/2817509572 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd40009590 con 0x7fcd580cf4d0 2024-05-10T04:23:13.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.787+0000 7fcd4f400700 1 -- 172.21.15.80:0/2817509572 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4000ee70 con 0x7fcd580cf4d0 2024-05-10T04:23:13.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.787+0000 7fcd5e400700 1 -- 172.21.15.80:0/2817509572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5815fee0 con 0x7fcd580cf4d0 2024-05-10T04:23:13.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.787+0000 7fcd4f400700 1 -- 172.21.15.80:0/2817509572 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4000ca50 con 0x7fcd580cf4d0 2024-05-10T04:23:13.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.788+0000 7fcd5e400700 1 -- 172.21.15.80:0/2817509572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd581604a0 con 0x7fcd580cf4d0 2024-05-10T04:23:13.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.788+0000 7fcd5e400700 1 -- 172.21.15.80:0/2817509572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd58160dd0 con 0x7fcd580cf4d0 2024-05-10T04:23:13.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.789+0000 7fcd4f400700 1 -- 172.21.15.80:0/2817509572 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcd4000cbb0 con 0x7fcd580cf4d0 2024-05-10T04:23:13.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.790+0000 7fcd4f400700 1 --2- 172.21.15.80:0/2817509572 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcd3406ac90 0x7fcd3406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:13.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.790+0000 7fcd4f400700 1 -- 172.21.15.80:0/2817509572 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd40089370 con 0x7fcd580cf4d0 2024-05-10T04:23:13.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.791+0000 7fcd57400700 1 --2- 172.21.15.80:0/2817509572 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcd3406ac90 0x7fcd3406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:13.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.791+0000 7fcd57400700 1 --2- 172.21.15.80:0/2817509572 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcd3406ac90 0x7fcd3406d1a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcd480098f0 tx=0x7fcd48008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:13.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.795+0000 7fcd4f400700 1 -- 172.21.15.80:0/2817509572 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcd400544b0 con 0x7fcd580cf4d0 2024-05-10T04:23:13.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.996+0000 7fcd5e400700 1 -- 172.21.15.80:0/2817509572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd58074af0 con 0x7fcd580cf4d0 2024-05-10T04:23:13.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.997+0000 7fcd4f400700 1 -- 172.21.15.80:0/2817509572 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd4000ce60 con 0x7fcd580cf4d0 2024-05-10T04:23:13.998 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-10T04:23:14.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.999+0000 7fcd5e400700 1 -- 172.21.15.80:0/2817509572 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcd3406ac90 msgr2=0x7fcd3406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:14.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.999+0000 7fcd5e400700 1 --2- 172.21.15.80:0/2817509572 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcd3406ac90 0x7fcd3406d1a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcd480098f0 tx=0x7fcd48008030 comp rx=0 tx=0).stop 2024-05-10T04:23:14.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.999+0000 7fcd5e400700 1 -- 172.21.15.80:0/2817509572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd580cf4d0 msgr2=0x7fcd581f4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:14.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.999+0000 7fcd5e400700 1 --2- 172.21.15.80:0/2817509572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd580cf4d0 0x7fcd581f4650 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000e870 tx=0x7fcd4000ec30 comp rx=0 tx=0).stop 2024-05-10T04:23:14.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.999+0000 7fcd5e400700 1 -- 172.21.15.80:0/2817509572 shutdown_connections 2024-05-10T04:23:14.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.999+0000 7fcd5e400700 1 --2- 172.21.15.80:0/2817509572 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcd3406ac90 0x7fcd3406d1a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:14.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.999+0000 7fcd5e400700 1 --2- 172.21.15.80:0/2817509572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd58162150 0x7fcd58155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:14.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.999+0000 7fcd5e400700 1 --2- 172.21.15.80:0/2817509572 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd580b7910 0x7fcd580c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:14.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.999+0000 7fcd5e400700 1 --2- 172.21.15.80:0/2817509572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd580cf4d0 0x7fcd581f4650 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:14.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.999+0000 7fcd5e400700 1 -- 172.21.15.80:0/2817509572 >> 172.21.15.80:0/2817509572 conn(0x7fcd580d3e10 msgr2=0x7fcd5815cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:14.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.999+0000 7fcd5e400700 1 -- 172.21.15.80:0/2817509572 shutdown_connections 2024-05-10T04:23:14.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:13.999+0000 7fcd5e400700 1 -- 172.21.15.80:0/2817509572 wait complete. 2024-05-10T04:23:14.025 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:23:14.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.286+0000 7f0773600700 1 Processor -- start 2024-05-10T04:23:14.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.286+0000 7f0773600700 1 -- start start 2024-05-10T04:23:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.288+0000 7f0773600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f076c0cb0e0 0x7f076c0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.288+0000 7f0773600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f076c06b340 0x7f076c161fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.288+0000 7f0773600700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076c0b20e0 con 0x7f076c0b6270 2024-05-10T04:23:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.288+0000 7f0773600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076c0b13c0 con 0x7f076c0cb0e0 2024-05-10T04:23:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.288+0000 7f0773600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076c0ceab0 con 0x7f076c06b340 2024-05-10T04:23:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.288+0000 7f076be00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f076c0b6270 0x7f076c06ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33990/0 (socket says 172.21.15.80:33990) 2024-05-10T04:23:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.288+0000 7f076be00700 1 -- 172.21.15.80:0/893479961 learned_addr learned my addr 172.21.15.80:0/893479961 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.288+0000 7f0770c00700 1 --2- 172.21.15.80:0/893479961 >> v2:172.21.15.106:3300/0 conn(0x7f076c0cb0e0 0x7f076c0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.288+0000 7f0771600700 1 --2- 172.21.15.80:0/893479961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f076c06b340 0x7f076c161fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.288+0000 7f076b400700 1 -- 172.21.15.80:0/893479961 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99827113 0 0) 0x7f076c0b20e0 con 0x7f076c0b6270 2024-05-10T04:23:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.288+0000 7f076b400700 1 -- 172.21.15.80:0/893479961 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07540035b0 con 0x7f076c0b6270 2024-05-10T04:23:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.289+0000 7f0770c00700 1 -- 172.21.15.80:0/893479961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f076c06b340 msgr2=0x7f076c161fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.289+0000 7f0770c00700 1 --2- 172.21.15.80:0/893479961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f076c06b340 0x7f076c161fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.289+0000 7f0770c00700 1 -- 172.21.15.80:0/893479961 >> v1:172.21.15.80:6789/0 conn(0x7f076c0b6270 legacy=0x7f076c06ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.289+0000 7f076b400700 1 -- 172.21.15.80:0/893479961 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4128944250 0 0) 0x7f07540035b0 con 0x7f076c0b6270 2024-05-10T04:23:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.289+0000 7f0770c00700 1 -- 172.21.15.80:0/893479961 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c15e8b0 con 0x7f076c0cb0e0 2024-05-10T04:23:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.289+0000 7f0770c00700 1 --2- 172.21.15.80:0/893479961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f076c0cb0e0 0x7f076c0b5cb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0760009840 tx=0x7f0760009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d53cfae65807e559 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.289+0000 7f076b400700 1 -- 172.21.15.80:0/893479961 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758001670 con 0x7f076c0cb0e0 2024-05-10T04:23:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.289+0000 7f076b400700 1 -- 172.21.15.80:0/893479961 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0760004030 con 0x7f076c0cb0e0 2024-05-10T04:23:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.289+0000 7f076b400700 1 -- 172.21.15.80:0/893479961 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07600043a0 con 0x7f076c0cb0e0 2024-05-10T04:23:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.290+0000 7f0773600700 1 -- 172.21.15.80:0/893479961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f076c0cb0e0 msgr2=0x7f076c0b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.290+0000 7f0773600700 1 --2- 172.21.15.80:0/893479961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f076c0cb0e0 0x7f076c0b5cb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0760009840 tx=0x7f0760009b50 comp rx=0 tx=0).stop 2024-05-10T04:23:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.290+0000 7f0773600700 1 -- 172.21.15.80:0/893479961 shutdown_connections 2024-05-10T04:23:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.290+0000 7f0773600700 1 --2- 172.21.15.80:0/893479961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f076c06b340 0x7f076c161fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.290+0000 7f0773600700 1 --2- 172.21.15.80:0/893479961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f076c0cb0e0 0x7f076c0b5cb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.290+0000 7f0773600700 1 -- 172.21.15.80:0/893479961 >> 172.21.15.80:0/893479961 conn(0x7f076c0d0a90 msgr2=0x7f076c0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.290+0000 7f0773600700 1 -- 172.21.15.80:0/893479961 shutdown_connections 2024-05-10T04:23:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.290+0000 7f0773600700 1 -- 172.21.15.80:0/893479961 wait complete. 2024-05-10T04:23:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.293+0000 7f0773600700 1 Processor -- start 2024-05-10T04:23:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.293+0000 7f0773600700 1 -- start start 2024-05-10T04:23:14.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.295+0000 7f0773600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f076c0b6270 0x7f076c14cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.295+0000 7f0773600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f076c0cb0e0 0x7f076c0ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.295+0000 7f0773600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f076c0c6e10 0x7f076c0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.295+0000 7f0773600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c15a6a0 con 0x7f076c0cb0e0 2024-05-10T04:23:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.295+0000 7f0773600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c0c86a0 con 0x7f076c0c6e10 2024-05-10T04:23:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.295+0000 7f0773600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076c0c5ab0 con 0x7f076c0b6270 2024-05-10T04:23:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.295+0000 7f076be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f076c0cb0e0 0x7f076c0ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.295+0000 7f076be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f076c0cb0e0 0x7f076c0ad800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53694/0 (socket says 172.21.15.80:53694) 2024-05-10T04:23:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.295+0000 7f076be00700 1 -- 172.21.15.80:0/585358494 learned_addr learned my addr 172.21.15.80:0/585358494 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.295+0000 7f0770c00700 1 --2- 172.21.15.80:0/585358494 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f076c0b6270 0x7f076c14cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.295+0000 7f0771600700 1 --2- 172.21.15.80:0/585358494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f076c0c6e10 0x7f076c0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.296+0000 7f076be00700 1 -- 172.21.15.80:0/585358494 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f076c0b6270 msgr2=0x7f076c14cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.296+0000 7f076be00700 1 --2- 172.21.15.80:0/585358494 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f076c0b6270 0x7f076c14cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.296+0000 7f076be00700 1 -- 172.21.15.80:0/585358494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f076c0c6e10 msgr2=0x7f076c0c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.296+0000 7f076be00700 1 --2- 172.21.15.80:0/585358494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f076c0c6e10 0x7f076c0c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.296+0000 7f076be00700 1 -- 172.21.15.80:0/585358494 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07600094a0 con 0x7f076c0cb0e0 2024-05-10T04:23:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.296+0000 7f0771600700 1 --2- 172.21.15.80:0/585358494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f076c0c6e10 0x7f076c0c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.296+0000 7f076be00700 1 --2- 172.21.15.80:0/585358494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f076c0cb0e0 0x7f076c0ad800 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f075800c550 tx=0x7f075800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.296+0000 7f0768c00700 1 -- 172.21.15.80:0/585358494 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758004c80 con 0x7f076c0cb0e0 2024-05-10T04:23:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.296+0000 7f0768c00700 1 -- 172.21.15.80:0/585358494 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0758004e20 con 0x7f076c0cb0e0 2024-05-10T04:23:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.296+0000 7f0773600700 1 -- 172.21.15.80:0/585358494 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076c0c5fe0 con 0x7f076c0cb0e0 2024-05-10T04:23:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.296+0000 7f0768c00700 1 -- 172.21.15.80:0/585358494 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758007310 con 0x7f076c0cb0e0 2024-05-10T04:23:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.296+0000 7f0773600700 1 -- 172.21.15.80:0/585358494 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076c0add40 con 0x7f076c0cb0e0 2024-05-10T04:23:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.297+0000 7f0773600700 1 -- 172.21.15.80:0/585358494 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076c074af0 con 0x7f076c0cb0e0 2024-05-10T04:23:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.298+0000 7f0768c00700 1 -- 172.21.15.80:0/585358494 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0758007470 con 0x7f076c0cb0e0 2024-05-10T04:23:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.299+0000 7f0768c00700 1 --2- 172.21.15.80:0/585358494 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f074c06acc0 0x7f074c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:14.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.299+0000 7f0768c00700 1 -- 172.21.15.80:0/585358494 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07580890a0 con 0x7f076c0cb0e0 2024-05-10T04:23:14.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.300+0000 7f0770c00700 1 --2- 172.21.15.80:0/585358494 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f074c06acc0 0x7f074c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:14.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.300+0000 7f0770c00700 1 --2- 172.21.15.80:0/585358494 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f074c06acc0 0x7f074c06d1d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0760009840 tx=0x7f0760008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:14.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.304+0000 7f0768c00700 1 -- 172.21.15.80:0/585358494 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f07580541e0 con 0x7f076c0cb0e0 2024-05-10T04:23:14.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.510+0000 7f0773600700 1 -- 172.21.15.80:0/585358494 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f076c0b0df0 con 0x7f076c0cb0e0 2024-05-10T04:23:14.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.511+0000 7f0768c00700 1 -- 172.21.15.80:0/585358494 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f0758057800 con 0x7f076c0cb0e0 2024-05-10T04:23:14.513 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:14.513 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:38.485422+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:23:14.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.514+0000 7f0773600700 1 -- 172.21.15.80:0/585358494 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f074c06acc0 msgr2=0x7f074c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:14.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.514+0000 7f0773600700 1 --2- 172.21.15.80:0/585358494 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f074c06acc0 0x7f074c06d1d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0760009840 tx=0x7f0760008030 comp rx=0 tx=0).stop 2024-05-10T04:23:14.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.514+0000 7f0773600700 1 -- 172.21.15.80:0/585358494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f076c0cb0e0 msgr2=0x7f076c0ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:14.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.514+0000 7f0773600700 1 --2- 172.21.15.80:0/585358494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f076c0cb0e0 0x7f076c0ad800 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f075800c550 tx=0x7f075800c860 comp rx=0 tx=0).stop 2024-05-10T04:23:14.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.514+0000 7f0773600700 1 -- 172.21.15.80:0/585358494 shutdown_connections 2024-05-10T04:23:14.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.514+0000 7f0773600700 1 --2- 172.21.15.80:0/585358494 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f074c06acc0 0x7f074c06d1d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:14.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.514+0000 7f0773600700 1 --2- 172.21.15.80:0/585358494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f076c0c6e10 0x7f076c0c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:14.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.514+0000 7f0773600700 1 --2- 172.21.15.80:0/585358494 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f076c0b6270 0x7f076c14cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:14.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.514+0000 7f0773600700 1 --2- 172.21.15.80:0/585358494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f076c0cb0e0 0x7f076c0ad800 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:14.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.514+0000 7f0773600700 1 -- 172.21.15.80:0/585358494 >> 172.21.15.80:0/585358494 conn(0x7f076c0d0a90 msgr2=0x7f076c06ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:14.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.514+0000 7f0773600700 1 -- 172.21.15.80:0/585358494 shutdown_connections 2024-05-10T04:23:14.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.514+0000 7f0773600700 1 -- 172.21.15.80:0/585358494 wait complete. 2024-05-10T04:23:14.539 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:22:26.793377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:22:35.751764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:22:36.465587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:23:14.540 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:23:14.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.801+0000 7f8782800700 1 Processor -- start 2024-05-10T04:23:14.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.801+0000 7f8782800700 1 -- start start 2024-05-10T04:23:14.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.803+0000 7f8782800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f877c162150 0x7f877c15e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:14.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.803+0000 7f8782800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877c0d2c00 con 0x7f877c0cf4d0 2024-05-10T04:23:14.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.803+0000 7f8782800700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877c162630 con 0x7f877c06c160 2024-05-10T04:23:14.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.803+0000 7f8782800700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877c162910 con 0x7f877c162150 2024-05-10T04:23:14.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.803+0000 7f877b400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f877c162150 0x7f877c15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:14.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.803+0000 7f877aa00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f877c0cf4d0 0x7f877c0b73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33998/0 (socket says 172.21.15.80:33998) 2024-05-10T04:23:14.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.803+0000 7f877aa00700 1 -- 172.21.15.80:0/4019746583 learned_addr learned my addr 172.21.15.80:0/4019746583 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:14.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.803+0000 7f877b400700 1 -- 172.21.15.80:0/4019746583 >> v1:172.21.15.106:6789/0 conn(0x7f877c06c160 legacy=0x7f877c06c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:14.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.803+0000 7f877b400700 1 -- 172.21.15.80:0/4019746583 >> v1:172.21.15.80:6789/0 conn(0x7f877c0cf4d0 legacy=0x7f877c0b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:14.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.803+0000 7f877b400700 1 -- 172.21.15.80:0/4019746583 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c162bf0 con 0x7f877c162150 2024-05-10T04:23:14.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.803+0000 7f877a000700 1 -- 172.21.15.80:0/4019746583 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969577997 0 0) 0x7f877c0d2c00 con 0x7f877c0cf4d0 2024-05-10T04:23:14.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.804+0000 7f877b400700 1 --2- 172.21.15.80:0/4019746583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877c162150 0x7f877c15e610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f876c009870 tx=0x7f876c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea501ce1b9f3802a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:14.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.804+0000 7f877a000700 1 -- 172.21.15.80:0/4019746583 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c004230 con 0x7f877c162150 2024-05-10T04:23:14.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.804+0000 7f877a000700 1 -- 172.21.15.80:0/4019746583 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876c004390 con 0x7f877c162150 2024-05-10T04:23:14.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.804+0000 7f877a000700 1 -- 172.21.15.80:0/4019746583 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c0036a0 con 0x7f877c162150 2024-05-10T04:23:14.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.805+0000 7f8782800700 1 -- 172.21.15.80:0/4019746583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877c162150 msgr2=0x7f877c15e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:14.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.805+0000 7f8782800700 1 --2- 172.21.15.80:0/4019746583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877c162150 0x7f877c15e610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f876c009870 tx=0x7f876c009b80 comp rx=0 tx=0).stop 2024-05-10T04:23:14.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.805+0000 7f8782800700 1 -- 172.21.15.80:0/4019746583 shutdown_connections 2024-05-10T04:23:14.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.805+0000 7f8782800700 1 --2- 172.21.15.80:0/4019746583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877c162150 0x7f877c15e610 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:14.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.805+0000 7f8782800700 1 -- 172.21.15.80:0/4019746583 >> 172.21.15.80:0/4019746583 conn(0x7f877c0d3e10 msgr2=0x7f877c0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:14.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.805+0000 7f8782800700 1 -- 172.21.15.80:0/4019746583 shutdown_connections 2024-05-10T04:23:14.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.805+0000 7f8782800700 1 -- 172.21.15.80:0/4019746583 wait complete. 2024-05-10T04:23:14.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.807+0000 7f8782800700 1 Processor -- start 2024-05-10T04:23:14.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.807+0000 7f8782800700 1 -- start start 2024-05-10T04:23:14.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.809+0000 7f8782800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f877c06c160 0x7f877c1e9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:14.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.809+0000 7f8782800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f877c0cf4d0 0x7f877c155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:14.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.809+0000 7f8782800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877c162150 0x7f877c15be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:14.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.809+0000 7f8782800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c157cf0 con 0x7f877c162150 2024-05-10T04:23:14.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.809+0000 7f8782800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0c85b0 con 0x7f877c06c160 2024-05-10T04:23:14.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.809+0000 7f8782800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877c156520 con 0x7f877c0cf4d0 2024-05-10T04:23:14.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.809+0000 7f877be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877c162150 0x7f877c15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:14.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.809+0000 7f877be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877c162150 0x7f877c15be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53708/0 (socket says 172.21.15.80:53708) 2024-05-10T04:23:14.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.809+0000 7f877be00700 1 -- 172.21.15.80:0/4129256748 learned_addr learned my addr 172.21.15.80:0/4129256748 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:14.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.809+0000 7f877aa00700 1 --2- 172.21.15.80:0/4129256748 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f877c0cf4d0 0x7f877c155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:14.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.809+0000 7f877b400700 1 --2- 172.21.15.80:0/4129256748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f877c06c160 0x7f877c1e9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:14.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.809+0000 7f877be00700 1 -- 172.21.15.80:0/4129256748 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f877c0cf4d0 msgr2=0x7f877c155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:14.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.809+0000 7f877be00700 1 --2- 172.21.15.80:0/4129256748 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f877c0cf4d0 0x7f877c155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:14.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.809+0000 7f877be00700 1 -- 172.21.15.80:0/4129256748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f877c06c160 msgr2=0x7f877c1e9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:14.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.809+0000 7f877be00700 1 --2- 172.21.15.80:0/4129256748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f877c06c160 0x7f877c1e9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:14.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.809+0000 7f877be00700 1 -- 172.21.15.80:0/4129256748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c0094a0 con 0x7f877c162150 2024-05-10T04:23:14.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.810+0000 7f877be00700 1 --2- 172.21.15.80:0/4129256748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877c162150 0x7f877c15be70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f877400ba10 tx=0x7f877400bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:14.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.810+0000 7f8773400700 1 -- 172.21.15.80:0/4129256748 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877400d8e0 con 0x7f877c162150 2024-05-10T04:23:14.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.810+0000 7f8773400700 1 -- 172.21.15.80:0/4129256748 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877400da80 con 0x7f877c162150 2024-05-10T04:23:14.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.810+0000 7f8782800700 1 -- 172.21.15.80:0/4129256748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877c1e9e90 con 0x7f877c162150 2024-05-10T04:23:14.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.810+0000 7f8773400700 1 -- 172.21.15.80:0/4129256748 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877400de30 con 0x7f877c162150 2024-05-10T04:23:14.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.810+0000 7f8782800700 1 -- 172.21.15.80:0/4129256748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877c0c8800 con 0x7f877c162150 2024-05-10T04:23:14.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.811+0000 7f8782800700 1 -- 172.21.15.80:0/4129256748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877c074af0 con 0x7f877c162150 2024-05-10T04:23:14.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.813+0000 7f8773400700 1 -- 172.21.15.80:0/4129256748 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8774015420 con 0x7f877c162150 2024-05-10T04:23:14.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.814+0000 7f8773400700 1 --2- 172.21.15.80:0/4129256748 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f875c06acc0 0x7f875c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:14.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.814+0000 7f8773400700 1 -- 172.21.15.80:0/4129256748 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8774011070 con 0x7f877c162150 2024-05-10T04:23:14.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.814+0000 7f877b400700 1 --2- 172.21.15.80:0/4129256748 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f875c06acc0 0x7f875c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:14.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.815+0000 7f877b400700 1 --2- 172.21.15.80:0/4129256748 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f875c06acc0 0x7f875c06d1d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f876c009870 tx=0x7f876c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:14.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:14.817+0000 7f8773400700 1 -- 172.21.15.80:0/4129256748 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8774054b40 con 0x7f877c162150 2024-05-10T04:23:15.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.030+0000 7f8782800700 1 -- 172.21.15.80:0/4129256748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f877c156660 con 0x7f877c162150 2024-05-10T04:23:15.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.030+0000 7f8773400700 1 -- 172.21.15.80:0/4129256748 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8774058160 con 0x7f877c162150 2024-05-10T04:23:15.031 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-10T04:23:15.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.032+0000 7f8782800700 1 -- 172.21.15.80:0/4129256748 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f875c06acc0 msgr2=0x7f875c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:15.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.032+0000 7f8782800700 1 --2- 172.21.15.80:0/4129256748 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f875c06acc0 0x7f875c06d1d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f876c009870 tx=0x7f876c008030 comp rx=0 tx=0).stop 2024-05-10T04:23:15.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.032+0000 7f8782800700 1 -- 172.21.15.80:0/4129256748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877c162150 msgr2=0x7f877c15be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:15.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.032+0000 7f8782800700 1 --2- 172.21.15.80:0/4129256748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877c162150 0x7f877c15be70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f877400ba10 tx=0x7f877400bd20 comp rx=0 tx=0).stop 2024-05-10T04:23:15.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.033+0000 7f8782800700 1 -- 172.21.15.80:0/4129256748 shutdown_connections 2024-05-10T04:23:15.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.033+0000 7f8782800700 1 --2- 172.21.15.80:0/4129256748 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f875c06acc0 0x7f875c06d1d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:15.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.033+0000 7f8782800700 1 --2- 172.21.15.80:0/4129256748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877c162150 0x7f877c15be70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:15.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.033+0000 7f8782800700 1 --2- 172.21.15.80:0/4129256748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f877c06c160 0x7f877c1e9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.033+0000 7f8782800700 1 --2- 172.21.15.80:0/4129256748 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f877c0cf4d0 0x7f877c155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.033+0000 7f8782800700 1 -- 172.21.15.80:0/4129256748 >> 172.21.15.80:0/4129256748 conn(0x7f877c0d3e10 msgr2=0x7f877c0b4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.033+0000 7f8782800700 1 -- 172.21.15.80:0/4129256748 shutdown_connections 2024-05-10T04:23:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.033+0000 7f8782800700 1 -- 172.21.15.80:0/4129256748 wait complete. 2024-05-10T04:23:15.062 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:23:15.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.325+0000 7fd7d3e00700 1 Processor -- start 2024-05-10T04:23:15.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.325+0000 7fd7d3e00700 1 -- start start 2024-05-10T04:23:15.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.327+0000 7fd7d3e00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd7cc0cf610 0x7fd7cc15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:15.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.327+0000 7fd7d3e00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7cc06db00 con 0x7fd7cc06df90 2024-05-10T04:23:15.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.327+0000 7fd7d3e00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7cc06e7b0 con 0x7fd7cc06e3a0 2024-05-10T04:23:15.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.327+0000 7fd7d3e00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7cc15d160 con 0x7fd7cc0cf610 2024-05-10T04:23:15.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.327+0000 7fd7d0a00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd7cc06df90 0x7fd7cc15d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34002/0 (socket says 172.21.15.80:34002) 2024-05-10T04:23:15.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.327+0000 7fd7d0a00700 1 -- 172.21.15.80:0/830084192 learned_addr learned my addr 172.21.15.80:0/830084192 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:15.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.327+0000 7fd7d1400700 1 --2- 172.21.15.80:0/830084192 >> v2:172.21.15.106:3300/0 conn(0x7fd7cc0cf610 0x7fd7cc15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:15.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.328+0000 7fd7cbe00700 1 -- 172.21.15.80:0/830084192 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192861503 0 0) 0x7fd7cc06db00 con 0x7fd7cc06df90 2024-05-10T04:23:15.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.328+0000 7fd7cbe00700 1 -- 172.21.15.80:0/830084192 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7b40035b0 con 0x7fd7cc06df90 2024-05-10T04:23:15.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.328+0000 7fd7d1400700 1 -- 172.21.15.80:0/830084192 >> v1:172.21.15.106:6789/0 conn(0x7fd7cc06e3a0 legacy=0x7fd7cc071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:15.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.328+0000 7fd7d1400700 1 -- 172.21.15.80:0/830084192 >> v1:172.21.15.80:6789/0 conn(0x7fd7cc06df90 legacy=0x7fd7cc15d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:15.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.328+0000 7fd7cbe00700 1 -- 172.21.15.80:0/830084192 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 155494188 0 0) 0x7fd7b40035b0 con 0x7fd7cc06df90 2024-05-10T04:23:15.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.328+0000 7fd7d1400700 1 -- 172.21.15.80:0/830084192 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc15d440 con 0x7fd7cc0cf610 2024-05-10T04:23:15.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.328+0000 7fd7d1400700 1 --2- 172.21.15.80:0/830084192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7cc0cf610 0x7fd7cc15c7f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009840 tx=0x7fd7c0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=669325b2f2d6788 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:15.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.329+0000 7fd7cbe00700 1 -- 172.21.15.80:0/830084192 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8001670 con 0x7fd7cc0cf610 2024-05-10T04:23:15.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.329+0000 7fd7cbe00700 1 -- 172.21.15.80:0/830084192 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c0004030 con 0x7fd7cc0cf610 2024-05-10T04:23:15.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.329+0000 7fd7cbe00700 1 -- 172.21.15.80:0/830084192 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c00043c0 con 0x7fd7cc0cf610 2024-05-10T04:23:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.329+0000 7fd7d3e00700 1 -- 172.21.15.80:0/830084192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7cc0cf610 msgr2=0x7fd7cc15c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.329+0000 7fd7d3e00700 1 --2- 172.21.15.80:0/830084192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7cc0cf610 0x7fd7cc15c7f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009840 tx=0x7fd7c0009b50 comp rx=0 tx=0).stop 2024-05-10T04:23:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.329+0000 7fd7d3e00700 1 -- 172.21.15.80:0/830084192 shutdown_connections 2024-05-10T04:23:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.329+0000 7fd7d3e00700 1 --2- 172.21.15.80:0/830084192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7cc0cf610 0x7fd7cc15c7f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.329+0000 7fd7d3e00700 1 -- 172.21.15.80:0/830084192 >> 172.21.15.80:0/830084192 conn(0x7fd7cc0b1830 msgr2=0x7fd7cc0b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.329+0000 7fd7d3e00700 1 -- 172.21.15.80:0/830084192 shutdown_connections 2024-05-10T04:23:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.330+0000 7fd7d3e00700 1 -- 172.21.15.80:0/830084192 wait complete. 2024-05-10T04:23:15.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.332+0000 7fd7d3e00700 1 Processor -- start 2024-05-10T04:23:15.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.332+0000 7fd7d3e00700 1 -- start start 2024-05-10T04:23:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.333+0000 7fd7d3e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7cc06df90 0x7fd7cc14b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.333+0000 7fd7d3e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7cc06e3a0 0x7fd7cc1e5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.333+0000 7fd7d3e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7cc0cf610 0x7fd7cc1e60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.333+0000 7fd7d3e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc158310 con 0x7fd7cc0cf610 2024-05-10T04:23:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.333+0000 7fd7d3e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc1e6670 con 0x7fd7cc06df90 2024-05-10T04:23:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.333+0000 7fd7d3e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc1e74d0 con 0x7fd7cc06e3a0 2024-05-10T04:23:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.334+0000 7fd7d1e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7cc0cf610 0x7fd7cc1e60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.334+0000 7fd7d0a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7cc06e3a0 0x7fd7cc1e5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.334+0000 7fd7d1e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7cc0cf610 0x7fd7cc1e60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53722/0 (socket says 172.21.15.80:53722) 2024-05-10T04:23:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.334+0000 7fd7d1e00700 1 -- 172.21.15.80:0/1742751475 learned_addr learned my addr 172.21.15.80:0/1742751475 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.334+0000 7fd7d1400700 1 --2- 172.21.15.80:0/1742751475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7cc06df90 0x7fd7cc14b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.334+0000 7fd7d1e00700 1 -- 172.21.15.80:0/1742751475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7cc06e3a0 msgr2=0x7fd7cc1e5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.334+0000 7fd7d1e00700 1 --2- 172.21.15.80:0/1742751475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7cc06e3a0 0x7fd7cc1e5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.334+0000 7fd7d1e00700 1 -- 172.21.15.80:0/1742751475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7cc06df90 msgr2=0x7fd7cc14b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.334+0000 7fd7d1e00700 1 --2- 172.21.15.80:0/1742751475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7cc06df90 0x7fd7cc14b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.334+0000 7fd7d1e00700 1 -- 172.21.15.80:0/1742751475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c00094a0 con 0x7fd7cc0cf610 2024-05-10T04:23:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.334+0000 7fd7d1e00700 1 --2- 172.21.15.80:0/1742751475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7cc0cf610 0x7fd7cc1e60f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400cbc0 tx=0x7fd7c400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.335+0000 7fd7c9600700 1 -- 172.21.15.80:0/1742751475 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4003c00 con 0x7fd7cc0cf610 2024-05-10T04:23:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.335+0000 7fd7c9600700 1 -- 172.21.15.80:0/1742751475 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c4003d60 con 0x7fd7cc0cf610 2024-05-10T04:23:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.335+0000 7fd7d3e00700 1 -- 172.21.15.80:0/1742751475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7cc0cd500 con 0x7fd7cc0cf610 2024-05-10T04:23:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.335+0000 7fd7c9600700 1 -- 172.21.15.80:0/1742751475 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c400a9c0 con 0x7fd7cc0cf610 2024-05-10T04:23:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.335+0000 7fd7d3e00700 1 -- 172.21.15.80:0/1742751475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7cc1e6ba0 con 0x7fd7cc0cf610 2024-05-10T04:23:15.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.336+0000 7fd7d3e00700 1 -- 172.21.15.80:0/1742751475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7cc074af0 con 0x7fd7cc0cf610 2024-05-10T04:23:15.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.337+0000 7fd7c9600700 1 -- 172.21.15.80:0/1742751475 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd7c400ab20 con 0x7fd7cc0cf610 2024-05-10T04:23:15.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.338+0000 7fd7c9600700 1 --2- 172.21.15.80:0/1742751475 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd7ac06acc0 0x7fd7ac06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:15.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.338+0000 7fd7c9600700 1 -- 172.21.15.80:0/1742751475 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7c4089230 con 0x7fd7cc0cf610 2024-05-10T04:23:15.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.338+0000 7fd7d1400700 1 --2- 172.21.15.80:0/1742751475 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd7ac06acc0 0x7fd7ac06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:15.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.339+0000 7fd7d1400700 1 --2- 172.21.15.80:0/1742751475 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd7ac06acc0 0x7fd7ac06d1d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009840 tx=0x7fd7c0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:15.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.342+0000 7fd7c9600700 1 -- 172.21.15.80:0/1742751475 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd7c40542e0 con 0x7fd7cc0cf610 2024-05-10T04:23:15.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.549+0000 7fd7d3e00700 1 -- 172.21.15.80:0/1742751475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd7cc1e7610 con 0x7fd7cc0cf610 2024-05-10T04:23:15.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.549+0000 7fd7c9600700 1 -- 172.21.15.80:0/1742751475 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd7c4057900 con 0x7fd7cc0cf610 2024-05-10T04:23:15.551 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-10T04:23:15.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.552+0000 7fd7d3e00700 1 -- 172.21.15.80:0/1742751475 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd7ac06acc0 msgr2=0x7fd7ac06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:15.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.552+0000 7fd7d3e00700 1 --2- 172.21.15.80:0/1742751475 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd7ac06acc0 0x7fd7ac06d1d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009840 tx=0x7fd7c0008030 comp rx=0 tx=0).stop 2024-05-10T04:23:15.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.552+0000 7fd7d3e00700 1 -- 172.21.15.80:0/1742751475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7cc0cf610 msgr2=0x7fd7cc1e60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:15.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.552+0000 7fd7d3e00700 1 --2- 172.21.15.80:0/1742751475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7cc0cf610 0x7fd7cc1e60f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400cbc0 tx=0x7fd7c400ced0 comp rx=0 tx=0).stop 2024-05-10T04:23:15.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.552+0000 7fd7d3e00700 1 -- 172.21.15.80:0/1742751475 shutdown_connections 2024-05-10T04:23:15.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.552+0000 7fd7d3e00700 1 --2- 172.21.15.80:0/1742751475 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd7ac06acc0 0x7fd7ac06d1d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:15.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.552+0000 7fd7d3e00700 1 --2- 172.21.15.80:0/1742751475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7cc0cf610 0x7fd7cc1e60f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:15.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.552+0000 7fd7d3e00700 1 --2- 172.21.15.80:0/1742751475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7cc06df90 0x7fd7cc14b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:15.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.552+0000 7fd7d3e00700 1 --2- 172.21.15.80:0/1742751475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7cc06e3a0 0x7fd7cc1e5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:15.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.552+0000 7fd7d3e00700 1 -- 172.21.15.80:0/1742751475 >> 172.21.15.80:0/1742751475 conn(0x7fd7cc0b1830 msgr2=0x7fd7cc1521f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:15.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.552+0000 7fd7d3e00700 1 -- 172.21.15.80:0/1742751475 shutdown_connections 2024-05-10T04:23:15.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.552+0000 7fd7d3e00700 1 -- 172.21.15.80:0/1742751475 wait complete. 2024-05-10T04:23:15.579 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:23:15.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.844+0000 7fdcbe600700 1 Processor -- start 2024-05-10T04:23:15.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.844+0000 7fdcbe600700 1 -- start start 2024-05-10T04:23:15.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.846+0000 7fdcbe600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdcb80b98e0 0x7fdcb80d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.846+0000 7fdcbe600700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb80d2e50 con 0x7fdcb80d0c90 2024-05-10T04:23:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.846+0000 7fdcbe600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb80d3130 con 0x7fdcb80b6230 2024-05-10T04:23:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.846+0000 7fdcbe600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb80d3410 con 0x7fdcb80b98e0 2024-05-10T04:23:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.846+0000 7fdcbd200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdcb80b98e0 0x7fdcb80d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.846+0000 7fdcbdc00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdcb80d0c90 0x7fdcb815d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34008/0 (socket says 172.21.15.80:34008) 2024-05-10T04:23:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.847+0000 7fdcbdc00700 1 -- 172.21.15.80:0/711312627 learned_addr learned my addr 172.21.15.80:0/711312627 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:15.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.847+0000 7fdcbd200700 1 -- 172.21.15.80:0/711312627 >> v1:172.21.15.106:6789/0 conn(0x7fdcb80b6230 legacy=0x7fdcb80d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.847+0000 7fdcbd200700 1 -- 172.21.15.80:0/711312627 >> v1:172.21.15.80:6789/0 conn(0x7fdcb80d0c90 legacy=0x7fdcb815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.847+0000 7fdcbd200700 1 -- 172.21.15.80:0/711312627 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb80b7470 con 0x7fdcb80b98e0 2024-05-10T04:23:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.847+0000 7fdcbd200700 1 --2- 172.21.15.80:0/711312627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb80b98e0 0x7fdcb80d2520 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009840 tx=0x7fdcac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe6967c57a9e9ec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.847+0000 7fdcb7400700 1 -- 172.21.15.80:0/711312627 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac004230 con 0x7fdcb80b98e0 2024-05-10T04:23:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.847+0000 7fdcb7400700 1 -- 172.21.15.80:0/711312627 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac004390 con 0x7fdcb80b98e0 2024-05-10T04:23:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.847+0000 7fdcb7400700 1 -- 172.21.15.80:0/711312627 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0036a0 con 0x7fdcb80b98e0 2024-05-10T04:23:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.848+0000 7fdcbe600700 1 -- 172.21.15.80:0/711312627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb80b98e0 msgr2=0x7fdcb80d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.848+0000 7fdcbe600700 1 --2- 172.21.15.80:0/711312627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb80b98e0 0x7fdcb80d2520 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009840 tx=0x7fdcac009b50 comp rx=0 tx=0).stop 2024-05-10T04:23:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.848+0000 7fdcbe600700 1 -- 172.21.15.80:0/711312627 shutdown_connections 2024-05-10T04:23:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.848+0000 7fdcbe600700 1 --2- 172.21.15.80:0/711312627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb80b98e0 0x7fdcb80d2520 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.848+0000 7fdcbe600700 1 -- 172.21.15.80:0/711312627 >> 172.21.15.80:0/711312627 conn(0x7fdcb80676c0 msgr2=0x7fdcb806c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:15.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.848+0000 7fdcbe600700 1 -- 172.21.15.80:0/711312627 shutdown_connections 2024-05-10T04:23:15.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.848+0000 7fdcbe600700 1 -- 172.21.15.80:0/711312627 wait complete. 2024-05-10T04:23:15.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.850+0000 7fdcbe600700 1 Processor -- start 2024-05-10T04:23:15.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.851+0000 7fdcbe600700 1 -- start start 2024-05-10T04:23:15.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.852+0000 7fdcbe600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcb80b6230 0x7fdcb814c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:15.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.852+0000 7fdcbe600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb80b98e0 0x7fdcb80c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.852+0000 7fdcbe600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcb80d0c90 0x7fdcb814a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.852+0000 7fdcbe600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb815a410 con 0x7fdcb80b98e0 2024-05-10T04:23:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.852+0000 7fdcbe600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb814ae30 con 0x7fdcb80d0c90 2024-05-10T04:23:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.852+0000 7fdcbe600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb814b080 con 0x7fdcb80b6230 2024-05-10T04:23:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.852+0000 7fdcb7e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb80b98e0 0x7fdcb80c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.852+0000 7fdcb7e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb80b98e0 0x7fdcb80c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53742/0 (socket says 172.21.15.80:53742) 2024-05-10T04:23:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.852+0000 7fdcb7e00700 1 -- 172.21.15.80:0/575530630 learned_addr learned my addr 172.21.15.80:0/575530630 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.853+0000 7fdcbd200700 1 --2- 172.21.15.80:0/575530630 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcb80b6230 0x7fdcb814c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.853+0000 7fdcb7e00700 1 -- 172.21.15.80:0/575530630 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcb80b6230 msgr2=0x7fdcb814c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.853+0000 7fdcb7e00700 1 --2- 172.21.15.80:0/575530630 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcb80b6230 0x7fdcb814c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.853+0000 7fdcb7e00700 1 -- 172.21.15.80:0/575530630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcb80d0c90 msgr2=0x7fdcb814a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.853+0000 7fdcb7e00700 1 --2- 172.21.15.80:0/575530630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcb80d0c90 0x7fdcb814a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.853+0000 7fdcb7e00700 1 -- 172.21.15.80:0/575530630 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac0094a0 con 0x7fdcb80b98e0 2024-05-10T04:23:15.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.853+0000 7fdcb7e00700 1 --2- 172.21.15.80:0/575530630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb80b98e0 0x7fdcb80c8a80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdca400b450 tx=0x7fdca400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:15.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.853+0000 7fdcb4c00700 1 -- 172.21.15.80:0/575530630 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4011830 con 0x7fdcb80b98e0 2024-05-10T04:23:15.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.853+0000 7fdcb4c00700 1 -- 172.21.15.80:0/575530630 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca4011990 con 0x7fdcb80b98e0 2024-05-10T04:23:15.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.853+0000 7fdcb4c00700 1 -- 172.21.15.80:0/575530630 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4011d40 con 0x7fdcb80b98e0 2024-05-10T04:23:15.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.853+0000 7fdcbe600700 1 -- 172.21.15.80:0/575530630 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb814b360 con 0x7fdcb80b98e0 2024-05-10T04:23:15.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.854+0000 7fdcbe600700 1 -- 172.21.15.80:0/575530630 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb814b920 con 0x7fdcb80b98e0 2024-05-10T04:23:15.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.854+0000 7fdcbe600700 1 -- 172.21.15.80:0/575530630 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb814bf70 con 0x7fdcb80b98e0 2024-05-10T04:23:15.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.855+0000 7fdcb4c00700 1 -- 172.21.15.80:0/575530630 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdca401a400 con 0x7fdcb80b98e0 2024-05-10T04:23:15.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.856+0000 7fdcb4c00700 1 --2- 172.21.15.80:0/575530630 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdc9806ac90 0x7fdc9806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:15.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.856+0000 7fdcb4c00700 1 -- 172.21.15.80:0/575530630 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdca40890c0 con 0x7fdcb80b98e0 2024-05-10T04:23:15.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.857+0000 7fdcbd200700 1 --2- 172.21.15.80:0/575530630 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdc9806ac90 0x7fdc9806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:15.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.857+0000 7fdcbd200700 1 --2- 172.21.15.80:0/575530630 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdc9806ac90 0x7fdc9806d1a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009b90 tx=0x7fdcac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:15.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:15.861+0000 7fdcb4c00700 1 -- 172.21.15.80:0/575530630 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdca4054200 con 0x7fdcb80b98e0 2024-05-10T04:23:16.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.066+0000 7fdcbe600700 1 -- 172.21.15.80:0/575530630 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdcb8074af0 con 0x7fdcb80b98e0 2024-05-10T04:23:16.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.066+0000 7fdcb4c00700 1 -- 172.21.15.80:0/575530630 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdca4057820 con 0x7fdcb80b98e0 2024-05-10T04:23:16.068 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-10T04:23:16.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.068+0000 7fdcbe600700 1 -- 172.21.15.80:0/575530630 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdc9806ac90 msgr2=0x7fdc9806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:16.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.068+0000 7fdcbe600700 1 --2- 172.21.15.80:0/575530630 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdc9806ac90 0x7fdc9806d1a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009b90 tx=0x7fdcac008030 comp rx=0 tx=0).stop 2024-05-10T04:23:16.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.068+0000 7fdcbe600700 1 -- 172.21.15.80:0/575530630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb80b98e0 msgr2=0x7fdcb80c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:16.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.068+0000 7fdcbe600700 1 --2- 172.21.15.80:0/575530630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb80b98e0 0x7fdcb80c8a80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdca400b450 tx=0x7fdca400b810 comp rx=0 tx=0).stop 2024-05-10T04:23:16.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.068+0000 7fdcbe600700 1 -- 172.21.15.80:0/575530630 shutdown_connections 2024-05-10T04:23:16.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.068+0000 7fdcbe600700 1 --2- 172.21.15.80:0/575530630 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdc9806ac90 0x7fdc9806d1a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.068+0000 7fdcbe600700 1 --2- 172.21.15.80:0/575530630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcb80d0c90 0x7fdcb814a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.068+0000 7fdcbe600700 1 --2- 172.21.15.80:0/575530630 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcb80b6230 0x7fdcb814c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.068+0000 7fdcbe600700 1 --2- 172.21.15.80:0/575530630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcb80b98e0 0x7fdcb80c8a80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.068+0000 7fdcbe600700 1 -- 172.21.15.80:0/575530630 >> 172.21.15.80:0/575530630 conn(0x7fdcb80676c0 msgr2=0x7fdcb80b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.069+0000 7fdcbe600700 1 -- 172.21.15.80:0/575530630 shutdown_connections 2024-05-10T04:23:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.069+0000 7fdcbe600700 1 -- 172.21.15.80:0/575530630 wait complete. 2024-05-10T04:23:16.096 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:23:16.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.354+0000 7f86ff600700 1 Processor -- start 2024-05-10T04:23:16.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.354+0000 7f86ff600700 1 -- start start 2024-05-10T04:23:16.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.356+0000 7f86ff600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f86f80b2f50 0x7f86f8161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:16.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.356+0000 7f86ff600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86f80d0d40 0x7f86f80d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:16.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.356+0000 7f86ff600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f80d28c0 con 0x7f86f80d3030 2024-05-10T04:23:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.356+0000 7f86ff600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f80b3360 con 0x7f86f80b2f50 2024-05-10T04:23:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.356+0000 7f86ff600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f81624e0 con 0x7f86f80d0d40 2024-05-10T04:23:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.356+0000 7f86fcc00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f86f80b2f50 0x7f86f8161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.356+0000 7f86fcc00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f86f80b2f50 0x7f86f8161fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53758/0 (socket says 172.21.15.80:53758) 2024-05-10T04:23:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.356+0000 7f86fcc00700 1 -- 172.21.15.80:0/2284519699 learned_addr learned my addr 172.21.15.80:0/2284519699 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.356+0000 7f86fd600700 1 --2- 172.21.15.80:0/2284519699 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86f80d0d40 0x7f86f80d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.357+0000 7f86fcc00700 1 -- 172.21.15.80:0/2284519699 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86f80d0d40 msgr2=0x7f86f80d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.357+0000 7f86fcc00700 1 --2- 172.21.15.80:0/2284519699 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86f80d0d40 0x7f86f80d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.357+0000 7f86fcc00700 1 -- 172.21.15.80:0/2284519699 >> v1:172.21.15.106:6789/0 conn(0x7f86f80d3030 legacy=0x7f86f80d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.357+0000 7f86fcc00700 1 -- 172.21.15.80:0/2284519699 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f80d2ba0 con 0x7f86f80b2f50 2024-05-10T04:23:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.357+0000 7f86fcc00700 1 --2- 172.21.15.80:0/2284519699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86f80b2f50 0x7f86f8161fa0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0098f0 tx=0x7f86ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7071619689c375 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.357+0000 7f86f7400700 1 -- 172.21.15.80:0/2284519699 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec011830 con 0x7f86f80b2f50 2024-05-10T04:23:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.357+0000 7f86f7400700 1 -- 172.21.15.80:0/2284519699 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec011990 con 0x7f86f80b2f50 2024-05-10T04:23:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.357+0000 7f86f7400700 1 -- 172.21.15.80:0/2284519699 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec011d20 con 0x7f86f80b2f50 2024-05-10T04:23:16.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.358+0000 7f86ff600700 1 -- 172.21.15.80:0/2284519699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86f80b2f50 msgr2=0x7f86f8161fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:16.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.358+0000 7f86ff600700 1 --2- 172.21.15.80:0/2284519699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86f80b2f50 0x7f86f8161fa0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0098f0 tx=0x7f86ec009c00 comp rx=0 tx=0).stop 2024-05-10T04:23:16.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.358+0000 7f86ff600700 1 -- 172.21.15.80:0/2284519699 shutdown_connections 2024-05-10T04:23:16.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.358+0000 7f86ff600700 1 --2- 172.21.15.80:0/2284519699 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86f80d0d40 0x7f86f80d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.358+0000 7f86ff600700 1 --2- 172.21.15.80:0/2284519699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86f80b2f50 0x7f86f8161fa0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.358+0000 7f86ff600700 1 -- 172.21.15.80:0/2284519699 >> 172.21.15.80:0/2284519699 conn(0x7f86f806c3f0 msgr2=0x7f86f806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:16.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.358+0000 7f86ff600700 1 -- 172.21.15.80:0/2284519699 shutdown_connections 2024-05-10T04:23:16.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.358+0000 7f86ff600700 1 -- 172.21.15.80:0/2284519699 wait complete. 2024-05-10T04:23:16.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.360+0000 7f86ff600700 1 Processor -- start 2024-05-10T04:23:16.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.361+0000 7f86ff600700 1 -- start start 2024-05-10T04:23:16.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.362+0000 7f86ff600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86f80b2f50 0x7f86f814e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:16.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.362+0000 7f86ff600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86f80d0d40 0x7f86f814c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:16.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.362+0000 7f86ff600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86f80d3030 0x7f86f814cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:16.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.362+0000 7f86ff600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f8150e40 con 0x7f86f80d0d40 2024-05-10T04:23:16.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.362+0000 7f86ff600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f814d360 con 0x7f86f80b2f50 2024-05-10T04:23:16.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.362+0000 7f86ff600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f814e1c0 con 0x7f86f80d3030 2024-05-10T04:23:16.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.362+0000 7f86f7e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86f80d0d40 0x7f86f814c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:16.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.362+0000 7f86f7e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86f80d0d40 0x7f86f814c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53774/0 (socket says 172.21.15.80:53774) 2024-05-10T04:23:16.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.362+0000 7f86f7e00700 1 -- 172.21.15.80:0/1482114605 learned_addr learned my addr 172.21.15.80:0/1482114605 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:16.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.362+0000 7f86fd600700 1 --2- 172.21.15.80:0/1482114605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86f80d3030 0x7f86f814cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:16.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.362+0000 7f86fcc00700 1 --2- 172.21.15.80:0/1482114605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86f80b2f50 0x7f86f814e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:16.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.363+0000 7f86f7e00700 1 -- 172.21.15.80:0/1482114605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86f80d3030 msgr2=0x7f86f814cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:16.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.363+0000 7f86f7e00700 1 --2- 172.21.15.80:0/1482114605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86f80d3030 0x7f86f814cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.363+0000 7f86f7e00700 1 -- 172.21.15.80:0/1482114605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86f80b2f50 msgr2=0x7f86f814e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:16.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.363+0000 7f86f7e00700 1 --2- 172.21.15.80:0/1482114605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86f80b2f50 0x7f86f814e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.363+0000 7f86f7e00700 1 -- 172.21.15.80:0/1482114605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec009550 con 0x7f86f80d0d40 2024-05-10T04:23:16.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.363+0000 7f86fd600700 1 --2- 172.21.15.80:0/1482114605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86f80d3030 0x7f86f814cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:16.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.363+0000 7f86f7e00700 1 --2- 172.21.15.80:0/1482114605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86f80d0d40 0x7f86f814c7e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f86e400c450 tx=0x7f86e400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:16.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.363+0000 7f86f4c00700 1 -- 172.21.15.80:0/1482114605 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e40052d0 con 0x7f86f80d0d40 2024-05-10T04:23:16.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.363+0000 7f86f4c00700 1 -- 172.21.15.80:0/1482114605 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e4005430 con 0x7f86f80d0d40 2024-05-10T04:23:16.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.363+0000 7f86f4c00700 1 -- 172.21.15.80:0/1482114605 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e40038c0 con 0x7f86f80d0d40 2024-05-10T04:23:16.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.363+0000 7f86ff600700 1 -- 172.21.15.80:0/1482114605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f814d5b0 con 0x7f86f80d0d40 2024-05-10T04:23:16.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.363+0000 7f86ff600700 1 -- 172.21.15.80:0/1482114605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f814db70 con 0x7f86f80d0d40 2024-05-10T04:23:16.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.364+0000 7f86ff600700 1 -- 172.21.15.80:0/1482114605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f814e370 con 0x7f86f80d0d40 2024-05-10T04:23:16.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.366+0000 7f86f4c00700 1 -- 172.21.15.80:0/1482114605 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f86e4003a20 con 0x7f86f80d0d40 2024-05-10T04:23:16.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.367+0000 7f86f4c00700 1 --2- 172.21.15.80:0/1482114605 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f86d806ac90 0x7f86d806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:16.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.367+0000 7f86f4c00700 1 -- 172.21.15.80:0/1482114605 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86e4088830 con 0x7f86f80d0d40 2024-05-10T04:23:16.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.367+0000 7f86fcc00700 1 --2- 172.21.15.80:0/1482114605 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f86d806ac90 0x7f86d806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:16.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.368+0000 7f86fcc00700 1 --2- 172.21.15.80:0/1482114605 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f86d806ac90 0x7f86d806d1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0098f0 tx=0x7f86ec008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:16.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.372+0000 7f86f4c00700 1 -- 172.21.15.80:0/1482114605 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f86f814e370 con 0x7f86f80d0d40 2024-05-10T04:23:16.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.576+0000 7f86ff600700 1 -- 172.21.15.80:0/1482114605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86f814e370 con 0x7f86f80d0d40 2024-05-10T04:23:16.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.577+0000 7f86f4c00700 1 -- 172.21.15.80:0/1482114605 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f86f814e370 con 0x7f86f80d0d40 2024-05-10T04:23:16.579 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:16.579 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:38.485422+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:23:16.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.580+0000 7f86ff600700 1 -- 172.21.15.80:0/1482114605 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f86d806ac90 msgr2=0x7f86d806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:16.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.580+0000 7f86ff600700 1 --2- 172.21.15.80:0/1482114605 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f86d806ac90 0x7f86d806d1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0098f0 tx=0x7f86ec008030 comp rx=0 tx=0).stop 2024-05-10T04:23:16.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.580+0000 7f86ff600700 1 -- 172.21.15.80:0/1482114605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86f80d0d40 msgr2=0x7f86f814c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:16.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.580+0000 7f86ff600700 1 --2- 172.21.15.80:0/1482114605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86f80d0d40 0x7f86f814c7e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f86e400c450 tx=0x7f86e400c760 comp rx=0 tx=0).stop 2024-05-10T04:23:16.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.580+0000 7f86ff600700 1 -- 172.21.15.80:0/1482114605 shutdown_connections 2024-05-10T04:23:16.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.580+0000 7f86ff600700 1 --2- 172.21.15.80:0/1482114605 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f86d806ac90 0x7f86d806d1a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.580+0000 7f86ff600700 1 --2- 172.21.15.80:0/1482114605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86f80d3030 0x7f86f814cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.580+0000 7f86ff600700 1 --2- 172.21.15.80:0/1482114605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86f80b2f50 0x7f86f814e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.580+0000 7f86ff600700 1 --2- 172.21.15.80:0/1482114605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86f80d0d40 0x7f86f814c7e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.580+0000 7f86ff600700 1 -- 172.21.15.80:0/1482114605 >> 172.21.15.80:0/1482114605 conn(0x7f86f806c3f0 msgr2=0x7f86f8160460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:16.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.580+0000 7f86ff600700 1 -- 172.21.15.80:0/1482114605 shutdown_connections 2024-05-10T04:23:16.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.580+0000 7f86ff600700 1 -- 172.21.15.80:0/1482114605 wait complete. 2024-05-10T04:23:16.609 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:22:26.793377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:22:35.751764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:22:36.465587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:23:16.609 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:23:16.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.875+0000 7f9ed0a00700 1 Processor -- start 2024-05-10T04:23:16.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.875+0000 7f9ed0a00700 1 -- start start 2024-05-10T04:23:16.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.876+0000 7f9ed0a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9ecc0b47e0 0x7f9ecc0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:16.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.876+0000 7f9ed0a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ecc06e800 0x7f9ecc06ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:16.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.877+0000 7f9ed0a00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ecc15c4e0 con 0x7f9ecc15b9c0 2024-05-10T04:23:16.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.877+0000 7f9ed0a00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ecc15c710 con 0x7f9ecc0b47e0 2024-05-10T04:23:16.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.877+0000 7f9ed0a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc0cf940 con 0x7f9ecc06e800 2024-05-10T04:23:16.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.877+0000 7f9ec9e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9ecc0b47e0 0x7f9ecc0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:16.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.877+0000 7f9ec9e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9ecc0b47e0 0x7f9ecc0cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53780/0 (socket says 172.21.15.80:53780) 2024-05-10T04:23:16.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.877+0000 7f9ec9e00700 1 -- 172.21.15.80:0/442617863 learned_addr learned my addr 172.21.15.80:0/442617863 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:16.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.877+0000 7f9ec3e00700 1 --2- 172.21.15.80:0/442617863 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ecc06e800 0x7f9ecc06ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:16.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.877+0000 7f9ec9e00700 1 -- 172.21.15.80:0/442617863 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ecc06e800 msgr2=0x7f9ecc06ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:16.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.877+0000 7f9ec9e00700 1 --2- 172.21.15.80:0/442617863 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ecc06e800 0x7f9ecc06ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.877+0000 7f9ec9e00700 1 -- 172.21.15.80:0/442617863 >> v1:172.21.15.106:6789/0 conn(0x7f9ecc15b9c0 legacy=0x7f9ecc15bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:16.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.877+0000 7f9ec9e00700 1 -- 172.21.15.80:0/442617863 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc06f150 con 0x7f9ecc0b47e0 2024-05-10T04:23:16.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.878+0000 7f9ec9e00700 1 --2- 172.21.15.80:0/442617863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc0b47e0 0x7f9ecc0cf400 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009920 tx=0x7f9ebc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13cab1fdf1acc360 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:16.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.878+0000 7f9ec9400700 1 -- 172.21.15.80:0/442617863 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc011830 con 0x7f9ecc0b47e0 2024-05-10T04:23:16.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.878+0000 7f9ec9400700 1 -- 172.21.15.80:0/442617863 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc011990 con 0x7f9ecc0b47e0 2024-05-10T04:23:16.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.878+0000 7f9ec9400700 1 -- 172.21.15.80:0/442617863 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc011d20 con 0x7f9ecc0b47e0 2024-05-10T04:23:16.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.878+0000 7f9ed0a00700 1 -- 172.21.15.80:0/442617863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc0b47e0 msgr2=0x7f9ecc0cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:16.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.878+0000 7f9ed0a00700 1 --2- 172.21.15.80:0/442617863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc0b47e0 0x7f9ecc0cf400 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009920 tx=0x7f9ebc009c30 comp rx=0 tx=0).stop 2024-05-10T04:23:16.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.879+0000 7f9ed0a00700 1 -- 172.21.15.80:0/442617863 shutdown_connections 2024-05-10T04:23:16.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.879+0000 7f9ed0a00700 1 --2- 172.21.15.80:0/442617863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc0b47e0 0x7f9ecc0cf400 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.879+0000 7f9ed0a00700 1 --2- 172.21.15.80:0/442617863 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ecc06e800 0x7f9ecc06ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.879+0000 7f9ed0a00700 1 -- 172.21.15.80:0/442617863 >> 172.21.15.80:0/442617863 conn(0x7f9ecc0b1830 msgr2=0x7f9ecc0b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:16.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.879+0000 7f9ed0a00700 1 -- 172.21.15.80:0/442617863 shutdown_connections 2024-05-10T04:23:16.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.879+0000 7f9ed0a00700 1 -- 172.21.15.80:0/442617863 wait complete. 2024-05-10T04:23:16.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.881+0000 7f9ed0a00700 1 Processor -- start 2024-05-10T04:23:16.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.881+0000 7f9ed0a00700 1 -- start start 2024-05-10T04:23:16.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.882+0000 7f9ed0a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ecc06e800 0x7f9ecc151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:16.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.882+0000 7f9ed0a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ecc0b47e0 0x7f9ecc1f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:16.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.883+0000 7f9ed0a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc15b9c0 0x7f9ecc0cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:16.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.883+0000 7f9ed0a00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc151cc0 con 0x7f9ecc15b9c0 2024-05-10T04:23:16.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.883+0000 7f9ed0a00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc151aa0 con 0x7f9ecc0b47e0 2024-05-10T04:23:16.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.883+0000 7f9ed0a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc1545e0 con 0x7f9ecc06e800 2024-05-10T04:23:16.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.883+0000 7f9eca800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc15b9c0 0x7f9ecc0cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:16.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.883+0000 7f9eca800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc15b9c0 0x7f9ecc0cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53790/0 (socket says 172.21.15.80:53790) 2024-05-10T04:23:16.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.883+0000 7f9eca800700 1 -- 172.21.15.80:0/2520746174 learned_addr learned my addr 172.21.15.80:0/2520746174 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:16.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.883+0000 7f9ec9e00700 1 --2- 172.21.15.80:0/2520746174 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ecc06e800 0x7f9ecc151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:16.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.883+0000 7f9ec3e00700 1 --2- 172.21.15.80:0/2520746174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ecc0b47e0 0x7f9ecc1f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:16.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.883+0000 7f9eca800700 1 -- 172.21.15.80:0/2520746174 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ecc06e800 msgr2=0x7f9ecc151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:16.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.883+0000 7f9eca800700 1 --2- 172.21.15.80:0/2520746174 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ecc06e800 0x7f9ecc151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.883+0000 7f9eca800700 1 -- 172.21.15.80:0/2520746174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ecc0b47e0 msgr2=0x7f9ecc1f3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:16.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.883+0000 7f9eca800700 1 --2- 172.21.15.80:0/2520746174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ecc0b47e0 0x7f9ecc1f3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:16.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.883+0000 7f9eca800700 1 -- 172.21.15.80:0/2520746174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc009550 con 0x7f9ecc15b9c0 2024-05-10T04:23:16.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.883+0000 7f9ec3e00700 1 --2- 172.21.15.80:0/2520746174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ecc0b47e0 0x7f9ecc1f3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:16.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.884+0000 7f9eca800700 1 --2- 172.21.15.80:0/2520746174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc15b9c0 0x7f9ecc0cfa80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400cb50 tx=0x7f9ec400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:16.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.884+0000 7f9ec2000700 1 -- 172.21.15.80:0/2520746174 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4003c00 con 0x7f9ecc15b9c0 2024-05-10T04:23:16.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.884+0000 7f9ec2000700 1 -- 172.21.15.80:0/2520746174 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec4003d60 con 0x7f9ecc15b9c0 2024-05-10T04:23:16.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.884+0000 7f9ed0a00700 1 -- 172.21.15.80:0/2520746174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ecc1f8530 con 0x7f9ecc15b9c0 2024-05-10T04:23:16.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.884+0000 7f9ec2000700 1 -- 172.21.15.80:0/2520746174 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec400aac0 con 0x7f9ecc15b9c0 2024-05-10T04:23:16.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.884+0000 7f9ed0a00700 1 -- 172.21.15.80:0/2520746174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ecc1f7c00 con 0x7f9ecc15b9c0 2024-05-10T04:23:16.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.885+0000 7f9ed0a00700 1 -- 172.21.15.80:0/2520746174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ecc1f86c0 con 0x7f9ecc15b9c0 2024-05-10T04:23:16.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.886+0000 7f9ec2000700 1 -- 172.21.15.80:0/2520746174 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9ec400ac20 con 0x7f9ecc15b9c0 2024-05-10T04:23:16.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.887+0000 7f9ec2000700 1 --2- 172.21.15.80:0/2520746174 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9ea806ac90 0x7f9ea806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:16.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.887+0000 7f9ec2000700 1 -- 172.21.15.80:0/2520746174 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ec4089380 con 0x7f9ecc15b9c0 2024-05-10T04:23:16.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.887+0000 7f9ec9e00700 1 --2- 172.21.15.80:0/2520746174 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9ea806ac90 0x7f9ea806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:16.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.888+0000 7f9ec9e00700 1 --2- 172.21.15.80:0/2520746174 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9ea806ac90 0x7f9ea806d1a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc000c00 tx=0x7f9ebc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:16.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:16.892+0000 7f9ec2000700 1 -- 172.21.15.80:0/2520746174 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9ec4054550 con 0x7f9ecc15b9c0 2024-05-10T04:23:17.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.105+0000 7f9ed0a00700 1 -- 172.21.15.80:0/2520746174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9ecc074af0 con 0x7f9ecc15b9c0 2024-05-10T04:23:17.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.105+0000 7f9ec2000700 1 -- 172.21.15.80:0/2520746174 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ec4057b70 con 0x7f9ecc15b9c0 2024-05-10T04:23:17.106 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-10T04:23:17.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.108+0000 7f9ed0a00700 1 -- 172.21.15.80:0/2520746174 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9ea806ac90 msgr2=0x7f9ea806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:17.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.108+0000 7f9ed0a00700 1 --2- 172.21.15.80:0/2520746174 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9ea806ac90 0x7f9ea806d1a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc000c00 tx=0x7f9ebc008030 comp rx=0 tx=0).stop 2024-05-10T04:23:17.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.108+0000 7f9ed0a00700 1 -- 172.21.15.80:0/2520746174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc15b9c0 msgr2=0x7f9ecc0cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:17.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.108+0000 7f9ed0a00700 1 --2- 172.21.15.80:0/2520746174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc15b9c0 0x7f9ecc0cfa80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400cb50 tx=0x7f9ec400ce60 comp rx=0 tx=0).stop 2024-05-10T04:23:17.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.108+0000 7f9ed0a00700 1 -- 172.21.15.80:0/2520746174 shutdown_connections 2024-05-10T04:23:17.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.108+0000 7f9ed0a00700 1 --2- 172.21.15.80:0/2520746174 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9ea806ac90 0x7f9ea806d1a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:17.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.108+0000 7f9ed0a00700 1 --2- 172.21.15.80:0/2520746174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc15b9c0 0x7f9ecc0cfa80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:17.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.108+0000 7f9ed0a00700 1 --2- 172.21.15.80:0/2520746174 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ecc06e800 0x7f9ecc151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:17.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.108+0000 7f9ed0a00700 1 --2- 172.21.15.80:0/2520746174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ecc0b47e0 0x7f9ecc1f3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:17.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.108+0000 7f9ed0a00700 1 -- 172.21.15.80:0/2520746174 >> 172.21.15.80:0/2520746174 conn(0x7f9ecc0b1830 msgr2=0x7f9ecc15bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:17.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.108+0000 7f9ed0a00700 1 -- 172.21.15.80:0/2520746174 shutdown_connections 2024-05-10T04:23:17.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.108+0000 7f9ed0a00700 1 -- 172.21.15.80:0/2520746174 wait complete. 2024-05-10T04:23:17.136 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:23:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.399+0000 7efd89800700 1 Processor -- start 2024-05-10T04:23:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.399+0000 7efd89800700 1 -- start start 2024-05-10T04:23:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.400+0000 7efd89800700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efd84158c70 0x7efd8415ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.401+0000 7efd89800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8406c5f0 con 0x7efd840b5c90 2024-05-10T04:23:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.401+0000 7efd89800700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8406d190 con 0x7efd84162000 2024-05-10T04:23:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.401+0000 7efd89800700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd84162850 con 0x7efd84158c70 2024-05-10T04:23:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.401+0000 7efd83400700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efd840b5c90 0x7efd840b60a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34016/0 (socket says 172.21.15.80:34016) 2024-05-10T04:23:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.401+0000 7efd83400700 1 -- 172.21.15.80:0/1561116357 learned_addr learned my addr 172.21.15.80:0/1561116357 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.401+0000 7efd82a00700 1 --2- 172.21.15.80:0/1561116357 >> v2:172.21.15.106:3300/0 conn(0x7efd84158c70 0x7efd8415ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.401+0000 7efd82000700 1 -- 172.21.15.80:0/1561116357 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644353510 0 0) 0x7efd8406c5f0 con 0x7efd840b5c90 2024-05-10T04:23:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.401+0000 7efd82000700 1 -- 172.21.15.80:0/1561116357 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd680035b0 con 0x7efd840b5c90 2024-05-10T04:23:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.402+0000 7efd82a00700 1 -- 172.21.15.80:0/1561116357 >> v1:172.21.15.106:6789/0 conn(0x7efd84162000 legacy=0x7efd8406ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.402+0000 7efd82000700 1 -- 172.21.15.80:0/1561116357 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788869910 0 0) 0x7efd8406d190 con 0x7efd84162000 2024-05-10T04:23:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.402+0000 7efd82a00700 1 -- 172.21.15.80:0/1561116357 >> v1:172.21.15.80:6789/0 conn(0x7efd840b5c90 legacy=0x7efd840b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.402+0000 7efd82a00700 1 -- 172.21.15.80:0/1561116357 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84162b30 con 0x7efd84158c70 2024-05-10T04:23:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.402+0000 7efd82a00700 1 --2- 172.21.15.80:0/1561116357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd84158c70 0x7efd8415ea10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efd74009840 tx=0x7efd74009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9766f8b7750c3263 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.402+0000 7efd82000700 1 -- 172.21.15.80:0/1561116357 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74011830 con 0x7efd84158c70 2024-05-10T04:23:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.402+0000 7efd82000700 1 -- 172.21.15.80:0/1561116357 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd74011990 con 0x7efd84158c70 2024-05-10T04:23:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.402+0000 7efd82000700 1 -- 172.21.15.80:0/1561116357 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74011d20 con 0x7efd84158c70 2024-05-10T04:23:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.403+0000 7efd89800700 1 -- 172.21.15.80:0/1561116357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd84158c70 msgr2=0x7efd8415ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.403+0000 7efd89800700 1 --2- 172.21.15.80:0/1561116357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd84158c70 0x7efd8415ea10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efd74009840 tx=0x7efd74009b50 comp rx=0 tx=0).stop 2024-05-10T04:23:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.403+0000 7efd89800700 1 -- 172.21.15.80:0/1561116357 shutdown_connections 2024-05-10T04:23:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.403+0000 7efd89800700 1 --2- 172.21.15.80:0/1561116357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd84158c70 0x7efd8415ea10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.403+0000 7efd89800700 1 -- 172.21.15.80:0/1561116357 >> 172.21.15.80:0/1561116357 conn(0x7efd840d0d30 msgr2=0x7efd840d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.403+0000 7efd89800700 1 -- 172.21.15.80:0/1561116357 shutdown_connections 2024-05-10T04:23:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.403+0000 7efd89800700 1 -- 172.21.15.80:0/1561116357 wait complete. 2024-05-10T04:23:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.406+0000 7efd89800700 1 Processor -- start 2024-05-10T04:23:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.406+0000 7efd89800700 1 -- start start 2024-05-10T04:23:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.408+0000 7efd89800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd840b5c90 0x7efd84159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.408+0000 7efd89800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd84158c70 0x7efd8414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.408+0000 7efd89800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd84162000 0x7efd840c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.408+0000 7efd89800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd841f4930 con 0x7efd84158c70 2024-05-10T04:23:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.408+0000 7efd89800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd841595c0 con 0x7efd840b5c90 2024-05-10T04:23:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.408+0000 7efd89800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8415b7f0 con 0x7efd84162000 2024-05-10T04:23:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.408+0000 7efd7be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd84158c70 0x7efd8414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.408+0000 7efd7be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd84158c70 0x7efd8414e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53794/0 (socket says 172.21.15.80:53794) 2024-05-10T04:23:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.408+0000 7efd7be00700 1 -- 172.21.15.80:0/3157160344 learned_addr learned my addr 172.21.15.80:0/3157160344 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.408+0000 7efd82a00700 1 --2- 172.21.15.80:0/3157160344 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd840b5c90 0x7efd84159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.408+0000 7efd83400700 1 --2- 172.21.15.80:0/3157160344 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd84162000 0x7efd840c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.409+0000 7efd7be00700 1 -- 172.21.15.80:0/3157160344 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd84162000 msgr2=0x7efd840c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.409+0000 7efd7be00700 1 --2- 172.21.15.80:0/3157160344 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd84162000 0x7efd840c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.409+0000 7efd7be00700 1 -- 172.21.15.80:0/3157160344 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd840b5c90 msgr2=0x7efd84159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.409+0000 7efd7be00700 1 --2- 172.21.15.80:0/3157160344 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd840b5c90 0x7efd84159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.409+0000 7efd7be00700 1 -- 172.21.15.80:0/3157160344 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd740094a0 con 0x7efd84158c70 2024-05-10T04:23:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.409+0000 7efd7be00700 1 --2- 172.21.15.80:0/3157160344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd84158c70 0x7efd8414e0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00c550 tx=0x7efd6c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.409+0000 7efd7aa00700 1 -- 172.21.15.80:0/3157160344 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0054e0 con 0x7efd84158c70 2024-05-10T04:23:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.409+0000 7efd7aa00700 1 -- 172.21.15.80:0/3157160344 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c003680 con 0x7efd84158c70 2024-05-10T04:23:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.409+0000 7efd7aa00700 1 -- 172.21.15.80:0/3157160344 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c003a30 con 0x7efd84158c70 2024-05-10T04:23:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.409+0000 7efd89800700 1 -- 172.21.15.80:0/3157160344 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8415bad0 con 0x7efd84158c70 2024-05-10T04:23:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.409+0000 7efd89800700 1 -- 172.21.15.80:0/3157160344 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8415c090 con 0x7efd84158c70 2024-05-10T04:23:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.410+0000 7efd89800700 1 -- 172.21.15.80:0/3157160344 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd840732b0 con 0x7efd84158c70 2024-05-10T04:23:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.411+0000 7efd7aa00700 1 -- 172.21.15.80:0/3157160344 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efd6c003b90 con 0x7efd84158c70 2024-05-10T04:23:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.412+0000 7efd7aa00700 1 --2- 172.21.15.80:0/3157160344 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efd6006acc0 0x7efd6006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.412+0000 7efd7aa00700 1 -- 172.21.15.80:0/3157160344 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd6c0887f0 con 0x7efd84158c70 2024-05-10T04:23:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.413+0000 7efd82a00700 1 --2- 172.21.15.80:0/3157160344 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efd6006acc0 0x7efd6006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.413+0000 7efd82a00700 1 --2- 172.21.15.80:0/3157160344 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efd6006acc0 0x7efd6006d1d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efd74009840 tx=0x7efd7401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:17.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.417+0000 7efd7aa00700 1 -- 172.21.15.80:0/3157160344 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7efd6c053930 con 0x7efd84158c70 2024-05-10T04:23:17.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.631+0000 7efd89800700 1 -- 172.21.15.80:0/3157160344 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efd84074af0 con 0x7efd84158c70 2024-05-10T04:23:17.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.631+0000 7efd7aa00700 1 -- 172.21.15.80:0/3157160344 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7efd6c0170a0 con 0x7efd84158c70 2024-05-10T04:23:17.633 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-10T04:23:17.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.634+0000 7efd89800700 1 -- 172.21.15.80:0/3157160344 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efd6006acc0 msgr2=0x7efd6006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:17.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.634+0000 7efd89800700 1 --2- 172.21.15.80:0/3157160344 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efd6006acc0 0x7efd6006d1d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efd74009840 tx=0x7efd7401c040 comp rx=0 tx=0).stop 2024-05-10T04:23:17.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.634+0000 7efd89800700 1 -- 172.21.15.80:0/3157160344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd84158c70 msgr2=0x7efd8414e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:17.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.634+0000 7efd89800700 1 --2- 172.21.15.80:0/3157160344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd84158c70 0x7efd8414e0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00c550 tx=0x7efd6c00c910 comp rx=0 tx=0).stop 2024-05-10T04:23:17.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.634+0000 7efd89800700 1 -- 172.21.15.80:0/3157160344 shutdown_connections 2024-05-10T04:23:17.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.634+0000 7efd89800700 1 --2- 172.21.15.80:0/3157160344 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efd6006acc0 0x7efd6006d1d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:17.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.634+0000 7efd89800700 1 --2- 172.21.15.80:0/3157160344 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd84162000 0x7efd840c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:17.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.634+0000 7efd89800700 1 --2- 172.21.15.80:0/3157160344 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd840b5c90 0x7efd84159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:17.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.634+0000 7efd89800700 1 --2- 172.21.15.80:0/3157160344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd84158c70 0x7efd8414e0a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:17.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.634+0000 7efd89800700 1 -- 172.21.15.80:0/3157160344 >> 172.21.15.80:0/3157160344 conn(0x7efd840d0d30 msgr2=0x7efd840740c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:17.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.634+0000 7efd89800700 1 -- 172.21.15.80:0/3157160344 shutdown_connections 2024-05-10T04:23:17.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.634+0000 7efd89800700 1 -- 172.21.15.80:0/3157160344 wait complete. 2024-05-10T04:23:17.660 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:23:17.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.922+0000 7f8c56400700 1 Processor -- start 2024-05-10T04:23:17.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.922+0000 7f8c56400700 1 -- start start 2024-05-10T04:23:17.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.923+0000 7f8c56400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c500b5c90 0x7f8c500b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:17.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.924+0000 7f8c56400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c5006c5f0 con 0x7f8c5015ea10 2024-05-10T04:23:17.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.924+0000 7f8c56400700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c500b65e0 con 0x7f8c50158c70 2024-05-10T04:23:17.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.924+0000 7f8c56400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5015ee20 con 0x7f8c500b5c90 2024-05-10T04:23:17.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.924+0000 7f8c47e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8c5015ea10 0x7f8c5006ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34028/0 (socket says 172.21.15.80:34028) 2024-05-10T04:23:17.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.924+0000 7f8c47e00700 1 -- 172.21.15.80:0/653808496 learned_addr learned my addr 172.21.15.80:0/653808496 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:17.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.924+0000 7f8c4fe00700 1 --2- 172.21.15.80:0/653808496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c500b5c90 0x7f8c500b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:17.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.924+0000 7f8c4ea00700 1 -- 172.21.15.80:0/653808496 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145484840 0 0) 0x7f8c5006c5f0 con 0x7f8c5015ea10 2024-05-10T04:23:17.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.924+0000 7f8c4ea00700 1 -- 172.21.15.80:0/653808496 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c340035b0 con 0x7f8c5015ea10 2024-05-10T04:23:17.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c4ea00700 1 -- 172.21.15.80:0/653808496 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986375581 0 0) 0x7f8c500b65e0 con 0x7f8c50158c70 2024-05-10T04:23:17.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c4ea00700 1 -- 172.21.15.80:0/653808496 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c5006c5f0 con 0x7f8c50158c70 2024-05-10T04:23:17.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c4ea00700 1 -- 172.21.15.80:0/653808496 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2272685887 0 0) 0x7f8c340035b0 con 0x7f8c5015ea10 2024-05-10T04:23:17.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c4ea00700 1 -- 172.21.15.80:0/653808496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c500b5c90 msgr2=0x7f8c500b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:17.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c4ea00700 1 --2- 172.21.15.80:0/653808496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c500b5c90 0x7f8c500b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:17.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c4ea00700 1 -- 172.21.15.80:0/653808496 >> v1:172.21.15.106:6789/0 conn(0x7f8c50158c70 legacy=0x7f8c50162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:17.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c4ea00700 1 -- 172.21.15.80:0/653808496 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5006d190 con 0x7f8c5015ea10 2024-05-10T04:23:17.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c4ea00700 1 -- 172.21.15.80:0/653808496 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7f8c38001670 con 0x7f8c5015ea10 2024-05-10T04:23:17.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c4ea00700 1 -- 172.21.15.80:0/653808496 >> v1:172.21.15.80:6789/0 conn(0x7f8c5015ea10 legacy=0x7f8c5006ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:17.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c4ea00700 1 --2- 172.21.15.80:0/653808496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c34003bc0 0x7f8c34004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:17.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c4ea00700 1 --2- 172.21.15.80:0/653808496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c34004850 0x7f8c34004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:17.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c4ea00700 1 --2- 172.21.15.80:0/653808496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c500b5c90 0x7f8c34005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:17.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c4ea00700 1 -- 172.21.15.80:0/653808496 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5015ee20 con 0x7f8c34004850 2024-05-10T04:23:17.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c4ea00700 1 -- 172.21.15.80:0/653808496 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3400bba0 con 0x7f8c34003bc0 2024-05-10T04:23:17.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c4ea00700 1 -- 172.21.15.80:0/653808496 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3400bd30 con 0x7f8c500b5c90 2024-05-10T04:23:17.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c47e00700 1 --2- 172.21.15.80:0/653808496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c34004850 0x7f8c34004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:17.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c4f400700 1 --2- 172.21.15.80:0/653808496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c34003bc0 0x7f8c34004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:17.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.925+0000 7f8c4fe00700 1 --2- 172.21.15.80:0/653808496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c500b5c90 0x7f8c34005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:17.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.926+0000 7f8c47e00700 1 -- 172.21.15.80:0/653808496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c500b5c90 msgr2=0x7f8c34005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:17.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.926+0000 7f8c47e00700 1 --2- 172.21.15.80:0/653808496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c500b5c90 0x7f8c34005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:17.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.926+0000 7f8c47e00700 1 -- 172.21.15.80:0/653808496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c34003bc0 msgr2=0x7f8c34004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:17.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.926+0000 7f8c47e00700 1 --2- 172.21.15.80:0/653808496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c34003bc0 0x7f8c34004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:17.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.926+0000 7f8c47e00700 1 -- 172.21.15.80:0/653808496 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c340035b0 con 0x7f8c34004850 2024-05-10T04:23:17.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.926+0000 7f8c4f400700 1 --2- 172.21.15.80:0/653808496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c34003bc0 0x7f8c34004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:17.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.926+0000 7f8c4fe00700 1 --2- 172.21.15.80:0/653808496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c500b5c90 0x7f8c34005270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:17.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.926+0000 7f8c47e00700 1 --2- 172.21.15.80:0/653808496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c34004850 0x7f8c34004c60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800c140 tx=0x7f8c34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee130c9691207bb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:17.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.926+0000 7f8c4ea00700 1 -- 172.21.15.80:0/653808496 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800cca0 con 0x7f8c34004850 2024-05-10T04:23:17.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.926+0000 7f8c4ea00700 1 -- 172.21.15.80:0/653808496 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3800ce00 con 0x7f8c34004850 2024-05-10T04:23:17.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.926+0000 7f8c4ea00700 1 -- 172.21.15.80:0/653808496 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38005ba0 con 0x7f8c34004850 2024-05-10T04:23:17.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.927+0000 7f8c56400700 1 -- 172.21.15.80:0/653808496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c34004850 msgr2=0x7f8c34004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:17.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.927+0000 7f8c56400700 1 --2- 172.21.15.80:0/653808496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c34004850 0x7f8c34004c60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800c140 tx=0x7f8c34005880 comp rx=0 tx=0).stop 2024-05-10T04:23:17.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.927+0000 7f8c4fe00700 1 -- 172.21.15.80:0/653808496 reap_dead start 2024-05-10T04:23:17.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.927+0000 7f8c56400700 1 -- 172.21.15.80:0/653808496 shutdown_connections 2024-05-10T04:23:17.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.927+0000 7f8c56400700 1 -- 172.21.15.80:0/653808496 >> 172.21.15.80:0/653808496 conn(0x7f8c500d0d30 msgr2=0x7f8c500d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:17.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.927+0000 7f8c56400700 1 -- 172.21.15.80:0/653808496 shutdown_connections 2024-05-10T04:23:17.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.927+0000 7f8c56400700 1 -- 172.21.15.80:0/653808496 wait complete. 2024-05-10T04:23:17.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.929+0000 7f8c56400700 1 Processor -- start 2024-05-10T04:23:17.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.929+0000 7f8c56400700 1 -- start start 2024-05-10T04:23:17.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.931+0000 7f8c56400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c34004850 0x7f8c501f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:17.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.931+0000 7f8c56400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c5015c230 0x7f8c5015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:17.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.931+0000 7f8c56400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5015c640 0x7f8c5015d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:17.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.931+0000 7f8c56400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5015b600 con 0x7f8c5015c230 2024-05-10T04:23:17.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.931+0000 7f8c56400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5014caf0 con 0x7f8c34004850 2024-05-10T04:23:17.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.931+0000 7f8c56400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5015d840 con 0x7f8c5015c640 2024-05-10T04:23:17.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.931+0000 7f8c47e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c5015c230 0x7f8c5015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:17.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.931+0000 7f8c47e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c5015c230 0x7f8c5015cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53826/0 (socket says 172.21.15.80:53826) 2024-05-10T04:23:17.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.931+0000 7f8c47e00700 1 -- 172.21.15.80:0/3689112503 learned_addr learned my addr 172.21.15.80:0/3689112503 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:17.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.931+0000 7f8c4f400700 1 --2- 172.21.15.80:0/3689112503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c34004850 0x7f8c501f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:17.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.931+0000 7f8c4fe00700 1 --2- 172.21.15.80:0/3689112503 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5015c640 0x7f8c5015d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:17.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.931+0000 7f8c47e00700 1 -- 172.21.15.80:0/3689112503 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5015c640 msgr2=0x7f8c5015d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:17.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.931+0000 7f8c47e00700 1 --2- 172.21.15.80:0/3689112503 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5015c640 0x7f8c5015d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:17.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.931+0000 7f8c47e00700 1 -- 172.21.15.80:0/3689112503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c34004850 msgr2=0x7f8c501f46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:17.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.931+0000 7f8c47e00700 1 --2- 172.21.15.80:0/3689112503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c34004850 0x7f8c501f46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:17.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.932+0000 7f8c47e00700 1 -- 172.21.15.80:0/3689112503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5015d600 con 0x7f8c5015c230 2024-05-10T04:23:17.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.932+0000 7f8c47e00700 1 --2- 172.21.15.80:0/3689112503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c5015c230 0x7f8c5015cb80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800c730 tx=0x7f8c38001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:17.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.932+0000 7f8c47400700 1 -- 172.21.15.80:0/3689112503 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c380072d0 con 0x7f8c5015c230 2024-05-10T04:23:17.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.932+0000 7f8c47400700 1 -- 172.21.15.80:0/3689112503 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c38007450 con 0x7f8c5015c230 2024-05-10T04:23:17.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.932+0000 7f8c47400700 1 -- 172.21.15.80:0/3689112503 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38007800 con 0x7f8c5015c230 2024-05-10T04:23:17.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.932+0000 7f8c56400700 1 -- 172.21.15.80:0/3689112503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c5015e050 con 0x7f8c5015c230 2024-05-10T04:23:17.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.932+0000 7f8c56400700 1 -- 172.21.15.80:0/3689112503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5015da90 con 0x7f8c5015c230 2024-05-10T04:23:17.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.933+0000 7f8c56400700 1 -- 172.21.15.80:0/3689112503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c500732b0 con 0x7f8c5015c230 2024-05-10T04:23:17.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.934+0000 7f8c47400700 1 -- 172.21.15.80:0/3689112503 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8c38019030 con 0x7f8c5015c230 2024-05-10T04:23:17.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.935+0000 7f8c47400700 1 --2- 172.21.15.80:0/3689112503 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8c2c06ac90 0x7f8c2c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:17.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.935+0000 7f8c47400700 1 -- 172.21.15.80:0/3689112503 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c3808a1a0 con 0x7f8c5015c230 2024-05-10T04:23:17.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.936+0000 7f8c4f400700 1 --2- 172.21.15.80:0/3689112503 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8c2c06ac90 0x7f8c2c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:17.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.937+0000 7f8c4f400700 1 --2- 172.21.15.80:0/3689112503 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8c2c06ac90 0x7f8c2c06d1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8c40000f60 tx=0x7f8c40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:17.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:17.940+0000 7f8c47400700 1 -- 172.21.15.80:0/3689112503 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8c380554c0 con 0x7f8c5015c230 2024-05-10T04:23:18.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.145+0000 7f8c56400700 1 -- 172.21.15.80:0/3689112503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c500d4d90 con 0x7f8c5015c230 2024-05-10T04:23:18.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.146+0000 7f8c47400700 1 -- 172.21.15.80:0/3689112503 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c38058ae0 con 0x7f8c5015c230 2024-05-10T04:23:18.147 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-10T04:23:18.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.148+0000 7f8c56400700 1 -- 172.21.15.80:0/3689112503 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8c2c06ac90 msgr2=0x7f8c2c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:18.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.148+0000 7f8c56400700 1 --2- 172.21.15.80:0/3689112503 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8c2c06ac90 0x7f8c2c06d1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8c40000f60 tx=0x7f8c40009040 comp rx=0 tx=0).stop 2024-05-10T04:23:18.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.148+0000 7f8c56400700 1 -- 172.21.15.80:0/3689112503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c5015c230 msgr2=0x7f8c5015cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:18.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.148+0000 7f8c56400700 1 --2- 172.21.15.80:0/3689112503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c5015c230 0x7f8c5015cb80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800c730 tx=0x7f8c38001930 comp rx=0 tx=0).stop 2024-05-10T04:23:18.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.148+0000 7f8c56400700 1 -- 172.21.15.80:0/3689112503 shutdown_connections 2024-05-10T04:23:18.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.148+0000 7f8c56400700 1 --2- 172.21.15.80:0/3689112503 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8c2c06ac90 0x7f8c2c06d1a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.148+0000 7f8c56400700 1 --2- 172.21.15.80:0/3689112503 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5015c640 0x7f8c5015d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.148+0000 7f8c56400700 1 --2- 172.21.15.80:0/3689112503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c34004850 0x7f8c501f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.148+0000 7f8c56400700 1 --2- 172.21.15.80:0/3689112503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c5015c230 0x7f8c5015cb80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.148+0000 7f8c56400700 1 -- 172.21.15.80:0/3689112503 >> 172.21.15.80:0/3689112503 conn(0x7f8c500d0d30 msgr2=0x7f8c500d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:18.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.149+0000 7f8c56400700 1 -- 172.21.15.80:0/3689112503 shutdown_connections 2024-05-10T04:23:18.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.149+0000 7f8c56400700 1 -- 172.21.15.80:0/3689112503 wait complete. 2024-05-10T04:23:18.176 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:23:18.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.434+0000 7fb225600700 1 Processor -- start 2024-05-10T04:23:18.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.434+0000 7fb225600700 1 -- start start 2024-05-10T04:23:18.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.436+0000 7fb225600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb2200d3460 0x7fb2200b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:18.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.437+0000 7fb225600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb2200b58b0 0x7fb2200b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:18.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.437+0000 7fb225600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2201620e0 0x7fb2201624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:18.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.437+0000 7fb225600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2200b3720 con 0x7fb2200b58b0 2024-05-10T04:23:18.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.437+0000 7fb225600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2200d2730 con 0x7fb2200d3460 2024-05-10T04:23:18.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.437+0000 7fb225600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2200d2fd0 con 0x7fb2201620e0 2024-05-10T04:23:18.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.437+0000 7fb216000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb2200b58b0 0x7fb2200b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:18.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.437+0000 7fb216000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb2200b58b0 0x7fb2200b5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53840/0 (socket says 172.21.15.80:53840) 2024-05-10T04:23:18.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.437+0000 7fb216000700 1 -- 172.21.15.80:0/4056216107 learned_addr learned my addr 172.21.15.80:0/4056216107 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:18.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.437+0000 7fb21f400700 1 --2- 172.21.15.80:0/4056216107 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2201620e0 0x7fb2201624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:18.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.437+0000 7fb21ea00700 1 --2- 172.21.15.80:0/4056216107 >> v2:172.21.15.106:3300/0 conn(0x7fb2200d3460 0x7fb2200b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:18.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.437+0000 7fb216000700 1 -- 172.21.15.80:0/4056216107 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2201620e0 msgr2=0x7fb2201624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:18.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.437+0000 7fb216000700 1 --2- 172.21.15.80:0/4056216107 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2201620e0 0x7fb2201624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.437+0000 7fb216000700 1 -- 172.21.15.80:0/4056216107 >> v2:172.21.15.106:3300/0 conn(0x7fb2200d3460 msgr2=0x7fb2200b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:18.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.437+0000 7fb216000700 1 --2- 172.21.15.80:0/4056216107 >> v2:172.21.15.106:3300/0 conn(0x7fb2200d3460 0x7fb2200b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.437+0000 7fb216000700 1 -- 172.21.15.80:0/4056216107 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2200b6200 con 0x7fb2200b58b0 2024-05-10T04:23:18.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.437+0000 7fb21f400700 1 --2- 172.21.15.80:0/4056216107 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2201620e0 0x7fb2201624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:18.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.437+0000 7fb21ea00700 1 --2- 172.21.15.80:0/4056216107 >> v2:172.21.15.106:3300/0 conn(0x7fb2200d3460 0x7fb2200b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:18.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.438+0000 7fb216000700 1 --2- 172.21.15.80:0/4056216107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2200b58b0 0x7fb2200b5cc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb22008c940 tx=0x7fb208009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652a6570f02bd5ae server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:18.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.438+0000 7fb21e000700 1 -- 172.21.15.80:0/4056216107 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20800b870 con 0x7fb2200b58b0 2024-05-10T04:23:18.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.438+0000 7fb21e000700 1 -- 172.21.15.80:0/4056216107 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20800b9d0 con 0x7fb2200b58b0 2024-05-10T04:23:18.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.438+0000 7fb21e000700 1 -- 172.21.15.80:0/4056216107 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20800bd60 con 0x7fb2200b58b0 2024-05-10T04:23:18.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.439+0000 7fb225600700 1 -- 172.21.15.80:0/4056216107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2200b58b0 msgr2=0x7fb2200b5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:18.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.439+0000 7fb225600700 1 --2- 172.21.15.80:0/4056216107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2200b58b0 0x7fb2200b5cc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb22008c940 tx=0x7fb208009bd0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.439+0000 7fb225600700 1 -- 172.21.15.80:0/4056216107 shutdown_connections 2024-05-10T04:23:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.439+0000 7fb225600700 1 --2- 172.21.15.80:0/4056216107 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2201620e0 0x7fb2201624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.439+0000 7fb225600700 1 --2- 172.21.15.80:0/4056216107 >> v2:172.21.15.106:3300/0 conn(0x7fb2200d3460 0x7fb2200b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.439+0000 7fb225600700 1 --2- 172.21.15.80:0/4056216107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2200b58b0 0x7fb2200b5cc0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.439+0000 7fb225600700 1 -- 172.21.15.80:0/4056216107 >> 172.21.15.80:0/4056216107 conn(0x7fb2200d0a90 msgr2=0x7fb2200d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.439+0000 7fb225600700 1 -- 172.21.15.80:0/4056216107 shutdown_connections 2024-05-10T04:23:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.439+0000 7fb225600700 1 -- 172.21.15.80:0/4056216107 wait complete. 2024-05-10T04:23:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.442+0000 7fb225600700 1 Processor -- start 2024-05-10T04:23:18.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.442+0000 7fb225600700 1 -- start start 2024-05-10T04:23:18.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.444+0000 7fb225600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2200b58b0 0x7fb220161660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:18.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.444+0000 7fb225600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2200d3460 0x7fb2201f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:18.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.444+0000 7fb225600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2201620e0 0x7fb22014ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:18.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.444+0000 7fb225600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2200b2150 con 0x7fb2200b58b0 2024-05-10T04:23:18.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.444+0000 7fb225600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2201f8310 con 0x7fb2200d3460 2024-05-10T04:23:18.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.444+0000 7fb225600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2201f8560 con 0x7fb2201620e0 2024-05-10T04:23:18.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.444+0000 7fb21ea00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2200b58b0 0x7fb220161660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.444+0000 7fb21ea00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2200b58b0 0x7fb220161660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53850/0 (socket says 172.21.15.80:53850) 2024-05-10T04:23:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.444+0000 7fb21ea00700 1 -- 172.21.15.80:0/2385338572 learned_addr learned my addr 172.21.15.80:0/2385338572 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.444+0000 7fb216000700 1 --2- 172.21.15.80:0/2385338572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2200d3460 0x7fb2201f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.444+0000 7fb21f400700 1 --2- 172.21.15.80:0/2385338572 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2201620e0 0x7fb22014ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.444+0000 7fb21ea00700 1 -- 172.21.15.80:0/2385338572 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2201620e0 msgr2=0x7fb22014ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.444+0000 7fb21ea00700 1 --2- 172.21.15.80:0/2385338572 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2201620e0 0x7fb22014ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.444+0000 7fb21ea00700 1 -- 172.21.15.80:0/2385338572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2200d3460 msgr2=0x7fb2201f77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.444+0000 7fb21ea00700 1 --2- 172.21.15.80:0/2385338572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2200d3460 0x7fb2201f77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.444+0000 7fb21ea00700 1 -- 172.21.15.80:0/2385338572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb208009550 con 0x7fb2200b58b0 2024-05-10T04:23:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.444+0000 7fb216000700 1 --2- 172.21.15.80:0/2385338572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2200d3460 0x7fb2201f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.445+0000 7fb21ea00700 1 --2- 172.21.15.80:0/2385338572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2200b58b0 0x7fb220161660 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb21000d800 tx=0x7fb21000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.445+0000 7fb217400700 1 -- 172.21.15.80:0/2385338572 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210004030 con 0x7fb2200b58b0 2024-05-10T04:23:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.445+0000 7fb217400700 1 -- 172.21.15.80:0/2385338572 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb210004190 con 0x7fb2200b58b0 2024-05-10T04:23:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.445+0000 7fb225600700 1 -- 172.21.15.80:0/2385338572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22014d8f0 con 0x7fb2200b58b0 2024-05-10T04:23:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.445+0000 7fb217400700 1 -- 172.21.15.80:0/2385338572 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210004520 con 0x7fb2200b58b0 2024-05-10T04:23:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.445+0000 7fb225600700 1 -- 172.21.15.80:0/2385338572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22014deb0 con 0x7fb2200b58b0 2024-05-10T04:23:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.446+0000 7fb225600700 1 -- 172.21.15.80:0/2385338572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2200732b0 con 0x7fb2200b58b0 2024-05-10T04:23:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.447+0000 7fb217400700 1 -- 172.21.15.80:0/2385338572 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb2100036a0 con 0x7fb2200b58b0 2024-05-10T04:23:18.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.448+0000 7fb217400700 1 --2- 172.21.15.80:0/2385338572 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb1fc06ac90 0x7fb1fc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:18.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.448+0000 7fb217400700 1 -- 172.21.15.80:0/2385338572 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb210088c60 con 0x7fb2200b58b0 2024-05-10T04:23:18.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.448+0000 7fb216000700 1 --2- 172.21.15.80:0/2385338572 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb1fc06ac90 0x7fb1fc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:18.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.449+0000 7fb216000700 1 --2- 172.21.15.80:0/2385338572 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb1fc06ac90 0x7fb1fc06d1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb208014040 tx=0x7fb208008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:18.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.452+0000 7fb217400700 1 -- 172.21.15.80:0/2385338572 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb210053e50 con 0x7fb2200b58b0 2024-05-10T04:23:18.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.660+0000 7fb225600700 1 -- 172.21.15.80:0/2385338572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb220162a00 con 0x7fb2200b58b0 2024-05-10T04:23:18.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.661+0000 7fb217400700 1 -- 172.21.15.80:0/2385338572 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fb210019020 con 0x7fb2200b58b0 2024-05-10T04:23:18.663 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:18.663 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:22:38.485422+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:23:18.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.664+0000 7fb225600700 1 -- 172.21.15.80:0/2385338572 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb1fc06ac90 msgr2=0x7fb1fc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:18.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.664+0000 7fb225600700 1 --2- 172.21.15.80:0/2385338572 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb1fc06ac90 0x7fb1fc06d1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb208014040 tx=0x7fb208008030 comp rx=0 tx=0).stop 2024-05-10T04:23:18.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.664+0000 7fb225600700 1 -- 172.21.15.80:0/2385338572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2200b58b0 msgr2=0x7fb220161660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:18.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.664+0000 7fb225600700 1 --2- 172.21.15.80:0/2385338572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2200b58b0 0x7fb220161660 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb21000d800 tx=0x7fb21000dbc0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.664+0000 7fb225600700 1 -- 172.21.15.80:0/2385338572 shutdown_connections 2024-05-10T04:23:18.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.664+0000 7fb225600700 1 --2- 172.21.15.80:0/2385338572 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb1fc06ac90 0x7fb1fc06d1a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.664+0000 7fb225600700 1 --2- 172.21.15.80:0/2385338572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2200b58b0 0x7fb220161660 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.664+0000 7fb225600700 1 --2- 172.21.15.80:0/2385338572 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2201620e0 0x7fb22014ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.664+0000 7fb225600700 1 --2- 172.21.15.80:0/2385338572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2200d3460 0x7fb2201f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.664+0000 7fb225600700 1 -- 172.21.15.80:0/2385338572 >> 172.21.15.80:0/2385338572 conn(0x7fb2200d0a90 msgr2=0x7fb22015e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:18.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.664+0000 7fb225600700 1 -- 172.21.15.80:0/2385338572 shutdown_connections 2024-05-10T04:23:18.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.664+0000 7fb225600700 1 -- 172.21.15.80:0/2385338572 wait complete. 2024-05-10T04:23:18.690 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:22:26.793377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:22:35.751764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:22:36.465587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:23:18.690 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:23:18.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.951+0000 7f722f600700 1 Processor -- start 2024-05-10T04:23:18.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.951+0000 7f722f600700 1 -- start start 2024-05-10T04:23:18.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.953+0000 7f722f600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72280cf610 0x7f722815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:18.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.953+0000 7f722f600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f722806df90 0x7f722806e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:18.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.953+0000 7f722f600700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f722806db00 con 0x7f722815d9b0 2024-05-10T04:23:18.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.953+0000 7f722f600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f722815d160 con 0x7f722806df90 2024-05-10T04:23:18.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.953+0000 7f722f600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f722815d440 con 0x7f72280cf610 2024-05-10T04:23:18.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.953+0000 7f722d600700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f722815d9b0 0x7f7228071690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34034/0 (socket says 172.21.15.80:34034) 2024-05-10T04:23:18.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.953+0000 7f722d600700 1 -- 172.21.15.80:0/1540804389 learned_addr learned my addr 172.21.15.80:0/1540804389 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:18.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f7227e00700 1 --2- 172.21.15.80:0/1540804389 >> v2:172.21.15.106:3300/0 conn(0x7f722806df90 0x7f722806e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:18.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f722cc00700 1 --2- 172.21.15.80:0/1540804389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72280cf610 0x7f722815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:18.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f7227400700 1 -- 172.21.15.80:0/1540804389 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463872175 0 0) 0x7f722806db00 con 0x7f722815d9b0 2024-05-10T04:23:18.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f7227400700 1 -- 172.21.15.80:0/1540804389 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72100035b0 con 0x7f722815d9b0 2024-05-10T04:23:18.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f7227400700 1 -- 172.21.15.80:0/1540804389 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 15190204 0 0) 0x7f72100035b0 con 0x7f722815d9b0 2024-05-10T04:23:18.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f7227400700 1 -- 172.21.15.80:0/1540804389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72280cf610 msgr2=0x7f722815c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:18.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f7227400700 1 --2- 172.21.15.80:0/1540804389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72280cf610 0x7f722815c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f7227400700 1 -- 172.21.15.80:0/1540804389 >> v2:172.21.15.106:3300/0 conn(0x7f722806df90 msgr2=0x7f722806e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:18.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f7227400700 1 --2- 172.21.15.80:0/1540804389 >> v2:172.21.15.106:3300/0 conn(0x7f722806df90 0x7f722806e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f7227400700 1 -- 172.21.15.80:0/1540804389 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722815d720 con 0x7f722815d9b0 2024-05-10T04:23:18.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f7227400700 1 -- 172.21.15.80:0/1540804389 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7f72200019f0 con 0x7f722815d9b0 2024-05-10T04:23:18.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f7227400700 1 -- 172.21.15.80:0/1540804389 >> v1:172.21.15.80:6789/0 conn(0x7f722815d9b0 legacy=0x7f7228071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:18.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f7227400700 1 --2- 172.21.15.80:0/1540804389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7210003a00 0x7f7210003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:18.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f7227400700 1 --2- 172.21.15.80:0/1540804389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7210004850 0x7f7210004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:18.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f7227400700 1 --2- 172.21.15.80:0/1540804389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72280cf610 0x7f72100051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:18.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f7227400700 1 -- 172.21.15.80:0/1540804389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722815d160 con 0x7f7210004850 2024-05-10T04:23:18.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f7227400700 1 -- 172.21.15.80:0/1540804389 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722815d440 con 0x7f7210003a00 2024-05-10T04:23:18.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.954+0000 7f7227400700 1 -- 172.21.15.80:0/1540804389 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721000ba10 con 0x7f72280cf610 2024-05-10T04:23:18.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.955+0000 7f7227e00700 1 --2- 172.21.15.80:0/1540804389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7210004850 0x7f7210004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:18.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.955+0000 7f722cc00700 1 --2- 172.21.15.80:0/1540804389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7210003a00 0x7f7210003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:18.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.955+0000 7f722d600700 1 --2- 172.21.15.80:0/1540804389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72280cf610 0x7f72100051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:18.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.955+0000 7f7227e00700 1 -- 172.21.15.80:0/1540804389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72280cf610 msgr2=0x7f72100051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:18.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.955+0000 7f7227e00700 1 --2- 172.21.15.80:0/1540804389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72280cf610 0x7f72100051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.955+0000 7f7227e00700 1 -- 172.21.15.80:0/1540804389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7210003a00 msgr2=0x7f7210003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:18.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.955+0000 7f7227e00700 1 --2- 172.21.15.80:0/1540804389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7210003a00 0x7f7210003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.955+0000 7f7227e00700 1 -- 172.21.15.80:0/1540804389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72100035b0 con 0x7f7210004850 2024-05-10T04:23:18.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.955+0000 7f7227e00700 1 --2- 172.21.15.80:0/1540804389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7210004850 0x7f7210004c60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f72280b5090 tx=0x7f7210005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc463a8a1c453df9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:18.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.956+0000 7f7227400700 1 -- 172.21.15.80:0/1540804389 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400e690 con 0x7f7210004850 2024-05-10T04:23:18.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.956+0000 7f7227400700 1 -- 172.21.15.80:0/1540804389 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721400e7f0 con 0x7f7210004850 2024-05-10T04:23:18.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.956+0000 7f7227400700 1 -- 172.21.15.80:0/1540804389 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400eb80 con 0x7f7210004850 2024-05-10T04:23:18.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.956+0000 7f722f600700 1 -- 172.21.15.80:0/1540804389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7210004850 msgr2=0x7f7210004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:18.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.956+0000 7f722f600700 1 --2- 172.21.15.80:0/1540804389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7210004850 0x7f7210004c60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f72280b5090 tx=0x7f7210005880 comp rx=0 tx=0).stop 2024-05-10T04:23:18.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.956+0000 7f722d600700 1 -- 172.21.15.80:0/1540804389 reap_dead start 2024-05-10T04:23:18.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.956+0000 7f722f600700 1 -- 172.21.15.80:0/1540804389 shutdown_connections 2024-05-10T04:23:18.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.956+0000 7f722f600700 1 -- 172.21.15.80:0/1540804389 >> 172.21.15.80:0/1540804389 conn(0x7f72280b1830 msgr2=0x7f72280b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:18.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.956+0000 7f722f600700 1 -- 172.21.15.80:0/1540804389 shutdown_connections 2024-05-10T04:23:18.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.957+0000 7f722f600700 1 -- 172.21.15.80:0/1540804389 wait complete. 2024-05-10T04:23:18.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.959+0000 7f722f600700 1 Processor -- start 2024-05-10T04:23:18.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.960+0000 7f722f600700 1 -- start start 2024-05-10T04:23:18.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.961+0000 7f722f600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7210004850 0x7f722815f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:18.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.961+0000 7f722f600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f722815edd0 0x7f7228154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:18.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.961+0000 7f722f600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7228153910 0x7f7228153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:18.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.961+0000 7f722f600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722815e9b0 con 0x7f7228153910 2024-05-10T04:23:18.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.961+0000 7f722f600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7228154710 con 0x7f7210004850 2024-05-10T04:23:18.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.961+0000 7f722f600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7228156620 con 0x7f722815edd0 2024-05-10T04:23:18.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.962+0000 7f722d600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7228153910 0x7f7228153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:18.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.962+0000 7f722d600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7228153910 0x7f7228153d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53866/0 (socket says 172.21.15.80:53866) 2024-05-10T04:23:18.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.962+0000 7f722d600700 1 -- 172.21.15.80:0/598408499 learned_addr learned my addr 172.21.15.80:0/598408499 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:18.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.962+0000 7f722cc00700 1 --2- 172.21.15.80:0/598408499 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7210004850 0x7f722815f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:18.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.962+0000 7f7227e00700 1 --2- 172.21.15.80:0/598408499 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f722815edd0 0x7f7228154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:18.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.962+0000 7f722d600700 1 -- 172.21.15.80:0/598408499 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f722815edd0 msgr2=0x7f7228154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:18.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.962+0000 7f722d600700 1 --2- 172.21.15.80:0/598408499 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f722815edd0 0x7f7228154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.962+0000 7f722d600700 1 -- 172.21.15.80:0/598408499 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7210004850 msgr2=0x7f722815f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:18.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.962+0000 7f722d600700 1 --2- 172.21.15.80:0/598408499 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7210004850 0x7f722815f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:18.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.962+0000 7f722d600700 1 -- 172.21.15.80:0/598408499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72280cd500 con 0x7f7228153910 2024-05-10T04:23:18.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.962+0000 7f722d600700 1 --2- 172.21.15.80:0/598408499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7228153910 0x7f7228153d20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7228071620 tx=0x7f722000a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:18.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.963+0000 7f7224c00700 1 -- 172.21.15.80:0/598408499 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722000ad50 con 0x7f7228153910 2024-05-10T04:23:18.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.963+0000 7f7224c00700 1 -- 172.21.15.80:0/598408499 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72200133f0 con 0x7f7228153910 2024-05-10T04:23:18.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.963+0000 7f722f600700 1 -- 172.21.15.80:0/598408499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f722815ddc0 con 0x7f7228153910 2024-05-10T04:23:18.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.963+0000 7f7224c00700 1 -- 172.21.15.80:0/598408499 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72200137a0 con 0x7f7228153910 2024-05-10T04:23:18.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.963+0000 7f722f600700 1 -- 172.21.15.80:0/598408499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7228155280 con 0x7f7228153910 2024-05-10T04:23:18.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.964+0000 7f722f600700 1 -- 172.21.15.80:0/598408499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f722815eaf0 con 0x7f7228153910 2024-05-10T04:23:18.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.965+0000 7f7224c00700 1 -- 172.21.15.80:0/598408499 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7220013900 con 0x7f7228153910 2024-05-10T04:23:18.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.966+0000 7f7224c00700 1 --2- 172.21.15.80:0/598408499 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f720806ac90 0x7f720806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:18.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.966+0000 7f7224c00700 1 -- 172.21.15.80:0/598408499 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7220089b80 con 0x7f7228153910 2024-05-10T04:23:18.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.967+0000 7f722cc00700 1 --2- 172.21.15.80:0/598408499 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f720806ac90 0x7f720806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:18.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.968+0000 7f722cc00700 1 --2- 172.21.15.80:0/598408499 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f720806ac90 0x7f720806d1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7228145f70 tx=0x7f721c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:18.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:18.971+0000 7f7224c00700 1 -- 172.21.15.80:0/598408499 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f722815eaf0 con 0x7f7228153910 2024-05-10T04:23:19.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.178+0000 7f722f600700 1 -- 172.21.15.80:0/598408499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f722815eaf0 con 0x7f7228153910 2024-05-10T04:23:19.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.179+0000 7f7224c00700 1 -- 172.21.15.80:0/598408499 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f722815eaf0 con 0x7f7228153910 2024-05-10T04:23:19.180 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-10T04:23:19.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.181+0000 7f722f600700 1 -- 172.21.15.80:0/598408499 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f720806ac90 msgr2=0x7f720806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:19.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.181+0000 7f722f600700 1 --2- 172.21.15.80:0/598408499 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f720806ac90 0x7f720806d1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7228145f70 tx=0x7f721c009210 comp rx=0 tx=0).stop 2024-05-10T04:23:19.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.181+0000 7f722f600700 1 -- 172.21.15.80:0/598408499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7228153910 msgr2=0x7f7228153d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:19.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.181+0000 7f722f600700 1 --2- 172.21.15.80:0/598408499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7228153910 0x7f7228153d20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7228071620 tx=0x7f722000a640 comp rx=0 tx=0).stop 2024-05-10T04:23:19.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.181+0000 7f722f600700 1 -- 172.21.15.80:0/598408499 shutdown_connections 2024-05-10T04:23:19.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.181+0000 7f722f600700 1 --2- 172.21.15.80:0/598408499 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f720806ac90 0x7f720806d1a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.181+0000 7f722f600700 1 --2- 172.21.15.80:0/598408499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7228153910 0x7f7228153d20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.181+0000 7f722f600700 1 --2- 172.21.15.80:0/598408499 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7210004850 0x7f722815f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.181+0000 7f722f600700 1 --2- 172.21.15.80:0/598408499 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f722815edd0 0x7f7228154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.181+0000 7f722f600700 1 -- 172.21.15.80:0/598408499 >> 172.21.15.80:0/598408499 conn(0x7f72280b1830 msgr2=0x7f72280b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:19.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.182+0000 7f722f600700 1 -- 172.21.15.80:0/598408499 shutdown_connections 2024-05-10T04:23:19.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.182+0000 7f722f600700 1 -- 172.21.15.80:0/598408499 wait complete. 2024-05-10T04:23:19.210 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:23:19.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.473+0000 7f56ea200700 1 Processor -- start 2024-05-10T04:23:19.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.473+0000 7f56ea200700 1 -- start start 2024-05-10T04:23:19.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.475+0000 7f56ea200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f56e4162150 0x7f56e415e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:19.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.475+0000 7f56ea200700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f56e40cf4d0 0x7f56e40b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.475+0000 7f56ea200700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e40d2c00 con 0x7f56e40b7910 2024-05-10T04:23:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.475+0000 7f56ea200700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e4162630 con 0x7f56e4162150 2024-05-10T04:23:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.475+0000 7f56ea200700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e4162910 con 0x7f56e40cf4d0 2024-05-10T04:23:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.475+0000 7f56e3400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f56e4162150 0x7f56e415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.475+0000 7f56e3e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f56e40b7910 0x7f56e406c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34036/0 (socket says 172.21.15.80:34036) 2024-05-10T04:23:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.475+0000 7f56e3e00700 1 -- 172.21.15.80:0/4239368095 learned_addr learned my addr 172.21.15.80:0/4239368095 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.475+0000 7f56e2a00700 1 --2- 172.21.15.80:0/4239368095 >> v2:172.21.15.106:3300/0 conn(0x7f56e40cf4d0 0x7f56e40b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.475+0000 7f56e2000700 1 -- 172.21.15.80:0/4239368095 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441072936 0 0) 0x7f56e40d2c00 con 0x7f56e40b7910 2024-05-10T04:23:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.475+0000 7f56e2000700 1 -- 172.21.15.80:0/4239368095 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56c80035b0 con 0x7f56e40b7910 2024-05-10T04:23:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.476+0000 7f56e3400700 1 -- 172.21.15.80:0/4239368095 >> v2:172.21.15.106:3300/0 conn(0x7f56e40cf4d0 msgr2=0x7f56e40b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.476+0000 7f56e3400700 1 --2- 172.21.15.80:0/4239368095 >> v2:172.21.15.106:3300/0 conn(0x7f56e40cf4d0 0x7f56e40b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.476+0000 7f56e3400700 1 -- 172.21.15.80:0/4239368095 >> v1:172.21.15.80:6789/0 conn(0x7f56e40b7910 legacy=0x7f56e406c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.476+0000 7f56e3400700 1 -- 172.21.15.80:0/4239368095 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e4162bf0 con 0x7f56e4162150 2024-05-10T04:23:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.476+0000 7f56e3400700 1 --2- 172.21.15.80:0/4239368095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56e4162150 0x7f56e415e610 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009840 tx=0x7f56d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cdf2ebb6d6eca26 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.476+0000 7f56e2000700 1 -- 172.21.15.80:0/4239368095 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d4011830 con 0x7f56e4162150 2024-05-10T04:23:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.476+0000 7f56e2000700 1 -- 172.21.15.80:0/4239368095 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d4011990 con 0x7f56e4162150 2024-05-10T04:23:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.476+0000 7f56e2000700 1 -- 172.21.15.80:0/4239368095 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d4011d20 con 0x7f56e4162150 2024-05-10T04:23:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.477+0000 7f56ea200700 1 -- 172.21.15.80:0/4239368095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56e4162150 msgr2=0x7f56e415e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.477+0000 7f56ea200700 1 --2- 172.21.15.80:0/4239368095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56e4162150 0x7f56e415e610 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009840 tx=0x7f56d4009b50 comp rx=0 tx=0).stop 2024-05-10T04:23:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.477+0000 7f56ea200700 1 -- 172.21.15.80:0/4239368095 shutdown_connections 2024-05-10T04:23:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.477+0000 7f56ea200700 1 --2- 172.21.15.80:0/4239368095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56e4162150 0x7f56e415e610 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.477+0000 7f56ea200700 1 --2- 172.21.15.80:0/4239368095 >> v2:172.21.15.106:3300/0 conn(0x7f56e40cf4d0 0x7f56e40b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.477+0000 7f56ea200700 1 -- 172.21.15.80:0/4239368095 >> 172.21.15.80:0/4239368095 conn(0x7f56e40d3e10 msgr2=0x7f56e40d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.477+0000 7f56ea200700 1 -- 172.21.15.80:0/4239368095 shutdown_connections 2024-05-10T04:23:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.477+0000 7f56ea200700 1 -- 172.21.15.80:0/4239368095 wait complete. 2024-05-10T04:23:19.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.479+0000 7f56ea200700 1 Processor -- start 2024-05-10T04:23:19.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.479+0000 7f56ea200700 1 -- start start 2024-05-10T04:23:19.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.481+0000 7f56ea200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e40b7910 0x7f56e41524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:19.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.481+0000 7f56ea200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56e40cf4d0 0x7f56e4153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:19.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.481+0000 7f56ea200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56e4162150 0x7f56e41536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:19.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.481+0000 7f56ea200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e41544b0 con 0x7f56e4162150 2024-05-10T04:23:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.481+0000 7f56ea200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e415f620 con 0x7f56e40cf4d0 2024-05-10T04:23:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.481+0000 7f56ea200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e415f860 con 0x7f56e40b7910 2024-05-10T04:23:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.481+0000 7f56e3e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56e4162150 0x7f56e41536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.481+0000 7f56e3e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56e4162150 0x7f56e41536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53884/0 (socket says 172.21.15.80:53884) 2024-05-10T04:23:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.481+0000 7f56e3e00700 1 -- 172.21.15.80:0/2226042844 learned_addr learned my addr 172.21.15.80:0/2226042844 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.481+0000 7f56e3400700 1 --2- 172.21.15.80:0/2226042844 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e40b7910 0x7f56e41524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.481+0000 7f56e2a00700 1 --2- 172.21.15.80:0/2226042844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56e40cf4d0 0x7f56e4153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.482+0000 7f56e3e00700 1 -- 172.21.15.80:0/2226042844 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e40b7910 msgr2=0x7f56e41524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.482+0000 7f56e3e00700 1 --2- 172.21.15.80:0/2226042844 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e40b7910 0x7f56e41524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.482+0000 7f56e3e00700 1 -- 172.21.15.80:0/2226042844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56e40cf4d0 msgr2=0x7f56e4153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.482+0000 7f56e3e00700 1 --2- 172.21.15.80:0/2226042844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56e40cf4d0 0x7f56e4153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.482+0000 7f56e3e00700 1 -- 172.21.15.80:0/2226042844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d40094a0 con 0x7f56e4162150 2024-05-10T04:23:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.482+0000 7f56e3400700 1 --2- 172.21.15.80:0/2226042844 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e40b7910 0x7f56e41524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.482+0000 7f56e3e00700 1 --2- 172.21.15.80:0/2226042844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56e4162150 0x7f56e41536b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00caa0 tx=0x7f56dc00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.482+0000 7f56db400700 1 -- 172.21.15.80:0/2226042844 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc00aa80 con 0x7f56e4162150 2024-05-10T04:23:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.482+0000 7f56db400700 1 -- 172.21.15.80:0/2226042844 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56dc00abe0 con 0x7f56e4162150 2024-05-10T04:23:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.482+0000 7f56ea200700 1 -- 172.21.15.80:0/2226042844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e4160630 con 0x7f56e4162150 2024-05-10T04:23:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.482+0000 7f56db400700 1 -- 172.21.15.80:0/2226042844 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc012400 con 0x7f56e4162150 2024-05-10T04:23:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.482+0000 7f56ea200700 1 -- 172.21.15.80:0/2226042844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e415fd90 con 0x7f56e4162150 2024-05-10T04:23:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.483+0000 7f56ea200700 1 -- 172.21.15.80:0/2226042844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e4068880 con 0x7f56e4162150 2024-05-10T04:23:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.484+0000 7f56db400700 1 -- 172.21.15.80:0/2226042844 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f56dc0113a0 con 0x7f56e4162150 2024-05-10T04:23:19.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.485+0000 7f56db400700 1 --2- 172.21.15.80:0/2226042844 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f56c406ac90 0x7f56c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:19.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.485+0000 7f56db400700 1 -- 172.21.15.80:0/2226042844 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f56dc0890e0 con 0x7f56e4162150 2024-05-10T04:23:19.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.486+0000 7f56e3400700 1 --2- 172.21.15.80:0/2226042844 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f56c406ac90 0x7f56c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.486+0000 7f56e3400700 1 --2- 172.21.15.80:0/2226042844 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f56c406ac90 0x7f56c406d1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009840 tx=0x7f56d4010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.490+0000 7f56db400700 1 -- 172.21.15.80:0/2226042844 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f56dc054230 con 0x7f56e4162150 2024-05-10T04:23:19.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.695+0000 7f56ea200700 1 -- 172.21.15.80:0/2226042844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56e40b2b70 con 0x7f56e4162150 2024-05-10T04:23:19.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.695+0000 7f56db400700 1 -- 172.21.15.80:0/2226042844 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56dc057850 con 0x7f56e4162150 2024-05-10T04:23:19.697 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-10T04:23:19.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.697+0000 7f56ea200700 1 -- 172.21.15.80:0/2226042844 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f56c406ac90 msgr2=0x7f56c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:19.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.697+0000 7f56ea200700 1 --2- 172.21.15.80:0/2226042844 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f56c406ac90 0x7f56c406d1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009840 tx=0x7f56d4010000 comp rx=0 tx=0).stop 2024-05-10T04:23:19.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.697+0000 7f56ea200700 1 -- 172.21.15.80:0/2226042844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56e4162150 msgr2=0x7f56e41536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:19.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.697+0000 7f56ea200700 1 --2- 172.21.15.80:0/2226042844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56e4162150 0x7f56e41536b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00caa0 tx=0x7f56dc00ce60 comp rx=0 tx=0).stop 2024-05-10T04:23:19.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.697+0000 7f56ea200700 1 -- 172.21.15.80:0/2226042844 shutdown_connections 2024-05-10T04:23:19.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.697+0000 7f56ea200700 1 --2- 172.21.15.80:0/2226042844 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f56c406ac90 0x7f56c406d1a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.697+0000 7f56ea200700 1 --2- 172.21.15.80:0/2226042844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56e4162150 0x7f56e41536b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.697+0000 7f56ea200700 1 --2- 172.21.15.80:0/2226042844 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e40b7910 0x7f56e41524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.697+0000 7f56ea200700 1 --2- 172.21.15.80:0/2226042844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56e40cf4d0 0x7f56e4153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.698+0000 7f56ea200700 1 -- 172.21.15.80:0/2226042844 >> 172.21.15.80:0/2226042844 conn(0x7f56e40d3e10 msgr2=0x7f56e406c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:19.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.698+0000 7f56ea200700 1 -- 172.21.15.80:0/2226042844 shutdown_connections 2024-05-10T04:23:19.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.698+0000 7f56ea200700 1 -- 172.21.15.80:0/2226042844 wait complete. 2024-05-10T04:23:19.724 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:23:19.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.985+0000 7f985fa00700 1 Processor -- start 2024-05-10T04:23:19.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.985+0000 7f985fa00700 1 -- start start 2024-05-10T04:23:19.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.987+0000 7f985fa00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9858162150 0x7f985815e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:19.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.987+0000 7f985fa00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f985806c160 0x7f985806c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:19.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.987+0000 7f985fa00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98580d2c00 con 0x7f98580cf4d0 2024-05-10T04:23:19.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.987+0000 7f985fa00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985806cab0 con 0x7f985806c160 2024-05-10T04:23:19.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.987+0000 7f985fa00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9858162630 con 0x7f9858162150 2024-05-10T04:23:19.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.987+0000 7f985da00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f985806c160 0x7f985806c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:19.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.988+0000 7f9857e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f98580cf4d0 0x7f98580b73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34042/0 (socket says 172.21.15.80:34042) 2024-05-10T04:23:19.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.988+0000 7f9857e00700 1 -- 172.21.15.80:0/2772138949 learned_addr learned my addr 172.21.15.80:0/2772138949 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:19.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.988+0000 7f985d000700 1 --2- 172.21.15.80:0/2772138949 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9858162150 0x7f985815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:19.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.988+0000 7f985da00700 1 -- 172.21.15.80:0/2772138949 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9858162150 msgr2=0x7f985815e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:19.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.988+0000 7f985da00700 1 --2- 172.21.15.80:0/2772138949 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9858162150 0x7f985815e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.988+0000 7f985da00700 1 -- 172.21.15.80:0/2772138949 >> v1:172.21.15.80:6789/0 conn(0x7f98580cf4d0 legacy=0x7f98580b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:19.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.988+0000 7f985da00700 1 -- 172.21.15.80:0/2772138949 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9858162910 con 0x7f985806c160 2024-05-10T04:23:19.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.988+0000 7f9857400700 1 -- 172.21.15.80:0/2772138949 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455033272 0 0) 0x7f98580d2c00 con 0x7f98580cf4d0 2024-05-10T04:23:19.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.988+0000 7f985da00700 1 --2- 172.21.15.80:0/2772138949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f985806c160 0x7f985806c570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9850009d90 tx=0x7f985000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45782f969555564 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:19.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.988+0000 7f9857400700 1 -- 172.21.15.80:0/2772138949 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985000e070 con 0x7f985806c160 2024-05-10T04:23:19.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.989+0000 7f9857400700 1 -- 172.21.15.80:0/2772138949 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985000bb20 con 0x7f985806c160 2024-05-10T04:23:19.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.989+0000 7f9857400700 1 -- 172.21.15.80:0/2772138949 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850012430 con 0x7f985806c160 2024-05-10T04:23:19.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.989+0000 7f985fa00700 1 -- 172.21.15.80:0/2772138949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f985806c160 msgr2=0x7f985806c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:19.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.989+0000 7f985fa00700 1 --2- 172.21.15.80:0/2772138949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f985806c160 0x7f985806c570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9850009d90 tx=0x7f985000b330 comp rx=0 tx=0).stop 2024-05-10T04:23:19.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.989+0000 7f985fa00700 1 -- 172.21.15.80:0/2772138949 shutdown_connections 2024-05-10T04:23:19.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.989+0000 7f985fa00700 1 --2- 172.21.15.80:0/2772138949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f985806c160 0x7f985806c570 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.989+0000 7f985fa00700 1 --2- 172.21.15.80:0/2772138949 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9858162150 0x7f985815e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.989+0000 7f985fa00700 1 -- 172.21.15.80:0/2772138949 >> 172.21.15.80:0/2772138949 conn(0x7f98580d3e10 msgr2=0x7f98580d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:19.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.989+0000 7f985fa00700 1 -- 172.21.15.80:0/2772138949 shutdown_connections 2024-05-10T04:23:19.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.989+0000 7f985fa00700 1 -- 172.21.15.80:0/2772138949 wait complete. 2024-05-10T04:23:19.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.992+0000 7f985fa00700 1 Processor -- start 2024-05-10T04:23:19.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.992+0000 7f985fa00700 1 -- start start 2024-05-10T04:23:19.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.993+0000 7f985fa00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f985806c160 0x7f98580c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:19.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.993+0000 7f985fa00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98580cf4d0 0x7f985815a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:19.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.993+0000 7f985fa00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9858162150 0x7f985815bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:19.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.993+0000 7f985fa00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9858145d40 con 0x7f98580cf4d0 2024-05-10T04:23:19.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.993+0000 7f985fa00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985815b1d0 con 0x7f9858162150 2024-05-10T04:23:19.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.993+0000 7f985fa00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9858154830 con 0x7f985806c160 2024-05-10T04:23:19.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.993+0000 7f9857e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98580cf4d0 0x7f985815a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:19.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.994+0000 7f9857e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98580cf4d0 0x7f985815a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53910/0 (socket says 172.21.15.80:53910) 2024-05-10T04:23:19.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.994+0000 7f9857e00700 1 -- 172.21.15.80:0/2469759258 learned_addr learned my addr 172.21.15.80:0/2469759258 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:19.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.994+0000 7f985d000700 1 --2- 172.21.15.80:0/2469759258 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f985806c160 0x7f98580c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:19.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.994+0000 7f985da00700 1 --2- 172.21.15.80:0/2469759258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9858162150 0x7f985815bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:19.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.994+0000 7f9857e00700 1 -- 172.21.15.80:0/2469759258 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f985806c160 msgr2=0x7f98580c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:19.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.994+0000 7f9857e00700 1 --2- 172.21.15.80:0/2469759258 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f985806c160 0x7f98580c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.994+0000 7f9857e00700 1 -- 172.21.15.80:0/2469759258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9858162150 msgr2=0x7f985815bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:19.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.994+0000 7f9857e00700 1 --2- 172.21.15.80:0/2469759258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9858162150 0x7f985815bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:19.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.994+0000 7f9857e00700 1 -- 172.21.15.80:0/2469759258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9850009a70 con 0x7f98580cf4d0 2024-05-10T04:23:19.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.994+0000 7f985da00700 1 --2- 172.21.15.80:0/2469759258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9858162150 0x7f985815bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:19.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.994+0000 7f9857e00700 1 --2- 172.21.15.80:0/2469759258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98580cf4d0 0x7f985815a6b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f984400c550 tx=0x7f984400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:19.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.994+0000 7f9854c00700 1 -- 172.21.15.80:0/2469759258 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9844004c80 con 0x7f98580cf4d0 2024-05-10T04:23:19.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.995+0000 7f9854c00700 1 -- 172.21.15.80:0/2469759258 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9844004e00 con 0x7f98580cf4d0 2024-05-10T04:23:19.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.995+0000 7f985fa00700 1 -- 172.21.15.80:0/2469759258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98580c6d30 con 0x7f98580cf4d0 2024-05-10T04:23:19.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.995+0000 7f9854c00700 1 -- 172.21.15.80:0/2469759258 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9844007310 con 0x7f98580cf4d0 2024-05-10T04:23:19.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.995+0000 7f985fa00700 1 -- 172.21.15.80:0/2469759258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985815b700 con 0x7f98580cf4d0 2024-05-10T04:23:19.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.996+0000 7f985fa00700 1 -- 172.21.15.80:0/2469759258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98580c6ec0 con 0x7f98580cf4d0 2024-05-10T04:23:19.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.997+0000 7f9854c00700 1 -- 172.21.15.80:0/2469759258 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9844007470 con 0x7f98580cf4d0 2024-05-10T04:23:19.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.997+0000 7f9854c00700 1 --2- 172.21.15.80:0/2469759258 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f983806ac90 0x7f983806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:19.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.998+0000 7f9854c00700 1 -- 172.21.15.80:0/2469759258 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9844089130 con 0x7f98580cf4d0 2024-05-10T04:23:19.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.998+0000 7f985d000700 1 --2- 172.21.15.80:0/2469759258 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f983806ac90 0x7f983806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:19.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:19.999+0000 7f985d000700 1 --2- 172.21.15.80:0/2469759258 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f983806ac90 0x7f983806d1a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f98580d1920 tx=0x7f984c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:20.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.002+0000 7f9854c00700 1 -- 172.21.15.80:0/2469759258 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f98580c6ec0 con 0x7f98580cf4d0 2024-05-10T04:23:20.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.214+0000 7f985fa00700 1 -- 172.21.15.80:0/2469759258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f98580c6ec0 con 0x7f98580cf4d0 2024-05-10T04:23:20.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.214+0000 7f9854c00700 1 -- 172.21.15.80:0/2469759258 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f98580c6ec0 con 0x7f98580cf4d0 2024-05-10T04:23:20.216 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-10T04:23:20.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.217+0000 7f985fa00700 1 -- 172.21.15.80:0/2469759258 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f983806ac90 msgr2=0x7f983806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:20.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.217+0000 7f985fa00700 1 --2- 172.21.15.80:0/2469759258 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f983806ac90 0x7f983806d1a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f98580d1920 tx=0x7f984c008040 comp rx=0 tx=0).stop 2024-05-10T04:23:20.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.217+0000 7f985fa00700 1 -- 172.21.15.80:0/2469759258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98580cf4d0 msgr2=0x7f985815a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:20.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.217+0000 7f985fa00700 1 --2- 172.21.15.80:0/2469759258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98580cf4d0 0x7f985815a6b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f984400c550 tx=0x7f984400c910 comp rx=0 tx=0).stop 2024-05-10T04:23:20.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.217+0000 7f985fa00700 1 -- 172.21.15.80:0/2469759258 shutdown_connections 2024-05-10T04:23:20.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.217+0000 7f985fa00700 1 --2- 172.21.15.80:0/2469759258 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f983806ac90 0x7f983806d1a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:20.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.217+0000 7f985fa00700 1 --2- 172.21.15.80:0/2469759258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9858162150 0x7f985815bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:20.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.217+0000 7f985fa00700 1 --2- 172.21.15.80:0/2469759258 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f985806c160 0x7f98580c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:20.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.217+0000 7f985fa00700 1 --2- 172.21.15.80:0/2469759258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98580cf4d0 0x7f985815a6b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:20.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.217+0000 7f985fa00700 1 -- 172.21.15.80:0/2469759258 >> 172.21.15.80:0/2469759258 conn(0x7f98580d3e10 msgr2=0x7f98580b5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:20.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.217+0000 7f985fa00700 1 -- 172.21.15.80:0/2469759258 shutdown_connections 2024-05-10T04:23:20.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.217+0000 7f985fa00700 1 -- 172.21.15.80:0/2469759258 wait complete. 2024-05-10T04:23:20.328 INFO:tasks.cephfs_test_runner:Starting test: test_acls (tasks.cephfs.test_acls.TestACLs) 2024-05-10T04:23:20.329 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:23:20.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.590+0000 7fa29d400700 1 Processor -- start 2024-05-10T04:23:20.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.591+0000 7fa29d400700 1 -- start start 2024-05-10T04:23:20.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.592+0000 7fa29d400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa2980cf360 0x7fa2980b9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:20.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.592+0000 7fa29d400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa2980b7120 0x7fa2980b7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:20.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.592+0000 7fa29d400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2980d2850 con 0x7fa298161d10 2024-05-10T04:23:20.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.592+0000 7fa29d400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2980d25b0 con 0x7fa2980cf360 2024-05-10T04:23:20.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.592+0000 7fa29d400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2980b7a70 con 0x7fa2980b7120 2024-05-10T04:23:20.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.593+0000 7fa297e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa2980cf360 0x7fa2980b9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:20.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.593+0000 7fa28fe00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa298161d10 0x7fa2980d2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34046/0 (socket says 172.21.15.80:34046) 2024-05-10T04:23:20.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.593+0000 7fa28fe00700 1 -- 172.21.15.80:0/2643228001 learned_addr learned my addr 172.21.15.80:0/2643228001 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:20.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.593+0000 7fa297e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa2980cf360 0x7fa2980b9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53918/0 (socket says 172.21.15.80:53918) 2024-05-10T04:23:20.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.593+0000 7fa29ca00700 1 --2- 172.21.15.80:0/2643228001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa2980b7120 0x7fa2980b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:20.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.593+0000 7fa297e00700 1 -- 172.21.15.80:0/2643228001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa2980b7120 msgr2=0x7fa2980b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:20.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.593+0000 7fa297e00700 1 --2- 172.21.15.80:0/2643228001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa2980b7120 0x7fa2980b7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:20.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.593+0000 7fa297e00700 1 -- 172.21.15.80:0/2643228001 >> v1:172.21.15.80:6789/0 conn(0x7fa298161d10 legacy=0x7fa2980d2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:20.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.593+0000 7fa297e00700 1 -- 172.21.15.80:0/2643228001 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2980cf770 con 0x7fa2980cf360 2024-05-10T04:23:20.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.593+0000 7fa29ca00700 1 --2- 172.21.15.80:0/2643228001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa2980b7120 0x7fa2980b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:20.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.593+0000 7fa297400700 1 -- 172.21.15.80:0/2643228001 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032579200 0 0) 0x7fa2980d2850 con 0x7fa298161d10 2024-05-10T04:23:20.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.593+0000 7fa297e00700 1 --2- 172.21.15.80:0/2643228001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2980cf360 0x7fa2980b9420 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa288009840 tx=0x7fa288009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd532f4e4b5e116 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:20.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.594+0000 7fa297400700 1 -- 172.21.15.80:0/2643228001 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288011830 con 0x7fa2980cf360 2024-05-10T04:23:20.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.594+0000 7fa297400700 1 -- 172.21.15.80:0/2643228001 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa288011990 con 0x7fa2980cf360 2024-05-10T04:23:20.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.594+0000 7fa297400700 1 -- 172.21.15.80:0/2643228001 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288011d20 con 0x7fa2980cf360 2024-05-10T04:23:20.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.594+0000 7fa29d400700 1 -- 172.21.15.80:0/2643228001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2980cf360 msgr2=0x7fa2980b9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:20.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.594+0000 7fa29d400700 1 --2- 172.21.15.80:0/2643228001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2980cf360 0x7fa2980b9420 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa288009840 tx=0x7fa288009b50 comp rx=0 tx=0).stop 2024-05-10T04:23:20.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.594+0000 7fa29d400700 1 -- 172.21.15.80:0/2643228001 shutdown_connections 2024-05-10T04:23:20.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.594+0000 7fa29d400700 1 --2- 172.21.15.80:0/2643228001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa2980b7120 0x7fa2980b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:20.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.594+0000 7fa29d400700 1 --2- 172.21.15.80:0/2643228001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2980cf360 0x7fa2980b9420 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:20.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.594+0000 7fa29d400700 1 -- 172.21.15.80:0/2643228001 >> 172.21.15.80:0/2643228001 conn(0x7fa29806c4e0 msgr2=0x7fa29806c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:20.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.595+0000 7fa29d400700 1 -- 172.21.15.80:0/2643228001 shutdown_connections 2024-05-10T04:23:20.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.595+0000 7fa29d400700 1 -- 172.21.15.80:0/2643228001 wait complete. 2024-05-10T04:23:20.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.597+0000 7fa29d400700 1 Processor -- start 2024-05-10T04:23:20.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.597+0000 7fa29d400700 1 -- start start 2024-05-10T04:23:20.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.598+0000 7fa29d400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2980b7120 0x7fa29814c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:20.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.598+0000 7fa29d400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa2980cf360 0x7fa2981589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:20.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.598+0000 7fa29d400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa298161d10 0x7fa298158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:20.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.598+0000 7fa29d400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2980cda60 con 0x7fa298161d10 2024-05-10T04:23:20.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.598+0000 7fa29d400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29815c170 con 0x7fa2980b7120 2024-05-10T04:23:20.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.598+0000 7fa29d400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2980cb510 con 0x7fa2980cf360 2024-05-10T04:23:20.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.599+0000 7fa29ca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa298161d10 0x7fa298158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:20.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.599+0000 7fa29ca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa298161d10 0x7fa298158f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53920/0 (socket says 172.21.15.80:53920) 2024-05-10T04:23:20.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.599+0000 7fa29ca00700 1 -- 172.21.15.80:0/2809160557 learned_addr learned my addr 172.21.15.80:0/2809160557 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:20.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.599+0000 7fa29ca00700 1 -- 172.21.15.80:0/2809160557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa2980cf360 msgr2=0x7fa2981589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:20.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.599+0000 7fa29ca00700 1 --2- 172.21.15.80:0/2809160557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa2980cf360 0x7fa2981589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:20.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.599+0000 7fa29ca00700 1 -- 172.21.15.80:0/2809160557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2980b7120 msgr2=0x7fa29814c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:20.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.599+0000 7fa29ca00700 1 --2- 172.21.15.80:0/2809160557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2980b7120 0x7fa29814c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:20.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.599+0000 7fa29ca00700 1 -- 172.21.15.80:0/2809160557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2880094a0 con 0x7fa298161d10 2024-05-10T04:23:20.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.599+0000 7fa29ca00700 1 --2- 172.21.15.80:0/2809160557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa298161d10 0x7fa298158f30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa290007dc0 tx=0x7fa29000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:20.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.599+0000 7fa294c00700 1 -- 172.21.15.80:0/2809160557 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29000ddd0 con 0x7fa298161d10 2024-05-10T04:23:20.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.599+0000 7fa294c00700 1 -- 172.21.15.80:0/2809160557 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29000f040 con 0x7fa298161d10 2024-05-10T04:23:20.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.599+0000 7fa294c00700 1 -- 172.21.15.80:0/2809160557 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290003c60 con 0x7fa298161d10 2024-05-10T04:23:20.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.599+0000 7fa29d400700 1 -- 172.21.15.80:0/2809160557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29814c550 con 0x7fa298161d10 2024-05-10T04:23:20.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.600+0000 7fa29d400700 1 -- 172.21.15.80:0/2809160557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2980cba70 con 0x7fa298161d10 2024-05-10T04:23:20.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.601+0000 7fa29d400700 1 -- 172.21.15.80:0/2809160557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa298074af0 con 0x7fa298161d10 2024-05-10T04:23:20.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.602+0000 7fa294c00700 1 -- 172.21.15.80:0/2809160557 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa290004030 con 0x7fa298161d10 2024-05-10T04:23:20.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.603+0000 7fa294c00700 1 --2- 172.21.15.80:0/2809160557 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa27406ac90 0x7fa27406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:20.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.603+0000 7fa294c00700 1 -- 172.21.15.80:0/2809160557 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa2900895d0 con 0x7fa298161d10 2024-05-10T04:23:20.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.604+0000 7fa297e00700 1 --2- 172.21.15.80:0/2809160557 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa27406ac90 0x7fa27406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:20.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.604+0000 7fa297e00700 1 --2- 172.21.15.80:0/2809160557 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa27406ac90 0x7fa27406d1a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa288009840 tx=0x7fa288010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:20.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.608+0000 7fa294c00700 1 -- 172.21.15.80:0/2809160557 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa290054600 con 0x7fa298161d10 2024-05-10T04:23:20.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.815+0000 7fa29d400700 1 -- 172.21.15.80:0/2809160557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2980b38a0 con 0x7fa298161d10 2024-05-10T04:23:20.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.816+0000 7fa294c00700 1 -- 172.21.15.80:0/2809160557 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16286 (secure 0 0 0) 0x7fa290057c20 con 0x7fa298161d10 2024-05-10T04:23:20.818 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:20.818 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:23:20.092453+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:23:20.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.819+0000 7fa29d400700 1 -- 172.21.15.80:0/2809160557 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa27406ac90 msgr2=0x7fa27406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:20.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.819+0000 7fa29d400700 1 --2- 172.21.15.80:0/2809160557 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa27406ac90 0x7fa27406d1a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa288009840 tx=0x7fa288010000 comp rx=0 tx=0).stop 2024-05-10T04:23:20.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.819+0000 7fa29d400700 1 -- 172.21.15.80:0/2809160557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa298161d10 msgr2=0x7fa298158f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:20.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.819+0000 7fa29d400700 1 --2- 172.21.15.80:0/2809160557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa298161d10 0x7fa298158f30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa290007dc0 tx=0x7fa29000d3b0 comp rx=0 tx=0).stop 2024-05-10T04:23:20.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.819+0000 7fa29d400700 1 -- 172.21.15.80:0/2809160557 shutdown_connections 2024-05-10T04:23:20.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.819+0000 7fa29d400700 1 --2- 172.21.15.80:0/2809160557 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa27406ac90 0x7fa27406d1a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:20.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.819+0000 7fa29d400700 1 --2- 172.21.15.80:0/2809160557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa298161d10 0x7fa298158f30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:20.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.819+0000 7fa29d400700 1 --2- 172.21.15.80:0/2809160557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2980b7120 0x7fa29814c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:20.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.819+0000 7fa29d400700 1 --2- 172.21.15.80:0/2809160557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa2980cf360 0x7fa2981589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:20.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.819+0000 7fa29d400700 1 -- 172.21.15.80:0/2809160557 >> 172.21.15.80:0/2809160557 conn(0x7fa29806c4e0 msgr2=0x7fa29806c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:20.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.819+0000 7fa29d400700 1 -- 172.21.15.80:0/2809160557 shutdown_connections 2024-05-10T04:23:20.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:20.819+0000 7fa29d400700 1 -- 172.21.15.80:0/2809160557 wait complete. 2024-05-10T04:23:20.846 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:22:26.793377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:22:35.751764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:22:36.465587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:23:20.847 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:23:21.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.108+0000 7f2874400700 1 Processor -- start 2024-05-10T04:23:21.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.108+0000 7f2874400700 1 -- start start 2024-05-10T04:23:21.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.110+0000 7f2874400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f286c162150 0x7f286c15e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.110+0000 7f2874400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f286c0cf4d0 0x7f286c0b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.110+0000 7f2874400700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286c0d2c00 con 0x7f286c0b7910 2024-05-10T04:23:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.110+0000 7f2874400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286c162630 con 0x7f286c162150 2024-05-10T04:23:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.110+0000 7f2874400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c162910 con 0x7f286c0cf4d0 2024-05-10T04:23:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.110+0000 7f2871a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f286c162150 0x7f286c15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.110+0000 7f2871a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f286c162150 0x7f286c15e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53922/0 (socket says 172.21.15.80:53922) 2024-05-10T04:23:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.110+0000 7f2871a00700 1 -- 172.21.15.80:0/2313320199 learned_addr learned my addr 172.21.15.80:0/2313320199 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.110+0000 7f2871000700 1 --2- 172.21.15.80:0/2313320199 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f286c0cf4d0 0x7f286c0b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.110+0000 7f2871a00700 1 -- 172.21.15.80:0/2313320199 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f286c0cf4d0 msgr2=0x7f286c0b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.110+0000 7f2871a00700 1 --2- 172.21.15.80:0/2313320199 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f286c0cf4d0 0x7f286c0b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.110+0000 7f2871a00700 1 -- 172.21.15.80:0/2313320199 >> v1:172.21.15.106:6789/0 conn(0x7f286c0b7910 legacy=0x7f286c06c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.110+0000 7f2871a00700 1 -- 172.21.15.80:0/2313320199 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c162bf0 con 0x7f286c162150 2024-05-10T04:23:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.111+0000 7f2871a00700 1 --2- 172.21.15.80:0/2313320199 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286c162150 0x7f286c15e610 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f28600098f0 tx=0x7f2860009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d4992e01d99d1a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:21.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.111+0000 7f286be00700 1 -- 172.21.15.80:0/2313320199 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860011830 con 0x7f286c162150 2024-05-10T04:23:21.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.111+0000 7f286be00700 1 -- 172.21.15.80:0/2313320199 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2860011990 con 0x7f286c162150 2024-05-10T04:23:21.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.111+0000 7f286be00700 1 -- 172.21.15.80:0/2313320199 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860011d20 con 0x7f286c162150 2024-05-10T04:23:21.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.112+0000 7f2874400700 1 -- 172.21.15.80:0/2313320199 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286c162150 msgr2=0x7f286c15e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:21.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.112+0000 7f2874400700 1 --2- 172.21.15.80:0/2313320199 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286c162150 0x7f286c15e610 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f28600098f0 tx=0x7f2860009c00 comp rx=0 tx=0).stop 2024-05-10T04:23:21.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.112+0000 7f2874400700 1 -- 172.21.15.80:0/2313320199 shutdown_connections 2024-05-10T04:23:21.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.112+0000 7f2874400700 1 --2- 172.21.15.80:0/2313320199 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286c162150 0x7f286c15e610 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.112+0000 7f2874400700 1 --2- 172.21.15.80:0/2313320199 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f286c0cf4d0 0x7f286c0b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.112+0000 7f2874400700 1 -- 172.21.15.80:0/2313320199 >> 172.21.15.80:0/2313320199 conn(0x7f286c0d3e10 msgr2=0x7f286c0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:21.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.112+0000 7f2874400700 1 -- 172.21.15.80:0/2313320199 shutdown_connections 2024-05-10T04:23:21.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.112+0000 7f2874400700 1 -- 172.21.15.80:0/2313320199 wait complete. 2024-05-10T04:23:21.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.115+0000 7f2874400700 1 Processor -- start 2024-05-10T04:23:21.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.115+0000 7f2874400700 1 -- start start 2024-05-10T04:23:21.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.117+0000 7f2874400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f286c0b7910 0x7f286c0b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:21.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.117+0000 7f2874400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f286c0cf4d0 0x7f286c14d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:21.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.117+0000 7f2874400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286c162150 0x7f286c160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:21.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.117+0000 7f2874400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0b4f00 con 0x7f286c162150 2024-05-10T04:23:21.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.117+0000 7f2874400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c1e9aa0 con 0x7f286c0b7910 2024-05-10T04:23:21.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.117+0000 7f2874400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c1ea870 con 0x7f286c0cf4d0 2024-05-10T04:23:21.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.117+0000 7f2872400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286c162150 0x7f286c160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:21.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.117+0000 7f2872400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286c162150 0x7f286c160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53936/0 (socket says 172.21.15.80:53936) 2024-05-10T04:23:21.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.117+0000 7f2872400700 1 -- 172.21.15.80:0/83445677 learned_addr learned my addr 172.21.15.80:0/83445677 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:21.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.117+0000 7f2871000700 1 --2- 172.21.15.80:0/83445677 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f286c0cf4d0 0x7f286c14d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:21.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.117+0000 7f2871a00700 1 --2- 172.21.15.80:0/83445677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f286c0b7910 0x7f286c0b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:21.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.117+0000 7f2872400700 1 -- 172.21.15.80:0/83445677 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f286c0cf4d0 msgr2=0x7f286c14d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:21.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.117+0000 7f2872400700 1 --2- 172.21.15.80:0/83445677 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f286c0cf4d0 0x7f286c14d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.117+0000 7f2872400700 1 -- 172.21.15.80:0/83445677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f286c0b7910 msgr2=0x7f286c0b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:21.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.117+0000 7f2872400700 1 --2- 172.21.15.80:0/83445677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f286c0b7910 0x7f286c0b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.117+0000 7f2872400700 1 -- 172.21.15.80:0/83445677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2860009550 con 0x7f286c162150 2024-05-10T04:23:21.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.118+0000 7f2872400700 1 --2- 172.21.15.80:0/83445677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286c162150 0x7f286c160a60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f286400cbf0 tx=0x7f286400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:21.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.118+0000 7f2869600700 1 -- 172.21.15.80:0/83445677 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2864003c00 con 0x7f286c162150 2024-05-10T04:23:21.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.118+0000 7f2869600700 1 -- 172.21.15.80:0/83445677 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2864003d60 con 0x7f286c162150 2024-05-10T04:23:21.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.118+0000 7f2869600700 1 -- 172.21.15.80:0/83445677 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286400aaa0 con 0x7f286c162150 2024-05-10T04:23:21.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.118+0000 7f2874400700 1 -- 172.21.15.80:0/83445677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286c1e9cf0 con 0x7f286c162150 2024-05-10T04:23:21.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.118+0000 7f2874400700 1 -- 172.21.15.80:0/83445677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286c1ea2b0 con 0x7f286c162150 2024-05-10T04:23:21.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.119+0000 7f2874400700 1 -- 172.21.15.80:0/83445677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f286c074af0 con 0x7f286c162150 2024-05-10T04:23:21.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.120+0000 7f2869600700 1 -- 172.21.15.80:0/83445677 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f286400ac00 con 0x7f286c162150 2024-05-10T04:23:21.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.121+0000 7f2869600700 1 --2- 172.21.15.80:0/83445677 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f284c06ac90 0x7f284c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:21.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.121+0000 7f2869600700 1 -- 172.21.15.80:0/83445677 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2864089350 con 0x7f286c162150 2024-05-10T04:23:21.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.122+0000 7f2871a00700 1 --2- 172.21.15.80:0/83445677 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f284c06ac90 0x7f284c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:21.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.122+0000 7f2871a00700 1 --2- 172.21.15.80:0/83445677 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f284c06ac90 0x7f284c06d1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f28600098f0 tx=0x7f2860008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:21.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.126+0000 7f2869600700 1 -- 172.21.15.80:0/83445677 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2864054400 con 0x7f286c162150 2024-05-10T04:23:21.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.327+0000 7f2874400700 1 -- 172.21.15.80:0/83445677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f286c161ec0 con 0x7f286c162150 2024-05-10T04:23:21.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.328+0000 7f2869600700 1 -- 172.21.15.80:0/83445677 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2864057a20 con 0x7f286c162150 2024-05-10T04:23:21.330 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-10T04:23:21.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.331+0000 7f2874400700 1 -- 172.21.15.80:0/83445677 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f284c06ac90 msgr2=0x7f284c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:21.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.331+0000 7f2874400700 1 --2- 172.21.15.80:0/83445677 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f284c06ac90 0x7f284c06d1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f28600098f0 tx=0x7f2860008030 comp rx=0 tx=0).stop 2024-05-10T04:23:21.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.331+0000 7f2874400700 1 -- 172.21.15.80:0/83445677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286c162150 msgr2=0x7f286c160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:21.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.331+0000 7f2874400700 1 --2- 172.21.15.80:0/83445677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286c162150 0x7f286c160a60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f286400cbf0 tx=0x7f286400cf00 comp rx=0 tx=0).stop 2024-05-10T04:23:21.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.331+0000 7f2874400700 1 -- 172.21.15.80:0/83445677 shutdown_connections 2024-05-10T04:23:21.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.331+0000 7f2874400700 1 --2- 172.21.15.80:0/83445677 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f284c06ac90 0x7f284c06d1a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.331+0000 7f2874400700 1 --2- 172.21.15.80:0/83445677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286c162150 0x7f286c160a60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.331+0000 7f2874400700 1 --2- 172.21.15.80:0/83445677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f286c0b7910 0x7f286c0b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.331+0000 7f2874400700 1 --2- 172.21.15.80:0/83445677 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f286c0cf4d0 0x7f286c14d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.331+0000 7f2874400700 1 -- 172.21.15.80:0/83445677 >> 172.21.15.80:0/83445677 conn(0x7f286c0d3e10 msgr2=0x7f286c0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:21.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.331+0000 7f2874400700 1 -- 172.21.15.80:0/83445677 shutdown_connections 2024-05-10T04:23:21.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.331+0000 7f2874400700 1 -- 172.21.15.80:0/83445677 wait complete. 2024-05-10T04:23:21.357 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:23:21.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.616+0000 7faf97200700 1 Processor -- start 2024-05-10T04:23:21.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.616+0000 7faf97200700 1 -- start start 2024-05-10T04:23:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.617+0000 7faf97200700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faf980b98e0 0x7faf980d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.617+0000 7faf97200700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf980d2e50 con 0x7faf980d0c90 2024-05-10T04:23:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.617+0000 7faf97200700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf980d3130 con 0x7faf980b6230 2024-05-10T04:23:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.617+0000 7faf97200700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf980d3410 con 0x7faf980b98e0 2024-05-10T04:23:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.618+0000 7faf96800700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faf980d0c90 0x7faf9815d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34050/0 (socket says 172.21.15.80:34050) 2024-05-10T04:23:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.618+0000 7faf96800700 1 -- 172.21.15.80:0/1565629548 learned_addr learned my addr 172.21.15.80:0/1565629548 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.618+0000 7faf95e00700 1 --2- 172.21.15.80:0/1565629548 >> v2:172.21.15.106:3300/0 conn(0x7faf980b98e0 0x7faf980d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:21.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.618+0000 7faf95400700 1 -- 172.21.15.80:0/1565629548 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65182926 0 0) 0x7faf980d2e50 con 0x7faf980d0c90 2024-05-10T04:23:21.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.618+0000 7faf95400700 1 -- 172.21.15.80:0/1565629548 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf7c0035b0 con 0x7faf980d0c90 2024-05-10T04:23:21.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.618+0000 7faf95400700 1 -- 172.21.15.80:0/1565629548 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683671869 0 0) 0x7faf980d3130 con 0x7faf980b6230 2024-05-10T04:23:21.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.618+0000 7faf95400700 1 -- 172.21.15.80:0/1565629548 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf980d2e50 con 0x7faf980b6230 2024-05-10T04:23:21.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.618+0000 7faf95400700 1 -- 172.21.15.80:0/1565629548 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 198490005 0 0) 0x7faf7c0035b0 con 0x7faf980d0c90 2024-05-10T04:23:21.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.618+0000 7faf95400700 1 -- 172.21.15.80:0/1565629548 >> v2:172.21.15.106:3300/0 conn(0x7faf980b98e0 msgr2=0x7faf980d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:21.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.618+0000 7faf95400700 1 --2- 172.21.15.80:0/1565629548 >> v2:172.21.15.106:3300/0 conn(0x7faf980b98e0 0x7faf980d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.618+0000 7faf95400700 1 -- 172.21.15.80:0/1565629548 >> v1:172.21.15.106:6789/0 conn(0x7faf980b6230 legacy=0x7faf980d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:21.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.618+0000 7faf95400700 1 -- 172.21.15.80:0/1565629548 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf980b7470 con 0x7faf980d0c90 2024-05-10T04:23:21.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.618+0000 7faf95400700 1 -- 172.21.15.80:0/1565629548 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7faf900019f0 con 0x7faf980d0c90 2024-05-10T04:23:21.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.618+0000 7faf95e00700 1 --2- 172.21.15.80:0/1565629548 >> v2:172.21.15.106:3300/0 conn(0x7faf980b98e0 0x7faf980d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:23:21.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.619+0000 7faf95400700 1 -- 172.21.15.80:0/1565629548 >> v1:172.21.15.80:6789/0 conn(0x7faf980d0c90 legacy=0x7faf9815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:21.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.619+0000 7faf95400700 1 --2- 172.21.15.80:0/1565629548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf7c003be0 0x7faf7c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:21.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.619+0000 7faf95400700 1 --2- 172.21.15.80:0/1565629548 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf7c004850 0x7faf7c004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:21.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.619+0000 7faf95400700 1 --2- 172.21.15.80:0/1565629548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf7c005260 0x7faf7c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:21.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.619+0000 7faf95400700 1 -- 172.21.15.80:0/1565629548 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf980d3410 con 0x7faf7c003be0 2024-05-10T04:23:21.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.619+0000 7faf95400700 1 -- 172.21.15.80:0/1565629548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c00c1e0 con 0x7faf7c005260 2024-05-10T04:23:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.619+0000 7faf95400700 1 -- 172.21.15.80:0/1565629548 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c00c3a0 con 0x7faf7c004850 2024-05-10T04:23:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.619+0000 7faf95e00700 1 --2- 172.21.15.80:0/1565629548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf7c003be0 0x7faf7c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.619+0000 7faf8fe00700 1 --2- 172.21.15.80:0/1565629548 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf7c004850 0x7faf7c004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.619+0000 7faf96800700 1 --2- 172.21.15.80:0/1565629548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf7c005260 0x7faf7c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.619+0000 7faf95e00700 1 -- 172.21.15.80:0/1565629548 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf7c004850 msgr2=0x7faf7c004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.619+0000 7faf95e00700 1 --2- 172.21.15.80:0/1565629548 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf7c004850 0x7faf7c004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.619+0000 7faf95e00700 1 -- 172.21.15.80:0/1565629548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf7c005260 msgr2=0x7faf7c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.619+0000 7faf95e00700 1 --2- 172.21.15.80:0/1565629548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf7c005260 0x7faf7c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.619+0000 7faf95e00700 1 -- 172.21.15.80:0/1565629548 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c0035b0 con 0x7faf7c003be0 2024-05-10T04:23:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.619+0000 7faf96800700 1 -- 172.21.15.80:0/1565629548 reap_dead start 2024-05-10T04:23:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.620+0000 7faf95e00700 1 --2- 172.21.15.80:0/1565629548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf7c003be0 0x7faf7c004030 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faf88009d30 tx=0x7faf7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b06ffc565214af server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.620+0000 7faf95400700 1 -- 172.21.15.80:0/1565629548 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf88009e80 con 0x7faf7c003be0 2024-05-10T04:23:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.620+0000 7faf95400700 1 -- 172.21.15.80:0/1565629548 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8800e9a0 con 0x7faf7c003be0 2024-05-10T04:23:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.620+0000 7faf95400700 1 -- 172.21.15.80:0/1565629548 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8800ed10 con 0x7faf7c003be0 2024-05-10T04:23:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.621+0000 7faf97200700 1 -- 172.21.15.80:0/1565629548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf7c003be0 msgr2=0x7faf7c004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.621+0000 7faf97200700 1 --2- 172.21.15.80:0/1565629548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf7c003be0 0x7faf7c004030 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faf88009d30 tx=0x7faf7c005880 comp rx=0 tx=0).stop 2024-05-10T04:23:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.621+0000 7faf97200700 1 -- 172.21.15.80:0/1565629548 shutdown_connections 2024-05-10T04:23:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.621+0000 7faf97200700 1 --2- 172.21.15.80:0/1565629548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf7c003be0 0x7faf7c004030 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.621+0000 7faf97200700 1 -- 172.21.15.80:0/1565629548 >> 172.21.15.80:0/1565629548 conn(0x7faf980676c0 msgr2=0x7faf9806c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.621+0000 7faf97200700 1 -- 172.21.15.80:0/1565629548 shutdown_connections 2024-05-10T04:23:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.621+0000 7faf97200700 1 -- 172.21.15.80:0/1565629548 wait complete. 2024-05-10T04:23:21.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.623+0000 7faf97200700 1 Processor -- start 2024-05-10T04:23:21.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.623+0000 7faf97200700 1 -- start start 2024-05-10T04:23:21.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.625+0000 7faf97200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf7c003be0 0x7faf980aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:21.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.625+0000 7faf97200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf980ac1b0 0x7faf98151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:21.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.625+0000 7faf97200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf9815d990 0x7faf9815dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.625+0000 7faf97200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf981f5080 con 0x7faf7c003be0 2024-05-10T04:23:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.625+0000 7faf97200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf980aaec0 con 0x7faf980ac1b0 2024-05-10T04:23:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.625+0000 7faf97200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf980abd20 con 0x7faf9815d990 2024-05-10T04:23:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.625+0000 7faf95e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf7c003be0 0x7faf980aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.625+0000 7faf95e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf7c003be0 0x7faf980aa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53956/0 (socket says 172.21.15.80:53956) 2024-05-10T04:23:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.625+0000 7faf95e00700 1 -- 172.21.15.80:0/1118779522 learned_addr learned my addr 172.21.15.80:0/1118779522 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.625+0000 7faf8fe00700 1 --2- 172.21.15.80:0/1118779522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf980ac1b0 0x7faf98151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.625+0000 7faf96800700 1 --2- 172.21.15.80:0/1118779522 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf9815d990 0x7faf9815dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.625+0000 7faf95e00700 1 -- 172.21.15.80:0/1118779522 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf9815d990 msgr2=0x7faf9815dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.625+0000 7faf95e00700 1 --2- 172.21.15.80:0/1118779522 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf9815d990 0x7faf9815dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.625+0000 7faf95e00700 1 -- 172.21.15.80:0/1118779522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf980ac1b0 msgr2=0x7faf98151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.625+0000 7faf95e00700 1 --2- 172.21.15.80:0/1118779522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf980ac1b0 0x7faf98151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.625+0000 7faf95e00700 1 -- 172.21.15.80:0/1118779522 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9815e2e0 con 0x7faf7c003be0 2024-05-10T04:23:21.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.626+0000 7faf95e00700 1 --2- 172.21.15.80:0/1118779522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf7c003be0 0x7faf980aa5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faf8800e790 tx=0x7faf880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:21.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.626+0000 7faf8e000700 1 -- 172.21.15.80:0/1118779522 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf88003ab0 con 0x7faf7c003be0 2024-05-10T04:23:21.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.626+0000 7faf8e000700 1 -- 172.21.15.80:0/1118779522 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf88003c10 con 0x7faf7c003be0 2024-05-10T04:23:21.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.626+0000 7faf97200700 1 -- 172.21.15.80:0/1118779522 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf980ab110 con 0x7faf7c003be0 2024-05-10T04:23:21.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.626+0000 7faf8e000700 1 -- 172.21.15.80:0/1118779522 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf88009e80 con 0x7faf7c003be0 2024-05-10T04:23:21.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.626+0000 7faf97200700 1 -- 172.21.15.80:0/1118779522 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf980ab6d0 con 0x7faf7c003be0 2024-05-10T04:23:21.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.627+0000 7faf97200700 1 -- 172.21.15.80:0/1118779522 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf98074af0 con 0x7faf7c003be0 2024-05-10T04:23:21.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.628+0000 7faf8e000700 1 -- 172.21.15.80:0/1118779522 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faf88013470 con 0x7faf7c003be0 2024-05-10T04:23:21.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.629+0000 7faf8e000700 1 --2- 172.21.15.80:0/1118779522 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7faf7406acc0 0x7faf7406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:21.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.629+0000 7faf8e000700 1 -- 172.21.15.80:0/1118779522 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7faf8808aef0 con 0x7faf7c003be0 2024-05-10T04:23:21.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.629+0000 7faf8fe00700 1 --2- 172.21.15.80:0/1118779522 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7faf7406acc0 0x7faf7406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:21.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.630+0000 7faf8fe00700 1 --2- 172.21.15.80:0/1118779522 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7faf7406acc0 0x7faf7406d1d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faf9815e840 tx=0x7faf80009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:21.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.634+0000 7faf8e000700 1 -- 172.21.15.80:0/1118779522 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7faf88059bf0 con 0x7faf7c003be0 2024-05-10T04:23:21.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.836+0000 7faf97200700 1 -- 172.21.15.80:0/1118779522 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf981f5080 con 0x7faf7c003be0 2024-05-10T04:23:21.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.837+0000 7faf8e000700 1 -- 172.21.15.80:0/1118779522 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf88009900 con 0x7faf7c003be0 2024-05-10T04:23:21.838 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-10T04:23:21.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.839+0000 7faf97200700 1 -- 172.21.15.80:0/1118779522 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7faf7406acc0 msgr2=0x7faf7406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:21.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.839+0000 7faf97200700 1 --2- 172.21.15.80:0/1118779522 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7faf7406acc0 0x7faf7406d1d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faf9815e840 tx=0x7faf80009040 comp rx=0 tx=0).stop 2024-05-10T04:23:21.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.839+0000 7faf97200700 1 -- 172.21.15.80:0/1118779522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf7c003be0 msgr2=0x7faf980aa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:21.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.839+0000 7faf97200700 1 --2- 172.21.15.80:0/1118779522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf7c003be0 0x7faf980aa5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faf8800e790 tx=0x7faf880047c0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.839+0000 7faf97200700 1 -- 172.21.15.80:0/1118779522 shutdown_connections 2024-05-10T04:23:21.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.839+0000 7faf97200700 1 --2- 172.21.15.80:0/1118779522 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7faf7406acc0 0x7faf7406d1d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.839+0000 7faf97200700 1 --2- 172.21.15.80:0/1118779522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf7c003be0 0x7faf980aa5a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.839+0000 7faf97200700 1 --2- 172.21.15.80:0/1118779522 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf9815d990 0x7faf9815dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.839+0000 7faf97200700 1 --2- 172.21.15.80:0/1118779522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf980ac1b0 0x7faf98151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:21.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.839+0000 7faf97200700 1 -- 172.21.15.80:0/1118779522 >> 172.21.15.80:0/1118779522 conn(0x7faf980676c0 msgr2=0x7faf980b7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:21.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.839+0000 7faf97200700 1 -- 172.21.15.80:0/1118779522 shutdown_connections 2024-05-10T04:23:21.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:21.839+0000 7faf97200700 1 -- 172.21.15.80:0/1118779522 wait complete. 2024-05-10T04:23:21.867 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:23:22.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.130+0000 7f02aa600700 1 Processor -- start 2024-05-10T04:23:22.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.130+0000 7f02aa600700 1 -- start start 2024-05-10T04:23:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.131+0000 7f02aa600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f02a4162150 0x7f02a415e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.131+0000 7f02aa600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02a40cf4d0 0x7f02a40b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.131+0000 7f02aa600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f02a40b7910 0x7f02a406c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.131+0000 7f02aa600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a40d2c00 con 0x7f02a4162150 2024-05-10T04:23:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.131+0000 7f02aa600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a4162630 con 0x7f02a40b7910 2024-05-10T04:23:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.131+0000 7f02aa600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a4162910 con 0x7f02a40cf4d0 2024-05-10T04:23:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.132+0000 7f02a3400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f02a4162150 0x7f02a415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.132+0000 7f02a3400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f02a4162150 0x7f02a415e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53958/0 (socket says 172.21.15.80:53958) 2024-05-10T04:23:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.132+0000 7f02a3400700 1 -- 172.21.15.80:0/3678510122 learned_addr learned my addr 172.21.15.80:0/3678510122 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.132+0000 7f02a3e00700 1 --2- 172.21.15.80:0/3678510122 >> v2:172.21.15.106:3300/0 conn(0x7f02a40b7910 0x7f02a406c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.132+0000 7f02a2a00700 1 --2- 172.21.15.80:0/3678510122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02a40cf4d0 0x7f02a40b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.132+0000 7f02a3400700 1 -- 172.21.15.80:0/3678510122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02a40cf4d0 msgr2=0x7f02a40b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.132+0000 7f02a3400700 1 --2- 172.21.15.80:0/3678510122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02a40cf4d0 0x7f02a40b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.132+0000 7f02a3400700 1 -- 172.21.15.80:0/3678510122 >> v2:172.21.15.106:3300/0 conn(0x7f02a40b7910 msgr2=0x7f02a406c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.132+0000 7f02a3400700 1 --2- 172.21.15.80:0/3678510122 >> v2:172.21.15.106:3300/0 conn(0x7f02a40b7910 0x7f02a406c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.132+0000 7f02a3400700 1 -- 172.21.15.80:0/3678510122 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a4162bf0 con 0x7f02a4162150 2024-05-10T04:23:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.132+0000 7f02a3400700 1 --2- 172.21.15.80:0/3678510122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a4162150 0x7f02a415e610 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f02a40b6f10 tx=0x7f0294009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a85329d9369000 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.133+0000 7f02a2000700 1 -- 172.21.15.80:0/3678510122 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029400b870 con 0x7f02a4162150 2024-05-10T04:23:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.133+0000 7f02a2000700 1 -- 172.21.15.80:0/3678510122 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029400b9d0 con 0x7f02a4162150 2024-05-10T04:23:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.133+0000 7f02a2000700 1 -- 172.21.15.80:0/3678510122 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029400bd60 con 0x7f02a4162150 2024-05-10T04:23:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.133+0000 7f02aa600700 1 -- 172.21.15.80:0/3678510122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a4162150 msgr2=0x7f02a415e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.133+0000 7f02aa600700 1 --2- 172.21.15.80:0/3678510122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a4162150 0x7f02a415e610 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f02a40b6f10 tx=0x7f0294009bd0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.133+0000 7f02aa600700 1 -- 172.21.15.80:0/3678510122 shutdown_connections 2024-05-10T04:23:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.133+0000 7f02aa600700 1 --2- 172.21.15.80:0/3678510122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a4162150 0x7f02a415e610 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.133+0000 7f02aa600700 1 --2- 172.21.15.80:0/3678510122 >> v2:172.21.15.106:3300/0 conn(0x7f02a40b7910 0x7f02a406c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.133+0000 7f02aa600700 1 --2- 172.21.15.80:0/3678510122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02a40cf4d0 0x7f02a40b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.133+0000 7f02aa600700 1 -- 172.21.15.80:0/3678510122 >> 172.21.15.80:0/3678510122 conn(0x7f02a40d3e10 msgr2=0x7f02a40d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.134+0000 7f02aa600700 1 -- 172.21.15.80:0/3678510122 shutdown_connections 2024-05-10T04:23:22.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.134+0000 7f02aa600700 1 -- 172.21.15.80:0/3678510122 wait complete. 2024-05-10T04:23:22.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.136+0000 7f02aa600700 1 Processor -- start 2024-05-10T04:23:22.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.136+0000 7f02aa600700 1 -- start start 2024-05-10T04:23:22.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.137+0000 7f02aa600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02a40b7910 0x7f02a4142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:22.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.137+0000 7f02aa600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a40cf4d0 0x7f02a4144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:22.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.138+0000 7f02aa600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a4162150 0x7f02a41445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:22.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.138+0000 7f02aa600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a4156930 con 0x7f02a4162150 2024-05-10T04:23:22.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.138+0000 7f02aa600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a41ea3f0 con 0x7f02a40cf4d0 2024-05-10T04:23:22.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.138+0000 7f02aa600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a41ea920 con 0x7f02a40b7910 2024-05-10T04:23:22.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.138+0000 7f02a3e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a4162150 0x7f02a41445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:22.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.138+0000 7f02a3e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a4162150 0x7f02a41445c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53972/0 (socket says 172.21.15.80:53972) 2024-05-10T04:23:22.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.138+0000 7f02a3e00700 1 -- 172.21.15.80:0/1807785741 learned_addr learned my addr 172.21.15.80:0/1807785741 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:22.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.138+0000 7f02a2a00700 1 --2- 172.21.15.80:0/1807785741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a40cf4d0 0x7f02a4144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:22.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.138+0000 7f02a3400700 1 --2- 172.21.15.80:0/1807785741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02a40b7910 0x7f02a4142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:22.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.138+0000 7f02a3e00700 1 -- 172.21.15.80:0/1807785741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02a40b7910 msgr2=0x7f02a4142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:22.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.138+0000 7f02a3e00700 1 --2- 172.21.15.80:0/1807785741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02a40b7910 0x7f02a4142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.138+0000 7f02a3e00700 1 -- 172.21.15.80:0/1807785741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a40cf4d0 msgr2=0x7f02a4144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:22.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.138+0000 7f02a3e00700 1 --2- 172.21.15.80:0/1807785741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a40cf4d0 0x7f02a4144080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.138+0000 7f02a3e00700 1 -- 172.21.15.80:0/1807785741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0294009550 con 0x7f02a4162150 2024-05-10T04:23:22.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.138+0000 7f02a3400700 1 --2- 172.21.15.80:0/1807785741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02a40b7910 0x7f02a4142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:22.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.139+0000 7f02a3e00700 1 --2- 172.21.15.80:0/1807785741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a4162150 0x7f02a41445c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f029c007d40 tx=0x7f029c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:22.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.139+0000 7f029b400700 1 -- 172.21.15.80:0/1807785741 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c00ede0 con 0x7f02a4162150 2024-05-10T04:23:22.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.139+0000 7f029b400700 1 -- 172.21.15.80:0/1807785741 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c007e90 con 0x7f02a4162150 2024-05-10T04:23:22.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.139+0000 7f02aa600700 1 -- 172.21.15.80:0/1807785741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a41ea640 con 0x7f02a4162150 2024-05-10T04:23:22.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.139+0000 7f029b400700 1 -- 172.21.15.80:0/1807785741 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c014660 con 0x7f02a4162150 2024-05-10T04:23:22.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.139+0000 7f02aa600700 1 -- 172.21.15.80:0/1807785741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a4143880 con 0x7f02a4162150 2024-05-10T04:23:22.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.140+0000 7f02aa600700 1 -- 172.21.15.80:0/1807785741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a4074af0 con 0x7f02a4162150 2024-05-10T04:23:22.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.141+0000 7f029b400700 1 -- 172.21.15.80:0/1807785741 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f029c0147c0 con 0x7f02a4162150 2024-05-10T04:23:22.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.142+0000 7f029b400700 1 --2- 172.21.15.80:0/1807785741 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f028406ac90 0x7f028406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:22.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.142+0000 7f029b400700 1 -- 172.21.15.80:0/1807785741 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f029c0899d0 con 0x7f02a4162150 2024-05-10T04:23:22.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.142+0000 7f02a3400700 1 --2- 172.21.15.80:0/1807785741 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f028406ac90 0x7f028406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:22.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.143+0000 7f02a3400700 1 --2- 172.21.15.80:0/1807785741 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f028406ac90 0x7f028406d1a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f02a40b6f10 tx=0x7f0294008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:22.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.147+0000 7f029b400700 1 -- 172.21.15.80:0/1807785741 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f029c054b30 con 0x7f02a4162150 2024-05-10T04:23:22.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.349+0000 7f02aa600700 1 -- 172.21.15.80:0/1807785741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f02a4161ec0 con 0x7f02a4162150 2024-05-10T04:23:22.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.349+0000 7f029b400700 1 -- 172.21.15.80:0/1807785741 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f029c0098c0 con 0x7f02a4162150 2024-05-10T04:23:22.351 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-10T04:23:22.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.352+0000 7f02aa600700 1 -- 172.21.15.80:0/1807785741 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f028406ac90 msgr2=0x7f028406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:22.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.352+0000 7f02aa600700 1 --2- 172.21.15.80:0/1807785741 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f028406ac90 0x7f028406d1a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f02a40b6f10 tx=0x7f0294008030 comp rx=0 tx=0).stop 2024-05-10T04:23:22.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.352+0000 7f02aa600700 1 -- 172.21.15.80:0/1807785741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a4162150 msgr2=0x7f02a41445c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:22.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.352+0000 7f02aa600700 1 --2- 172.21.15.80:0/1807785741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a4162150 0x7f02a41445c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f029c007d40 tx=0x7f029c00e3c0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.352+0000 7f02aa600700 1 -- 172.21.15.80:0/1807785741 shutdown_connections 2024-05-10T04:23:22.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.352+0000 7f02aa600700 1 --2- 172.21.15.80:0/1807785741 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f028406ac90 0x7f028406d1a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.352+0000 7f02aa600700 1 --2- 172.21.15.80:0/1807785741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a4162150 0x7f02a41445c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.352+0000 7f02aa600700 1 --2- 172.21.15.80:0/1807785741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02a40b7910 0x7f02a4142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.352+0000 7f02aa600700 1 --2- 172.21.15.80:0/1807785741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a40cf4d0 0x7f02a4144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.352+0000 7f02aa600700 1 -- 172.21.15.80:0/1807785741 >> 172.21.15.80:0/1807785741 conn(0x7f02a40d3e10 msgr2=0x7f02a406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:22.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.352+0000 7f02aa600700 1 -- 172.21.15.80:0/1807785741 shutdown_connections 2024-05-10T04:23:22.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.352+0000 7f02aa600700 1 -- 172.21.15.80:0/1807785741 wait complete. 2024-05-10T04:23:22.378 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_acls.TestACLs.test_acls' 2024-05-10T04:23:22.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.638+0000 7fc3b5a00700 1 Processor -- start 2024-05-10T04:23:22.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.638+0000 7fc3b5a00700 1 -- start start 2024-05-10T04:23:22.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.640+0000 7fc3b5a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3b0161fa0 0x7fc3b00d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:22.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.640+0000 7fc3b5a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3b00d0b70 0x7fc3b00b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:22.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.640+0000 7fc3b5a00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b00d28c0 con 0x7fc3b00b2f50 2024-05-10T04:23:22.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.640+0000 7fc3b5a00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b00b3360 con 0x7fc3b0161fa0 2024-05-10T04:23:22.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.640+0000 7fc3b5a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b00d2ba0 con 0x7fc3b00d0b70 2024-05-10T04:23:22.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.640+0000 7fc3a7e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3b0161fa0 0x7fc3b00d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:22.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.640+0000 7fc3a7e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3b0161fa0 0x7fc3b00d0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53974/0 (socket says 172.21.15.80:53974) 2024-05-10T04:23:22.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.640+0000 7fc3a7e00700 1 -- 172.21.15.80:0/14961873 learned_addr learned my addr 172.21.15.80:0/14961873 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:22.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.641+0000 7fc3af400700 1 --2- 172.21.15.80:0/14961873 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3b00d0b70 0x7fc3b00b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:22.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.641+0000 7fc3a7e00700 1 -- 172.21.15.80:0/14961873 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3b00d0b70 msgr2=0x7fc3b00b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:22.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.641+0000 7fc3a7e00700 1 --2- 172.21.15.80:0/14961873 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3b00d0b70 0x7fc3b00b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.641+0000 7fc3a7e00700 1 -- 172.21.15.80:0/14961873 >> v1:172.21.15.106:6789/0 conn(0x7fc3b00b2f50 legacy=0x7fc3b00d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:22.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.641+0000 7fc3a7e00700 1 -- 172.21.15.80:0/14961873 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b00cf970 con 0x7fc3b0161fa0 2024-05-10T04:23:22.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.641+0000 7fc3a7e00700 1 --2- 172.21.15.80:0/14961873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3b0161fa0 0x7fc3b00d0630 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc3980098f0 tx=0x7fc398009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d2725ca75d0f36 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:22.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.641+0000 7fc3ae000700 1 -- 172.21.15.80:0/14961873 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398004230 con 0x7fc3b0161fa0 2024-05-10T04:23:22.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.641+0000 7fc3ae000700 1 -- 172.21.15.80:0/14961873 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc398004390 con 0x7fc3b0161fa0 2024-05-10T04:23:22.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.641+0000 7fc3ae000700 1 -- 172.21.15.80:0/14961873 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3980036a0 con 0x7fc3b0161fa0 2024-05-10T04:23:22.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.642+0000 7fc3b5a00700 1 -- 172.21.15.80:0/14961873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3b0161fa0 msgr2=0x7fc3b00d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:22.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.642+0000 7fc3b5a00700 1 --2- 172.21.15.80:0/14961873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3b0161fa0 0x7fc3b00d0630 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc3980098f0 tx=0x7fc398009c00 comp rx=0 tx=0).stop 2024-05-10T04:23:22.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.642+0000 7fc3b5a00700 1 -- 172.21.15.80:0/14961873 shutdown_connections 2024-05-10T04:23:22.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.642+0000 7fc3b5a00700 1 --2- 172.21.15.80:0/14961873 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3b00d0b70 0x7fc3b00b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.642+0000 7fc3b5a00700 1 --2- 172.21.15.80:0/14961873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3b0161fa0 0x7fc3b00d0630 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.642+0000 7fc3b5a00700 1 -- 172.21.15.80:0/14961873 >> 172.21.15.80:0/14961873 conn(0x7fc3b006c3f0 msgr2=0x7fc3b006c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:22.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.642+0000 7fc3b5a00700 1 -- 172.21.15.80:0/14961873 shutdown_connections 2024-05-10T04:23:22.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.642+0000 7fc3b5a00700 1 -- 172.21.15.80:0/14961873 wait complete. 2024-05-10T04:23:22.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.645+0000 7fc3b5a00700 1 Processor -- start 2024-05-10T04:23:22.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.645+0000 7fc3b5a00700 1 -- start start 2024-05-10T04:23:22.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.646+0000 7fc3b5a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3b00b2f50 0x7fc3b01e8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:22.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.646+0000 7fc3b5a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3b00d0b70 0x7fc3b01e9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:22.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.646+0000 7fc3b5a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3b0161fa0 0x7fc3b01e9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:22.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.646+0000 7fc3b5a00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b00c84f0 con 0x7fc3b00b2f50 2024-05-10T04:23:22.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.646+0000 7fc3b5a00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b00ab980 con 0x7fc3b0161fa0 2024-05-10T04:23:22.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.646+0000 7fc3b5a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b00c81e0 con 0x7fc3b00d0b70 2024-05-10T04:23:22.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.646+0000 7fc3aea00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3b00b2f50 0x7fc3b01e8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:22.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.646+0000 7fc3aea00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3b00b2f50 0x7fc3b01e8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53978/0 (socket says 172.21.15.80:53978) 2024-05-10T04:23:22.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.646+0000 7fc3aea00700 1 -- 172.21.15.80:0/2342431269 learned_addr learned my addr 172.21.15.80:0/2342431269 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:22.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.647+0000 7fc3a7e00700 1 --2- 172.21.15.80:0/2342431269 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3b00d0b70 0x7fc3b01e9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:22.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.647+0000 7fc3af400700 1 --2- 172.21.15.80:0/2342431269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3b0161fa0 0x7fc3b01e9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:22.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.647+0000 7fc3aea00700 1 -- 172.21.15.80:0/2342431269 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3b00d0b70 msgr2=0x7fc3b01e9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:22.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.647+0000 7fc3aea00700 1 --2- 172.21.15.80:0/2342431269 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3b00d0b70 0x7fc3b01e9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.647+0000 7fc3aea00700 1 -- 172.21.15.80:0/2342431269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3b0161fa0 msgr2=0x7fc3b01e9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:22.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.647+0000 7fc3aea00700 1 --2- 172.21.15.80:0/2342431269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3b0161fa0 0x7fc3b01e9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:22.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.647+0000 7fc3aea00700 1 -- 172.21.15.80:0/2342431269 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc398009550 con 0x7fc3b00b2f50 2024-05-10T04:23:22.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.647+0000 7fc3af400700 1 --2- 172.21.15.80:0/2342431269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3b0161fa0 0x7fc3b01e9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:22.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.647+0000 7fc3aea00700 1 --2- 172.21.15.80:0/2342431269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3b00b2f50 0x7fc3b01e8e10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0006fd0 tx=0x7fc3a000b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:22.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.647+0000 7fc3a6a00700 1 -- 172.21.15.80:0/2342431269 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a000be80 con 0x7fc3b00b2f50 2024-05-10T04:23:22.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.647+0000 7fc3a6a00700 1 -- 172.21.15.80:0/2342431269 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a0004020 con 0x7fc3b00b2f50 2024-05-10T04:23:22.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.647+0000 7fc3b5a00700 1 -- 172.21.15.80:0/2342431269 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b00c9c50 con 0x7fc3b00b2f50 2024-05-10T04:23:22.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.647+0000 7fc3a6a00700 1 -- 172.21.15.80:0/2342431269 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0004390 con 0x7fc3b00b2f50 2024-05-10T04:23:22.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.648+0000 7fc3b5a00700 1 -- 172.21.15.80:0/2342431269 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b00ca3e0 con 0x7fc3b00b2f50 2024-05-10T04:23:22.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.648+0000 7fc3b5a00700 1 -- 172.21.15.80:0/2342431269 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b00c8630 con 0x7fc3b00b2f50 2024-05-10T04:23:22.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.650+0000 7fc3a6a00700 1 -- 172.21.15.80:0/2342431269 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc3a0003680 con 0x7fc3b00b2f50 2024-05-10T04:23:22.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.650+0000 7fc3a6a00700 1 --2- 172.21.15.80:0/2342431269 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc38c06ac90 0x7fc38c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:22.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.651+0000 7fc3a6a00700 1 -- 172.21.15.80:0/2342431269 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc3a0088fe0 con 0x7fc3b00b2f50 2024-05-10T04:23:22.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.651+0000 7fc3a7e00700 1 --2- 172.21.15.80:0/2342431269 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc38c06ac90 0x7fc38c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:22.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.652+0000 7fc3a7e00700 1 --2- 172.21.15.80:0/2342431269 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc38c06ac90 0x7fc38c06d1a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc398009130 tx=0x7fc398008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:22.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.655+0000 7fc3a6a00700 1 -- 172.21.15.80:0/2342431269 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc3a0054010 con 0x7fc3b00b2f50 2024-05-10T04:23:22.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:22.953+0000 7fc3b5a00700 1 -- 172.21.15.80:0/2342431269 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) v1 -- 0x7fc3b0074af0 con 0x7fc3b00b2f50 2024-05-10T04:23:22.955 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:23:22.959 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:23:23.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.117+0000 7fc3a6a00700 1 -- 172.21.15.80:0/2342431269 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v67) v1 ==== 123+0+0 (secure 0 0 0) 0x7fc3a0015020 con 0x7fc3b00b2f50 2024-05-10T04:23:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.120+0000 7fc3b5a00700 1 -- 172.21.15.80:0/2342431269 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc38c06ac90 msgr2=0x7fc38c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.120+0000 7fc3b5a00700 1 --2- 172.21.15.80:0/2342431269 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc38c06ac90 0x7fc38c06d1a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc398009130 tx=0x7fc398008030 comp rx=0 tx=0).stop 2024-05-10T04:23:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.120+0000 7fc3b5a00700 1 -- 172.21.15.80:0/2342431269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3b00b2f50 msgr2=0x7fc3b01e8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.120+0000 7fc3b5a00700 1 --2- 172.21.15.80:0/2342431269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3b00b2f50 0x7fc3b01e8e10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0006fd0 tx=0x7fc3a000b730 comp rx=0 tx=0).stop 2024-05-10T04:23:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.120+0000 7fc3b5a00700 1 -- 172.21.15.80:0/2342431269 shutdown_connections 2024-05-10T04:23:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.120+0000 7fc3b5a00700 1 --2- 172.21.15.80:0/2342431269 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc38c06ac90 0x7fc38c06d1a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.120+0000 7fc3b5a00700 1 --2- 172.21.15.80:0/2342431269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3b00b2f50 0x7fc3b01e8e10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.120+0000 7fc3b5a00700 1 --2- 172.21.15.80:0/2342431269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3b0161fa0 0x7fc3b01e9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.120+0000 7fc3b5a00700 1 --2- 172.21.15.80:0/2342431269 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3b00d0b70 0x7fc3b01e9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.120+0000 7fc3b5a00700 1 -- 172.21.15.80:0/2342431269 >> 172.21.15.80:0/2342431269 conn(0x7fc3b006c3f0 msgr2=0x7fc3b00b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.120+0000 7fc3b5a00700 1 -- 172.21.15.80:0/2342431269 shutdown_connections 2024-05-10T04:23:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.120+0000 7fc3b5a00700 1 -- 172.21.15.80:0/2342431269 wait complete. 2024-05-10T04:23:23.150 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-10T04:23:23.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.413+0000 7ff237a00700 1 Processor -- start 2024-05-10T04:23:23.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.413+0000 7ff237a00700 1 -- start start 2024-05-10T04:23:23.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.415+0000 7ff237a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff2300cf610 0x7ff23015c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:23.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.415+0000 7ff237a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23006df90 0x7ff23006e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:23.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.415+0000 7ff237a00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23006db00 con 0x7ff23015d9b0 2024-05-10T04:23:23.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.415+0000 7ff237a00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23015d160 con 0x7ff2300cf610 2024-05-10T04:23:23.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.415+0000 7ff237a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23015d440 con 0x7ff23006df90 2024-05-10T04:23:23.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.415+0000 7ff235000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff2300cf610 0x7ff23015c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:23.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.415+0000 7ff235000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff2300cf610 0x7ff23015c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55688/0 (socket says 172.21.15.80:55688) 2024-05-10T04:23:23.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.415+0000 7ff235a00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff23015d9b0 0x7ff230071690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41460/0 (socket says 172.21.15.80:41460) 2024-05-10T04:23:23.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.415+0000 7ff235000700 1 -- 172.21.15.80:0/2246313917 learned_addr learned my addr 172.21.15.80:0/2246313917 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:23.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.415+0000 7ff22fe00700 1 --2- 172.21.15.80:0/2246313917 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23006df90 0x7ff23006e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:23.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.415+0000 7ff235000700 1 -- 172.21.15.80:0/2246313917 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23006df90 msgr2=0x7ff23006e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:23.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.415+0000 7ff235000700 1 --2- 172.21.15.80:0/2246313917 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23006df90 0x7ff23006e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:23.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.415+0000 7ff235000700 1 -- 172.21.15.80:0/2246313917 >> v1:172.21.15.80:6789/0 conn(0x7ff23015d9b0 legacy=0x7ff230071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:23.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.415+0000 7ff235000700 1 -- 172.21.15.80:0/2246313917 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23015d720 con 0x7ff2300cf610 2024-05-10T04:23:23.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.415+0000 7ff22f400700 1 -- 172.21.15.80:0/2246313917 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81286066 0 0) 0x7ff23006db00 con 0x7ff23015d9b0 2024-05-10T04:23:23.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.416+0000 7ff235000700 1 --2- 172.21.15.80:0/2246313917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2300cf610 0x7ff23015c7f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff2240098f0 tx=0x7ff224009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75bf1d36d56e117 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:23.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.416+0000 7ff22f400700 1 -- 172.21.15.80:0/2246313917 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224011830 con 0x7ff2300cf610 2024-05-10T04:23:23.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.416+0000 7ff22f400700 1 -- 172.21.15.80:0/2246313917 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff224011990 con 0x7ff2300cf610 2024-05-10T04:23:23.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.416+0000 7ff22f400700 1 -- 172.21.15.80:0/2246313917 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224011d20 con 0x7ff2300cf610 2024-05-10T04:23:23.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.417+0000 7ff237a00700 1 -- 172.21.15.80:0/2246313917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2300cf610 msgr2=0x7ff23015c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:23.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.417+0000 7ff237a00700 1 --2- 172.21.15.80:0/2246313917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2300cf610 0x7ff23015c7f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff2240098f0 tx=0x7ff224009c00 comp rx=0 tx=0).stop 2024-05-10T04:23:23.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.417+0000 7ff237a00700 1 -- 172.21.15.80:0/2246313917 shutdown_connections 2024-05-10T04:23:23.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.417+0000 7ff237a00700 1 --2- 172.21.15.80:0/2246313917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2300cf610 0x7ff23015c7f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:23.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.417+0000 7ff237a00700 1 --2- 172.21.15.80:0/2246313917 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23006df90 0x7ff23006e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:23.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.417+0000 7ff237a00700 1 -- 172.21.15.80:0/2246313917 >> 172.21.15.80:0/2246313917 conn(0x7ff2300b1830 msgr2=0x7ff2300b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:23.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.417+0000 7ff237a00700 1 -- 172.21.15.80:0/2246313917 shutdown_connections 2024-05-10T04:23:23.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.417+0000 7ff237a00700 1 -- 172.21.15.80:0/2246313917 wait complete. 2024-05-10T04:23:23.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.419+0000 7ff237a00700 1 Processor -- start 2024-05-10T04:23:23.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.419+0000 7ff237a00700 1 -- start start 2024-05-10T04:23:23.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.421+0000 7ff237a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23006df90 0x7ff230153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:23.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.421+0000 7ff237a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2300cf610 0x7ff2300aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:23.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.421+0000 7ff237a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff23015d9b0 0x7ff23013bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:23.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.421+0000 7ff237a00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23013cdb0 con 0x7ff2300cf610 2024-05-10T04:23:23.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.421+0000 7ff237a00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23013b5d0 con 0x7ff23015d9b0 2024-05-10T04:23:23.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.421+0000 7ff237a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300b3860 con 0x7ff23006df90 2024-05-10T04:23:23.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.421+0000 7ff22fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2300cf610 0x7ff2300aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:23.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.421+0000 7ff22fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2300cf610 0x7ff2300aee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55692/0 (socket says 172.21.15.80:55692) 2024-05-10T04:23:23.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.421+0000 7ff22fe00700 1 -- 172.21.15.80:0/2208546945 learned_addr learned my addr 172.21.15.80:0/2208546945 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:23.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.421+0000 7ff22fe00700 1 -- 172.21.15.80:0/2208546945 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23006df90 msgr2=0x7ff230153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:23.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.421+0000 7ff22fe00700 1 --2- 172.21.15.80:0/2208546945 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23006df90 0x7ff230153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:23.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.421+0000 7ff22fe00700 1 -- 172.21.15.80:0/2208546945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff23015d9b0 msgr2=0x7ff23013bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:23.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.421+0000 7ff235a00700 1 --2- 172.21.15.80:0/2208546945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff23015d9b0 0x7ff23013bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:23.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.421+0000 7ff22fe00700 1 --2- 172.21.15.80:0/2208546945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff23015d9b0 0x7ff23013bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:23.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.422+0000 7ff22fe00700 1 -- 172.21.15.80:0/2208546945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff224009550 con 0x7ff2300cf610 2024-05-10T04:23:23.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.422+0000 7ff235a00700 1 --2- 172.21.15.80:0/2208546945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff23015d9b0 0x7ff23013bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:23.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.422+0000 7ff22fe00700 1 --2- 172.21.15.80:0/2208546945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2300cf610 0x7ff2300aee30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00e8d0 tx=0x7ff21c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:23.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.422+0000 7ff22cc00700 1 -- 172.21.15.80:0/2208546945 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c009590 con 0x7ff2300cf610 2024-05-10T04:23:23.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.422+0000 7ff22cc00700 1 -- 172.21.15.80:0/2208546945 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c00eed0 con 0x7ff2300cf610 2024-05-10T04:23:23.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.422+0000 7ff22cc00700 1 -- 172.21.15.80:0/2208546945 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c00ca50 con 0x7ff2300cf610 2024-05-10T04:23:23.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.422+0000 7ff237a00700 1 -- 172.21.15.80:0/2208546945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2300cd500 con 0x7ff2300cf610 2024-05-10T04:23:23.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.422+0000 7ff237a00700 1 -- 172.21.15.80:0/2208546945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2300b3d90 con 0x7ff2300cf610 2024-05-10T04:23:23.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.423+0000 7ff237a00700 1 -- 172.21.15.80:0/2208546945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff230074af0 con 0x7ff2300cf610 2024-05-10T04:23:23.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.424+0000 7ff22cc00700 1 -- 172.21.15.80:0/2208546945 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff21c00cbb0 con 0x7ff2300cf610 2024-05-10T04:23:23.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.425+0000 7ff22cc00700 1 --2- 172.21.15.80:0/2208546945 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff21006acc0 0x7ff21006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:23.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.425+0000 7ff22cc00700 1 -- 172.21.15.80:0/2208546945 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff21c089380 con 0x7ff2300cf610 2024-05-10T04:23:23.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.426+0000 7ff235000700 1 --2- 172.21.15.80:0/2208546945 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff21006acc0 0x7ff21006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:23.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.426+0000 7ff235000700 1 --2- 172.21.15.80:0/2208546945 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff21006acc0 0x7ff21006d1d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff2240098f0 tx=0x7ff224010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:23.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.429+0000 7ff22cc00700 1 -- 172.21.15.80:0/2208546945 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff21c054450 con 0x7ff2300cf610 2024-05-10T04:23:23.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.633+0000 7ff237a00700 1 -- 172.21.15.80:0/2208546945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff2300cecc0 con 0x7ff2300cf610 2024-05-10T04:23:23.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.638+0000 7ff22cc00700 1 -- 172.21.15.80:0/2208546945 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff21c057a70 con 0x7ff2300cf610 2024-05-10T04:23:23.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.640+0000 7ff237a00700 1 -- 172.21.15.80:0/2208546945 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff21006acc0 msgr2=0x7ff21006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:23.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.640+0000 7ff237a00700 1 --2- 172.21.15.80:0/2208546945 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff21006acc0 0x7ff21006d1d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff2240098f0 tx=0x7ff224010000 comp rx=0 tx=0).stop 2024-05-10T04:23:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.640+0000 7ff237a00700 1 -- 172.21.15.80:0/2208546945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2300cf610 msgr2=0x7ff2300aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.640+0000 7ff237a00700 1 --2- 172.21.15.80:0/2208546945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2300cf610 0x7ff2300aee30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00e8d0 tx=0x7ff21c00ec90 comp rx=0 tx=0).stop 2024-05-10T04:23:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.640+0000 7ff237a00700 1 -- 172.21.15.80:0/2208546945 shutdown_connections 2024-05-10T04:23:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.640+0000 7ff237a00700 1 --2- 172.21.15.80:0/2208546945 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff21006acc0 0x7ff21006d1d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.640+0000 7ff237a00700 1 --2- 172.21.15.80:0/2208546945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff23015d9b0 0x7ff23013bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.640+0000 7ff237a00700 1 --2- 172.21.15.80:0/2208546945 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23006df90 0x7ff230153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.640+0000 7ff237a00700 1 --2- 172.21.15.80:0/2208546945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2300cf610 0x7ff2300aee30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.640+0000 7ff237a00700 1 -- 172.21.15.80:0/2208546945 >> 172.21.15.80:0/2208546945 conn(0x7ff2300b1830 msgr2=0x7ff230153120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.640+0000 7ff237a00700 1 -- 172.21.15.80:0/2208546945 shutdown_connections 2024-05-10T04:23:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:23.640+0000 7ff237a00700 1 -- 172.21.15.80:0/2208546945 wait complete. 2024-05-10T04:23:23.669 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T04:23:23.669 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T04:23:23.754 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T04:23:23.876 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T04:23:23.876 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:23:23.877 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:23:23.919 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:23:23.919 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:23:24.003 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:23:24.003 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:23:24.086 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:23:24.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.388+0000 7f12e8e00700 1 Processor -- start 2024-05-10T04:23:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.388+0000 7f12e8e00700 1 -- start start 2024-05-10T04:23:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.390+0000 7f12e8e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f12e40d3460 0x7f12e40b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.390+0000 7f12e8e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12e41620e0 0x7f12e41624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.390+0000 7f12e8e00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e40d2730 con 0x7f12e40b58b0 2024-05-10T04:23:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.390+0000 7f12e8e00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e40b3720 con 0x7f12e40d3460 2024-05-10T04:23:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.390+0000 7f12e8e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e40d2fd0 con 0x7f12e41620e0 2024-05-10T04:23:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.390+0000 7f12e1e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f12e40d3460 0x7f12e40b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.390+0000 7f12e1e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f12e40d3460 0x7f12e40b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55698/0 (socket says 172.21.15.80:55698) 2024-05-10T04:23:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.390+0000 7f12e1e00700 1 -- 172.21.15.80:0/1548121233 learned_addr learned my addr 172.21.15.80:0/1548121233 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.391+0000 7f12e2800700 1 --2- 172.21.15.80:0/1548121233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12e41620e0 0x7f12e41624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.391+0000 7f12e1e00700 1 -- 172.21.15.80:0/1548121233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12e41620e0 msgr2=0x7f12e41624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:24.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.391+0000 7f12e1e00700 1 --2- 172.21.15.80:0/1548121233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12e41620e0 0x7f12e41624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:24.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.391+0000 7f12e1e00700 1 -- 172.21.15.80:0/1548121233 >> v1:172.21.15.106:6789/0 conn(0x7f12e40b58b0 legacy=0x7f12e40b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:24.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.391+0000 7f12e1e00700 1 -- 172.21.15.80:0/1548121233 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e4162e10 con 0x7f12e40d3460 2024-05-10T04:23:24.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.391+0000 7f12e1e00700 1 --2- 172.21.15.80:0/1548121233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12e40d3460 0x7f12e40b31e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f12d40098f0 tx=0x7f12d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4efed69b3e0dd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:24.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.391+0000 7f12e1400700 1 -- 172.21.15.80:0/1548121233 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d400b8a0 con 0x7f12e40d3460 2024-05-10T04:23:24.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.392+0000 7f12e1400700 1 -- 172.21.15.80:0/1548121233 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d400ba00 con 0x7f12e40d3460 2024-05-10T04:23:24.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.392+0000 7f12e1400700 1 -- 172.21.15.80:0/1548121233 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d400bd90 con 0x7f12e40d3460 2024-05-10T04:23:24.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.392+0000 7f12e8e00700 1 -- 172.21.15.80:0/1548121233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12e40d3460 msgr2=0x7f12e40b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:24.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.392+0000 7f12e8e00700 1 --2- 172.21.15.80:0/1548121233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12e40d3460 0x7f12e40b31e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f12d40098f0 tx=0x7f12d4009c00 comp rx=0 tx=0).stop 2024-05-10T04:23:24.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.392+0000 7f12e8e00700 1 -- 172.21.15.80:0/1548121233 shutdown_connections 2024-05-10T04:23:24.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.392+0000 7f12e8e00700 1 --2- 172.21.15.80:0/1548121233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12e41620e0 0x7f12e41624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:24.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.392+0000 7f12e8e00700 1 --2- 172.21.15.80:0/1548121233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12e40d3460 0x7f12e40b31e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:24.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.392+0000 7f12e8e00700 1 -- 172.21.15.80:0/1548121233 >> 172.21.15.80:0/1548121233 conn(0x7f12e40d0a90 msgr2=0x7f12e40d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:24.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.392+0000 7f12e8e00700 1 -- 172.21.15.80:0/1548121233 shutdown_connections 2024-05-10T04:23:24.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.392+0000 7f12e8e00700 1 -- 172.21.15.80:0/1548121233 wait complete. 2024-05-10T04:23:24.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.395+0000 7f12e8e00700 1 Processor -- start 2024-05-10T04:23:24.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.395+0000 7f12e8e00700 1 -- start start 2024-05-10T04:23:24.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.397+0000 7f12e8e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12e40b58b0 0x7f12e4158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:24.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.397+0000 7f12e8e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12e40d3460 0x7f12e415a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:24.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.397+0000 7f12e8e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12e41620e0 0x7f12e414b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:24.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.397+0000 7f12e8e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e415ab60 con 0x7f12e40d3460 2024-05-10T04:23:24.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.397+0000 7f12e8e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e41f5200 con 0x7f12e40b58b0 2024-05-10T04:23:24.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.397+0000 7f12e8e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e4159330 con 0x7f12e41620e0 2024-05-10T04:23:24.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.398+0000 7f12dbe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12e40d3460 0x7f12e415a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:24.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.398+0000 7f12dbe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12e40d3460 0x7f12e415a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55710/0 (socket says 172.21.15.80:55710) 2024-05-10T04:23:24.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.398+0000 7f12dbe00700 1 -- 172.21.15.80:0/1174086139 learned_addr learned my addr 172.21.15.80:0/1174086139 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:24.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.398+0000 7f12e1e00700 1 --2- 172.21.15.80:0/1174086139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12e40b58b0 0x7f12e4158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:24.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.398+0000 7f12e2800700 1 --2- 172.21.15.80:0/1174086139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12e41620e0 0x7f12e414b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:24.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.398+0000 7f12dbe00700 1 -- 172.21.15.80:0/1174086139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12e41620e0 msgr2=0x7f12e414b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:24.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.398+0000 7f12dbe00700 1 --2- 172.21.15.80:0/1174086139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12e41620e0 0x7f12e414b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:24.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.398+0000 7f12dbe00700 1 -- 172.21.15.80:0/1174086139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12e40b58b0 msgr2=0x7f12e4158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:24.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.398+0000 7f12dbe00700 1 --2- 172.21.15.80:0/1174086139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12e40b58b0 0x7f12e4158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:24.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.398+0000 7f12dbe00700 1 -- 172.21.15.80:0/1174086139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d4009550 con 0x7f12e40d3460 2024-05-10T04:23:24.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.398+0000 7f12e1e00700 1 --2- 172.21.15.80:0/1174086139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12e40b58b0 0x7f12e4158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:24.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.398+0000 7f12dbe00700 1 --2- 172.21.15.80:0/1174086139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12e40d3460 0x7f12e415a620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00c450 tx=0x7f12cc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:24.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.399+0000 7f12da000700 1 -- 172.21.15.80:0/1174086139 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc0052d0 con 0x7f12e40d3460 2024-05-10T04:23:24.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.399+0000 7f12da000700 1 -- 172.21.15.80:0/1174086139 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc005430 con 0x7f12e40d3460 2024-05-10T04:23:24.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.399+0000 7f12da000700 1 -- 172.21.15.80:0/1174086139 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc0038c0 con 0x7f12e40d3460 2024-05-10T04:23:24.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.399+0000 7f12e8e00700 1 -- 172.21.15.80:0/1174086139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e415a190 con 0x7f12e40d3460 2024-05-10T04:23:24.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.399+0000 7f12e8e00700 1 -- 172.21.15.80:0/1174086139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e4159860 con 0x7f12e40d3460 2024-05-10T04:23:24.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.400+0000 7f12e8e00700 1 -- 172.21.15.80:0/1174086139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e40732b0 con 0x7f12e40d3460 2024-05-10T04:23:24.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.401+0000 7f12da000700 1 -- 172.21.15.80:0/1174086139 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f12cc003a20 con 0x7f12e40d3460 2024-05-10T04:23:24.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.402+0000 7f12da000700 1 --2- 172.21.15.80:0/1174086139 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f12c006ac90 0x7f12c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:24.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.402+0000 7f12da000700 1 -- 172.21.15.80:0/1174086139 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f12cc0886e0 con 0x7f12e40d3460 2024-05-10T04:23:24.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.402+0000 7f12e1e00700 1 --2- 172.21.15.80:0/1174086139 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f12c006ac90 0x7f12c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:24.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.403+0000 7f12e1e00700 1 --2- 172.21.15.80:0/1174086139 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f12c006ac90 0x7f12c006d1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f12d4014040 tx=0x7f12d4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:24.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.406+0000 7f12da000700 1 -- 172.21.15.80:0/1174086139 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f12cc053840 con 0x7f12e40d3460 2024-05-10T04:23:24.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.612+0000 7f12e8e00700 1 -- 172.21.15.80:0/1174086139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12e415a320 con 0x7f12e40d3460 2024-05-10T04:23:24.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.613+0000 7f12da000700 1 -- 172.21.15.80:0/1174086139 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16286 (secure 0 0 0) 0x7f12cc056e60 con 0x7f12e40d3460 2024-05-10T04:23:24.614 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:24.614 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:23:20.092453+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:23:24.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.615+0000 7f12e8e00700 1 -- 172.21.15.80:0/1174086139 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f12c006ac90 msgr2=0x7f12c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:24.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.615+0000 7f12e8e00700 1 --2- 172.21.15.80:0/1174086139 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f12c006ac90 0x7f12c006d1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f12d4014040 tx=0x7f12d4008030 comp rx=0 tx=0).stop 2024-05-10T04:23:24.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.615+0000 7f12e8e00700 1 -- 172.21.15.80:0/1174086139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12e40d3460 msgr2=0x7f12e415a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:24.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.615+0000 7f12e8e00700 1 --2- 172.21.15.80:0/1174086139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12e40d3460 0x7f12e415a620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00c450 tx=0x7f12cc00c810 comp rx=0 tx=0).stop 2024-05-10T04:23:24.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.616+0000 7f12e8e00700 1 -- 172.21.15.80:0/1174086139 shutdown_connections 2024-05-10T04:23:24.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.616+0000 7f12e8e00700 1 --2- 172.21.15.80:0/1174086139 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f12c006ac90 0x7f12c006d1a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:24.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.616+0000 7f12e8e00700 1 --2- 172.21.15.80:0/1174086139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12e41620e0 0x7f12e414b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:24.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.616+0000 7f12e8e00700 1 --2- 172.21.15.80:0/1174086139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12e40b58b0 0x7f12e4158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:24.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.616+0000 7f12e8e00700 1 --2- 172.21.15.80:0/1174086139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12e40d3460 0x7f12e415a620 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:24.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.616+0000 7f12e8e00700 1 -- 172.21.15.80:0/1174086139 >> 172.21.15.80:0/1174086139 conn(0x7f12e40d0a90 msgr2=0x7f12e40b74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:24.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.616+0000 7f12e8e00700 1 -- 172.21.15.80:0/1174086139 shutdown_connections 2024-05-10T04:23:24.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.616+0000 7f12e8e00700 1 -- 172.21.15.80:0/1174086139 wait complete. 2024-05-10T04:23:24.646 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:22:26.793377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:22:35.751764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:22:36.465587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:23:24.646 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:23:24.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.907+0000 7f7da3c00700 1 Processor -- start 2024-05-10T04:23:24.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.908+0000 7f7da3c00700 1 -- start start 2024-05-10T04:23:24.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.909+0000 7f7da3c00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7d9c0b5d00 0x7f7d9c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:24.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.909+0000 7f7da3c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c06c2f0 0x7f7d9c06c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:24.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.909+0000 7f7da3c00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d9c0b6650 con 0x7f7d9c0b3280 2024-05-10T04:23:24.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.909+0000 7f7da3c00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d9c06cf70 con 0x7f7d9c0b5d00 2024-05-10T04:23:24.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.909+0000 7f7da3c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c06d250 con 0x7f7d9c06c2f0 2024-05-10T04:23:24.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.910+0000 7f7d9be00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7d9c0b5d00 0x7f7d9c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:24.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.910+0000 7f7d9be00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7d9c0b5d00 0x7f7d9c0b6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55716/0 (socket says 172.21.15.80:55716) 2024-05-10T04:23:24.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.910+0000 7f7da1200700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7d9c0b3280 0x7f7d9c0d3390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41466/0 (socket says 172.21.15.80:41466) 2024-05-10T04:23:24.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.910+0000 7f7d9be00700 1 -- 172.21.15.80:0/4142788191 learned_addr learned my addr 172.21.15.80:0/4142788191 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:24.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.910+0000 7f7da1c00700 1 --2- 172.21.15.80:0/4142788191 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c06c2f0 0x7f7d9c06c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:24.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.910+0000 7f7d9be00700 1 -- 172.21.15.80:0/4142788191 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c06c2f0 msgr2=0x7f7d9c06c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:24.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.910+0000 7f7d9be00700 1 --2- 172.21.15.80:0/4142788191 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c06c2f0 0x7f7d9c06c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:24.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.910+0000 7f7d9be00700 1 -- 172.21.15.80:0/4142788191 >> v1:172.21.15.80:6789/0 conn(0x7f7d9c0b3280 legacy=0x7f7d9c0d3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:24.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.910+0000 7f7d9be00700 1 -- 172.21.15.80:0/4142788191 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c0d28b0 con 0x7f7d9c0b5d00 2024-05-10T04:23:24.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.910+0000 7f7d9be00700 1 --2- 172.21.15.80:0/4142788191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d9c0b5d00 0x7f7d9c0b6110 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7d88006fd0 tx=0x7f7d88009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa5fee4c56e5e60 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:24.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.911+0000 7f7d9b400700 1 -- 172.21.15.80:0/4142788191 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88005e30 con 0x7f7d9c0b5d00 2024-05-10T04:23:24.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.911+0000 7f7d9b400700 1 -- 172.21.15.80:0/4142788191 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d88004030 con 0x7f7d9c0b5d00 2024-05-10T04:23:24.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.911+0000 7f7d9b400700 1 -- 172.21.15.80:0/4142788191 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d880043e0 con 0x7f7d9c0b5d00 2024-05-10T04:23:24.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.911+0000 7f7da3c00700 1 -- 172.21.15.80:0/4142788191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d9c0b5d00 msgr2=0x7f7d9c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:24.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.911+0000 7f7da3c00700 1 --2- 172.21.15.80:0/4142788191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d9c0b5d00 0x7f7d9c0b6110 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7d88006fd0 tx=0x7f7d88009bd0 comp rx=0 tx=0).stop 2024-05-10T04:23:24.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.911+0000 7f7da3c00700 1 -- 172.21.15.80:0/4142788191 shutdown_connections 2024-05-10T04:23:24.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.911+0000 7f7da3c00700 1 --2- 172.21.15.80:0/4142788191 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c06c2f0 0x7f7d9c06c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:24.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.911+0000 7f7da3c00700 1 --2- 172.21.15.80:0/4142788191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d9c0b5d00 0x7f7d9c0b6110 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:24.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.911+0000 7f7da3c00700 1 -- 172.21.15.80:0/4142788191 >> 172.21.15.80:0/4142788191 conn(0x7f7d9c0d40a0 msgr2=0x7f7d9c0d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:24.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.912+0000 7f7da3c00700 1 -- 172.21.15.80:0/4142788191 shutdown_connections 2024-05-10T04:23:24.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.912+0000 7f7da3c00700 1 -- 172.21.15.80:0/4142788191 wait complete. 2024-05-10T04:23:24.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.914+0000 7f7da3c00700 1 Processor -- start 2024-05-10T04:23:24.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.914+0000 7f7da3c00700 1 -- start start 2024-05-10T04:23:24.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.915+0000 7f7da3c00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d9c06c2f0 0x7f7d9c0ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:24.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.915+0000 7f7da3c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d9c0b3280 0x7f7d9c0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:24.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.915+0000 7f7da3c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c0b5d00 0x7f7d9c15b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:24.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.916+0000 7f7da3c00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c0ca850 con 0x7f7d9c0b3280 2024-05-10T04:23:24.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.916+0000 7f7da3c00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c0cc9b0 con 0x7f7d9c06c2f0 2024-05-10T04:23:24.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.916+0000 7f7da3c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c15c390 con 0x7f7d9c0b5d00 2024-05-10T04:23:24.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.916+0000 7f7d9be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d9c0b3280 0x7f7d9c0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:24.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.916+0000 7f7d9be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d9c0b3280 0x7f7d9c0cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55722/0 (socket says 172.21.15.80:55722) 2024-05-10T04:23:24.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.916+0000 7f7d9be00700 1 -- 172.21.15.80:0/1100057140 learned_addr learned my addr 172.21.15.80:0/1100057140 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:24.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.916+0000 7f7da1200700 1 --2- 172.21.15.80:0/1100057140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d9c06c2f0 0x7f7d9c0ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:24.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.916+0000 7f7da1c00700 1 --2- 172.21.15.80:0/1100057140 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c0b5d00 0x7f7d9c15b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:24.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.916+0000 7f7d9be00700 1 -- 172.21.15.80:0/1100057140 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c0b5d00 msgr2=0x7f7d9c15b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:24.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.916+0000 7f7d9be00700 1 --2- 172.21.15.80:0/1100057140 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c0b5d00 0x7f7d9c15b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:24.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.916+0000 7f7d9be00700 1 -- 172.21.15.80:0/1100057140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d9c06c2f0 msgr2=0x7f7d9c0ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:24.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.916+0000 7f7d9be00700 1 --2- 172.21.15.80:0/1100057140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d9c06c2f0 0x7f7d9c0ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:24.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.916+0000 7f7d9be00700 1 -- 172.21.15.80:0/1100057140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d88009500 con 0x7f7d9c0b3280 2024-05-10T04:23:24.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.916+0000 7f7da1200700 1 --2- 172.21.15.80:0/1100057140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d9c06c2f0 0x7f7d9c0ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:24.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.917+0000 7f7d9be00700 1 --2- 172.21.15.80:0/1100057140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d9c0b3280 0x7f7d9c0cdab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7d88000c00 tx=0x7f7d88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:24.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.917+0000 7f7d98c00700 1 -- 172.21.15.80:0/1100057140 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88003d90 con 0x7f7d9c0b3280 2024-05-10T04:23:24.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.917+0000 7f7d98c00700 1 -- 172.21.15.80:0/1100057140 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d88011420 con 0x7f7d9c0b3280 2024-05-10T04:23:24.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.917+0000 7f7d98c00700 1 -- 172.21.15.80:0/1100057140 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d880117d0 con 0x7f7d9c0b3280 2024-05-10T04:23:24.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.917+0000 7f7da3c00700 1 -- 172.21.15.80:0/1100057140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9c0cb1e0 con 0x7f7d9c0b3280 2024-05-10T04:23:24.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.917+0000 7f7da3c00700 1 -- 172.21.15.80:0/1100057140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9c15c8c0 con 0x7f7d9c0b3280 2024-05-10T04:23:24.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.918+0000 7f7da3c00700 1 -- 172.21.15.80:0/1100057140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9c0ce780 con 0x7f7d9c0b3280 2024-05-10T04:23:24.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.919+0000 7f7d98c00700 1 -- 172.21.15.80:0/1100057140 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7d88011930 con 0x7f7d9c0b3280 2024-05-10T04:23:24.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.920+0000 7f7d98c00700 1 --2- 172.21.15.80:0/1100057140 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7d7c06acc0 0x7f7d7c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:24.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.920+0000 7f7d98c00700 1 -- 172.21.15.80:0/1100057140 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7d8808a5f0 con 0x7f7d9c0b3280 2024-05-10T04:23:24.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.920+0000 7f7da1200700 1 --2- 172.21.15.80:0/1100057140 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7d7c06acc0 0x7f7d7c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:24.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.921+0000 7f7da1200700 1 --2- 172.21.15.80:0/1100057140 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7d7c06acc0 0x7f7d7c06d1d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7d90000f60 tx=0x7f7d90007dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:24.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:24.924+0000 7f7d98c00700 1 -- 172.21.15.80:0/1100057140 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7d88055740 con 0x7f7d9c0b3280 2024-05-10T04:23:25.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.131+0000 7f7da3c00700 1 -- 172.21.15.80:0/1100057140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d9c0732b0 con 0x7f7d9c0b3280 2024-05-10T04:23:25.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.131+0000 7f7d98c00700 1 -- 172.21.15.80:0/1100057140 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d88058d60 con 0x7f7d9c0b3280 2024-05-10T04:23:25.132 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-10T04:23:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.134+0000 7f7da3c00700 1 -- 172.21.15.80:0/1100057140 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7d7c06acc0 msgr2=0x7f7d7c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.134+0000 7f7da3c00700 1 --2- 172.21.15.80:0/1100057140 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7d7c06acc0 0x7f7d7c06d1d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7d90000f60 tx=0x7f7d90007dd0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.134+0000 7f7da3c00700 1 -- 172.21.15.80:0/1100057140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d9c0b3280 msgr2=0x7f7d9c0cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.134+0000 7f7da3c00700 1 --2- 172.21.15.80:0/1100057140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d9c0b3280 0x7f7d9c0cdab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7d88000c00 tx=0x7f7d88004750 comp rx=0 tx=0).stop 2024-05-10T04:23:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.134+0000 7f7da3c00700 1 -- 172.21.15.80:0/1100057140 shutdown_connections 2024-05-10T04:23:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.134+0000 7f7da3c00700 1 --2- 172.21.15.80:0/1100057140 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7d7c06acc0 0x7f7d7c06d1d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.134+0000 7f7da3c00700 1 --2- 172.21.15.80:0/1100057140 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c0b5d00 0x7f7d9c15b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.134+0000 7f7da3c00700 1 --2- 172.21.15.80:0/1100057140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d9c06c2f0 0x7f7d9c0ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.134+0000 7f7da3c00700 1 --2- 172.21.15.80:0/1100057140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d9c0b3280 0x7f7d9c0cdab0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.134+0000 7f7da3c00700 1 -- 172.21.15.80:0/1100057140 >> 172.21.15.80:0/1100057140 conn(0x7f7d9c0d40a0 msgr2=0x7f7d9c15fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.134+0000 7f7da3c00700 1 -- 172.21.15.80:0/1100057140 shutdown_connections 2024-05-10T04:23:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.134+0000 7f7da3c00700 1 -- 172.21.15.80:0/1100057140 wait complete. 2024-05-10T04:23:25.161 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:23:25.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.424+0000 7f564a200700 1 Processor -- start 2024-05-10T04:23:25.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.424+0000 7f564a200700 1 -- start start 2024-05-10T04:23:25.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.426+0000 7f564a200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f564415ea10 0x7f564406ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:25.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.426+0000 7f564a200700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564406c5f0 con 0x7f5644158c70 2024-05-10T04:23:25.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.426+0000 7f564a200700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5644162850 con 0x7f56440b5c90 2024-05-10T04:23:25.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.426+0000 7f564a200700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564415ee20 con 0x7f564415ea10 2024-05-10T04:23:25.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.426+0000 7f563be00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f564415ea10 0x7f564406ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:25.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.426+0000 7f5643400700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5644158c70 0x7f5644162000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41468/0 (socket says 172.21.15.80:41468) 2024-05-10T04:23:25.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.426+0000 7f5643400700 1 -- 172.21.15.80:0/498400826 learned_addr learned my addr 172.21.15.80:0/498400826 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:25.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.427+0000 7f563be00700 1 -- 172.21.15.80:0/498400826 >> v1:172.21.15.106:6789/0 conn(0x7f56440b5c90 legacy=0x7f56440b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:25.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.427+0000 7f563be00700 1 -- 172.21.15.80:0/498400826 >> v1:172.21.15.80:6789/0 conn(0x7f5644158c70 legacy=0x7f5644162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:25.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.427+0000 7f563be00700 1 -- 172.21.15.80:0/498400826 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5644162b30 con 0x7f564415ea10 2024-05-10T04:23:25.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.427+0000 7f5642a00700 1 -- 172.21.15.80:0/498400826 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442376605 0 0) 0x7f564406c5f0 con 0x7f5644158c70 2024-05-10T04:23:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.427+0000 7f563be00700 1 --2- 172.21.15.80:0/498400826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f564415ea10 0x7f564406ca80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f562c009840 tx=0x7f562c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6abbbfb2ede761 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.427+0000 7f5642a00700 1 -- 172.21.15.80:0/498400826 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c011830 con 0x7f564415ea10 2024-05-10T04:23:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.428+0000 7f5642a00700 1 -- 172.21.15.80:0/498400826 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562c011990 con 0x7f564415ea10 2024-05-10T04:23:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.428+0000 7f5642a00700 1 -- 172.21.15.80:0/498400826 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c011d20 con 0x7f564415ea10 2024-05-10T04:23:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.428+0000 7f564a200700 1 -- 172.21.15.80:0/498400826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f564415ea10 msgr2=0x7f564406ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.428+0000 7f564a200700 1 --2- 172.21.15.80:0/498400826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f564415ea10 0x7f564406ca80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f562c009840 tx=0x7f562c009b50 comp rx=0 tx=0).stop 2024-05-10T04:23:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.428+0000 7f564a200700 1 -- 172.21.15.80:0/498400826 shutdown_connections 2024-05-10T04:23:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.428+0000 7f564a200700 1 --2- 172.21.15.80:0/498400826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f564415ea10 0x7f564406ca80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.428+0000 7f564a200700 1 -- 172.21.15.80:0/498400826 >> 172.21.15.80:0/498400826 conn(0x7f56440d0d30 msgr2=0x7f56440d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.428+0000 7f564a200700 1 -- 172.21.15.80:0/498400826 shutdown_connections 2024-05-10T04:23:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.428+0000 7f564a200700 1 -- 172.21.15.80:0/498400826 wait complete. 2024-05-10T04:23:25.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.431+0000 7f564a200700 1 Processor -- start 2024-05-10T04:23:25.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.431+0000 7f564a200700 1 -- start start 2024-05-10T04:23:25.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.432+0000 7f564a200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56440b5c90 0x7f5644157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:25.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.432+0000 7f564a200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5644158c70 0x7f56441e9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:25.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.432+0000 7f564a200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f564415ea10 0x7f56440c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:25.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.432+0000 7f564a200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56440b35e0 con 0x7f56440b5c90 2024-05-10T04:23:25.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.432+0000 7f564a200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56440cc2f0 con 0x7f564415ea10 2024-05-10T04:23:25.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.432+0000 7f564a200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56441e8c10 con 0x7f5644158c70 2024-05-10T04:23:25.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.432+0000 7f5643400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56440b5c90 0x7f5644157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:25.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.433+0000 7f5643400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56440b5c90 0x7f5644157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55750/0 (socket says 172.21.15.80:55750) 2024-05-10T04:23:25.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.433+0000 7f5643400700 1 -- 172.21.15.80:0/286745296 learned_addr learned my addr 172.21.15.80:0/286745296 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:25.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.433+0000 7f563be00700 1 --2- 172.21.15.80:0/286745296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5644158c70 0x7f56441e9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:25.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.433+0000 7f5643e00700 1 --2- 172.21.15.80:0/286745296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f564415ea10 0x7f56440c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:25.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.433+0000 7f5643400700 1 -- 172.21.15.80:0/286745296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5644158c70 msgr2=0x7f56441e9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:25.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.433+0000 7f5643400700 1 --2- 172.21.15.80:0/286745296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5644158c70 0x7f56441e9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.433+0000 7f5643400700 1 -- 172.21.15.80:0/286745296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f564415ea10 msgr2=0x7f56440c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:25.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.433+0000 7f5643400700 1 --2- 172.21.15.80:0/286745296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f564415ea10 0x7f56440c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.433+0000 7f5643400700 1 -- 172.21.15.80:0/286745296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562c0094a0 con 0x7f56440b5c90 2024-05-10T04:23:25.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.433+0000 7f5643400700 1 --2- 172.21.15.80:0/286745296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56440b5c90 0x7f5644157c60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f563400c450 tx=0x7f563400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:25.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.433+0000 7f563b400700 1 -- 172.21.15.80:0/286745296 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634004c80 con 0x7f56440b5c90 2024-05-10T04:23:25.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.433+0000 7f563b400700 1 -- 172.21.15.80:0/286745296 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5634004de0 con 0x7f56440b5c90 2024-05-10T04:23:25.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.433+0000 7f564a200700 1 -- 172.21.15.80:0/286745296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56440cef50 con 0x7f56440b5c90 2024-05-10T04:23:25.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.433+0000 7f563b400700 1 -- 172.21.15.80:0/286745296 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634007310 con 0x7f56440b5c90 2024-05-10T04:23:25.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.434+0000 7f564a200700 1 -- 172.21.15.80:0/286745296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56441e82e0 con 0x7f56440b5c90 2024-05-10T04:23:25.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.435+0000 7f564a200700 1 -- 172.21.15.80:0/286745296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56440732b0 con 0x7f56440b5c90 2024-05-10T04:23:25.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.436+0000 7f563b400700 1 -- 172.21.15.80:0/286745296 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5634007470 con 0x7f56440b5c90 2024-05-10T04:23:25.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.437+0000 7f563b400700 1 --2- 172.21.15.80:0/286745296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f562006ac90 0x7f562006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:25.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.437+0000 7f563b400700 1 -- 172.21.15.80:0/286745296 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f56340890f0 con 0x7f56440b5c90 2024-05-10T04:23:25.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.438+0000 7f563be00700 1 --2- 172.21.15.80:0/286745296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f562006ac90 0x7f562006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:25.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.439+0000 7f563be00700 1 --2- 172.21.15.80:0/286745296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f562006ac90 0x7f562006d1a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5644160f50 tx=0x7f562c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.442+0000 7f563b400700 1 -- 172.21.15.80:0/286745296 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5634054230 con 0x7f56440b5c90 2024-05-10T04:23:25.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.653+0000 7f564a200700 1 -- 172.21.15.80:0/286745296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5644074af0 con 0x7f56440b5c90 2024-05-10T04:23:25.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.653+0000 7f563b400700 1 -- 172.21.15.80:0/286745296 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5634057850 con 0x7f56440b5c90 2024-05-10T04:23:25.654 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-10T04:23:25.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.655+0000 7f564a200700 1 -- 172.21.15.80:0/286745296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f562006ac90 msgr2=0x7f562006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:25.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.655+0000 7f564a200700 1 --2- 172.21.15.80:0/286745296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f562006ac90 0x7f562006d1a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5644160f50 tx=0x7f562c01c040 comp rx=0 tx=0).stop 2024-05-10T04:23:25.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.655+0000 7f564a200700 1 -- 172.21.15.80:0/286745296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56440b5c90 msgr2=0x7f5644157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:25.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.655+0000 7f564a200700 1 --2- 172.21.15.80:0/286745296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56440b5c90 0x7f5644157c60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f563400c450 tx=0x7f563400c810 comp rx=0 tx=0).stop 2024-05-10T04:23:25.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.655+0000 7f564a200700 1 -- 172.21.15.80:0/286745296 shutdown_connections 2024-05-10T04:23:25.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.655+0000 7f564a200700 1 --2- 172.21.15.80:0/286745296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f562006ac90 0x7f562006d1a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.655+0000 7f564a200700 1 --2- 172.21.15.80:0/286745296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56440b5c90 0x7f5644157c60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.655+0000 7f564a200700 1 --2- 172.21.15.80:0/286745296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f564415ea10 0x7f56440c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.655+0000 7f564a200700 1 --2- 172.21.15.80:0/286745296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5644158c70 0x7f56441e9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.655+0000 7f564a200700 1 -- 172.21.15.80:0/286745296 >> 172.21.15.80:0/286745296 conn(0x7f56440d0d30 msgr2=0x7f56440d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:25.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.655+0000 7f564a200700 1 -- 172.21.15.80:0/286745296 shutdown_connections 2024-05-10T04:23:25.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.656+0000 7f564a200700 1 -- 172.21.15.80:0/286745296 wait complete. 2024-05-10T04:23:25.683 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:23:25.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.945+0000 7fa07cc00700 1 Processor -- start 2024-05-10T04:23:25.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.945+0000 7fa07cc00700 1 -- start start 2024-05-10T04:23:25.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.947+0000 7fa07cc00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa0780b13a0 0x7fa0780b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:25.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.947+0000 7fa07cc00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0780cb9d0 con 0x7fa0780b1fe0 2024-05-10T04:23:25.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.947+0000 7fa07cc00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0780b17b0 con 0x7fa0780d05b0 2024-05-10T04:23:25.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.947+0000 7fa07cc00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07815ec70 con 0x7fa0780b13a0 2024-05-10T04:23:25.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.947+0000 7fa06fe00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa0780b1fe0 0x7fa0780cfea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41474/0 (socket says 172.21.15.80:41474) 2024-05-10T04:23:25.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.947+0000 7fa06fe00700 1 -- 172.21.15.80:0/2271348555 learned_addr learned my addr 172.21.15.80:0/2271348555 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:25.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.947+0000 7fa075e00700 1 --2- 172.21.15.80:0/2271348555 >> v2:172.21.15.106:3300/0 conn(0x7fa0780b13a0 0x7fa0780b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:25.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.948+0000 7fa075400700 1 -- 172.21.15.80:0/2271348555 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608198715 0 0) 0x7fa0780cb9d0 con 0x7fa0780b1fe0 2024-05-10T04:23:25.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.948+0000 7fa075400700 1 -- 172.21.15.80:0/2271348555 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa05c0035b0 con 0x7fa0780b1fe0 2024-05-10T04:23:25.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.948+0000 7fa075400700 1 -- 172.21.15.80:0/2271348555 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3832079274 0 0) 0x7fa05c0035b0 con 0x7fa0780b1fe0 2024-05-10T04:23:25.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.948+0000 7fa075400700 1 -- 172.21.15.80:0/2271348555 >> v2:172.21.15.106:3300/0 conn(0x7fa0780b13a0 msgr2=0x7fa0780b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:25.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.948+0000 7fa075400700 1 --2- 172.21.15.80:0/2271348555 >> v2:172.21.15.106:3300/0 conn(0x7fa0780b13a0 0x7fa0780b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.948+0000 7fa075400700 1 -- 172.21.15.80:0/2271348555 >> v1:172.21.15.106:6789/0 conn(0x7fa0780d05b0 legacy=0x7fa0780cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:25.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.948+0000 7fa075400700 1 -- 172.21.15.80:0/2271348555 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780ce240 con 0x7fa0780b1fe0 2024-05-10T04:23:25.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.948+0000 7fa075400700 1 -- 172.21.15.80:0/2271348555 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7fa060001670 con 0x7fa0780b1fe0 2024-05-10T04:23:25.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.948+0000 7fa075400700 1 -- 172.21.15.80:0/2271348555 >> v1:172.21.15.80:6789/0 conn(0x7fa0780b1fe0 legacy=0x7fa0780cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:25.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.948+0000 7fa075400700 1 --2- 172.21.15.80:0/2271348555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa05c003a00 0x7fa05c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:25.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.948+0000 7fa075400700 1 --2- 172.21.15.80:0/2271348555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05c004850 0x7fa05c004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:25.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.948+0000 7fa075400700 1 --2- 172.21.15.80:0/2271348555 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa05c0051a0 0x7fa05c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:25.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.948+0000 7fa075400700 1 -- 172.21.15.80:0/2271348555 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07815ec70 con 0x7fa05c004850 2024-05-10T04:23:25.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.948+0000 7fa075400700 1 -- 172.21.15.80:0/2271348555 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c00c110 con 0x7fa05c003a00 2024-05-10T04:23:25.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.948+0000 7fa075400700 1 -- 172.21.15.80:0/2271348555 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c00c2d0 con 0x7fa05c0051a0 2024-05-10T04:23:25.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.949+0000 7fa06fe00700 1 --2- 172.21.15.80:0/2271348555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05c004850 0x7fa05c004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:25.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.949+0000 7fa075e00700 1 --2- 172.21.15.80:0/2271348555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa05c003a00 0x7fa05c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:25.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.949+0000 7fa076800700 1 --2- 172.21.15.80:0/2271348555 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa05c0051a0 0x7fa05c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:25.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.949+0000 7fa06fe00700 1 -- 172.21.15.80:0/2271348555 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa05c0051a0 msgr2=0x7fa05c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:25.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.949+0000 7fa06fe00700 1 --2- 172.21.15.80:0/2271348555 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa05c0051a0 0x7fa05c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.949+0000 7fa06fe00700 1 -- 172.21.15.80:0/2271348555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa05c003a00 msgr2=0x7fa05c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:25.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.949+0000 7fa06fe00700 1 --2- 172.21.15.80:0/2271348555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa05c003a00 0x7fa05c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.949+0000 7fa06fe00700 1 -- 172.21.15.80:0/2271348555 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c0035b0 con 0x7fa05c004850 2024-05-10T04:23:25.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.949+0000 7fa076800700 1 -- 172.21.15.80:0/2271348555 reap_dead start 2024-05-10T04:23:25.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.949+0000 7fa06fe00700 1 --2- 172.21.15.80:0/2271348555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05c004850 0x7fa05c004c60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa06000c210 tx=0x7fa05c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45941389e2ce5036 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:25.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.949+0000 7fa075400700 1 -- 172.21.15.80:0/2271348555 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06000cd50 con 0x7fa05c004850 2024-05-10T04:23:25.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.949+0000 7fa075400700 1 -- 172.21.15.80:0/2271348555 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa060005960 con 0x7fa05c004850 2024-05-10T04:23:25.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.950+0000 7fa075400700 1 -- 172.21.15.80:0/2271348555 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa060005d10 con 0x7fa05c004850 2024-05-10T04:23:25.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.950+0000 7fa07cc00700 1 -- 172.21.15.80:0/2271348555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05c004850 msgr2=0x7fa05c004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:25.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.950+0000 7fa07cc00700 1 --2- 172.21.15.80:0/2271348555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05c004850 0x7fa05c004c60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa06000c210 tx=0x7fa05c005880 comp rx=0 tx=0).stop 2024-05-10T04:23:25.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.950+0000 7fa07cc00700 1 -- 172.21.15.80:0/2271348555 shutdown_connections 2024-05-10T04:23:25.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.950+0000 7fa07cc00700 1 --2- 172.21.15.80:0/2271348555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05c004850 0x7fa05c004c60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.950+0000 7fa07cc00700 1 -- 172.21.15.80:0/2271348555 >> 172.21.15.80:0/2271348555 conn(0x7fa0780b26a0 msgr2=0x7fa0780b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:25.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.950+0000 7fa07cc00700 1 -- 172.21.15.80:0/2271348555 shutdown_connections 2024-05-10T04:23:25.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.950+0000 7fa07cc00700 1 -- 172.21.15.80:0/2271348555 wait complete. 2024-05-10T04:23:25.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.953+0000 7fa07cc00700 1 Processor -- start 2024-05-10T04:23:25.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.953+0000 7fa07cc00700 1 -- start start 2024-05-10T04:23:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.954+0000 7fa07cc00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05c004850 0x7fa07815faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.954+0000 7fa07cc00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0780cc040 0x7fa0780cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.954+0000 7fa07cc00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa0780c7c40 0x7fa0780c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.954+0000 7fa07cc00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780aec00 con 0x7fa05c004850 2024-05-10T04:23:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.954+0000 7fa07cc00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa078160410 con 0x7fa0780cc040 2024-05-10T04:23:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.954+0000 7fa07cc00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780cc990 con 0x7fa0780c7c40 2024-05-10T04:23:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.954+0000 7fa075e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05c004850 0x7fa07815faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.954+0000 7fa075e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05c004850 0x7fa07815faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55766/0 (socket says 172.21.15.80:55766) 2024-05-10T04:23:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.954+0000 7fa075e00700 1 -- 172.21.15.80:0/299624740 learned_addr learned my addr 172.21.15.80:0/299624740 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.955+0000 7fa076800700 1 --2- 172.21.15.80:0/299624740 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa0780c7c40 0x7fa0780c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.955+0000 7fa06fe00700 1 --2- 172.21.15.80:0/299624740 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0780cc040 0x7fa0780cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.955+0000 7fa075e00700 1 -- 172.21.15.80:0/299624740 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa0780c7c40 msgr2=0x7fa0780c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.955+0000 7fa075e00700 1 --2- 172.21.15.80:0/299624740 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa0780c7c40 0x7fa0780c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.955+0000 7fa075e00700 1 -- 172.21.15.80:0/299624740 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0780cc040 msgr2=0x7fa0780cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.955+0000 7fa075e00700 1 --2- 172.21.15.80:0/299624740 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0780cc040 0x7fa0780cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.955+0000 7fa075e00700 1 -- 172.21.15.80:0/299624740 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780c9b10 con 0x7fa05c004850 2024-05-10T04:23:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.955+0000 7fa076800700 1 --2- 172.21.15.80:0/299624740 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa0780c7c40 0x7fa0780c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.955+0000 7fa06fe00700 1 --2- 172.21.15.80:0/299624740 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0780cc040 0x7fa0780cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.955+0000 7fa075e00700 1 --2- 172.21.15.80:0/299624740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05c004850 0x7fa07815faf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa068011a00 tx=0x7fa068011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.955+0000 7fa06e000700 1 -- 172.21.15.80:0/299624740 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068004240 con 0x7fa05c004850 2024-05-10T04:23:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.955+0000 7fa06e000700 1 -- 172.21.15.80:0/299624740 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0680043a0 con 0x7fa05c004850 2024-05-10T04:23:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.955+0000 7fa07cc00700 1 -- 172.21.15.80:0/299624740 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0780c9df0 con 0x7fa05c004850 2024-05-10T04:23:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.955+0000 7fa06e000700 1 -- 172.21.15.80:0/299624740 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06800f730 con 0x7fa05c004850 2024-05-10T04:23:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.956+0000 7fa07cc00700 1 -- 172.21.15.80:0/299624740 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0780ca3b0 con 0x7fa05c004850 2024-05-10T04:23:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.957+0000 7fa07cc00700 1 -- 172.21.15.80:0/299624740 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa078074af0 con 0x7fa05c004850 2024-05-10T04:23:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.958+0000 7fa06e000700 1 -- 172.21.15.80:0/299624740 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa06800f890 con 0x7fa05c004850 2024-05-10T04:23:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.958+0000 7fa06e000700 1 --2- 172.21.15.80:0/299624740 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa05406acc0 0x7fa05406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.959+0000 7fa06e000700 1 -- 172.21.15.80:0/299624740 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa0680899b0 con 0x7fa05c004850 2024-05-10T04:23:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.959+0000 7fa06fe00700 1 --2- 172.21.15.80:0/299624740 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa05406acc0 0x7fa05406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.960+0000 7fa06fe00700 1 --2- 172.21.15.80:0/299624740 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa05406acc0 0x7fa05406d1d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa07806f6e0 tx=0x7fa06000a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:25.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:25.963+0000 7fa06e000700 1 -- 172.21.15.80:0/299624740 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa0680549e0 con 0x7fa05c004850 2024-05-10T04:23:26.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.170+0000 7fa07cc00700 1 -- 172.21.15.80:0/299624740 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa078156a20 con 0x7fa05c004850 2024-05-10T04:23:26.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.170+0000 7fa06e000700 1 -- 172.21.15.80:0/299624740 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa068023020 con 0x7fa05c004850 2024-05-10T04:23:26.171 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-10T04:23:26.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.172+0000 7fa07cc00700 1 -- 172.21.15.80:0/299624740 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa05406acc0 msgr2=0x7fa05406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:26.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.172+0000 7fa07cc00700 1 --2- 172.21.15.80:0/299624740 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa05406acc0 0x7fa05406d1d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa07806f6e0 tx=0x7fa06000a000 comp rx=0 tx=0).stop 2024-05-10T04:23:26.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.172+0000 7fa07cc00700 1 -- 172.21.15.80:0/299624740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05c004850 msgr2=0x7fa07815faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:26.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.172+0000 7fa07cc00700 1 --2- 172.21.15.80:0/299624740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05c004850 0x7fa07815faf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa068011a00 tx=0x7fa068011dc0 comp rx=0 tx=0).stop 2024-05-10T04:23:26.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.172+0000 7fa07cc00700 1 -- 172.21.15.80:0/299624740 shutdown_connections 2024-05-10T04:23:26.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.172+0000 7fa07cc00700 1 --2- 172.21.15.80:0/299624740 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa05406acc0 0x7fa05406d1d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:26.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.173+0000 7fa07cc00700 1 --2- 172.21.15.80:0/299624740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05c004850 0x7fa07815faf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:26.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.173+0000 7fa07cc00700 1 --2- 172.21.15.80:0/299624740 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa0780c7c40 0x7fa0780c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:26.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.173+0000 7fa07cc00700 1 --2- 172.21.15.80:0/299624740 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0780cc040 0x7fa0780cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:26.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.173+0000 7fa07cc00700 1 -- 172.21.15.80:0/299624740 >> 172.21.15.80:0/299624740 conn(0x7fa0780b26a0 msgr2=0x7fa0780cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:26.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.173+0000 7fa07cc00700 1 -- 172.21.15.80:0/299624740 shutdown_connections 2024-05-10T04:23:26.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.173+0000 7fa07cc00700 1 -- 172.21.15.80:0/299624740 wait complete. 2024-05-10T04:23:26.201 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T04:23:26.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.462+0000 7fc975600700 1 Processor -- start 2024-05-10T04:23:26.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.462+0000 7fc975600700 1 -- start start 2024-05-10T04:23:26.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.464+0000 7fc975600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc97015ea10 0x7fc97006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.464+0000 7fc975600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc9700b5c90 0x7fc9700b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.464+0000 7fc975600700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97006c5f0 con 0x7fc970158c70 2024-05-10T04:23:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.464+0000 7fc975600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97015ee20 con 0x7fc97015ea10 2024-05-10T04:23:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.464+0000 7fc975600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9700b65e0 con 0x7fc9700b5c90 2024-05-10T04:23:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.464+0000 7fc96e000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc97015ea10 0x7fc97006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.464+0000 7fc96e000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc97015ea10 0x7fc97006ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55776/0 (socket says 172.21.15.80:55776) 2024-05-10T04:23:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.464+0000 7fc96ea00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc970158c70 0x7fc970162000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41490/0 (socket says 172.21.15.80:41490) 2024-05-10T04:23:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.464+0000 7fc96e000700 1 -- 172.21.15.80:0/2432236069 learned_addr learned my addr 172.21.15.80:0/2432236069 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.464+0000 7fc96f400700 1 --2- 172.21.15.80:0/2432236069 >> v2:172.21.15.106:3300/0 conn(0x7fc9700b5c90 0x7fc9700b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.464+0000 7fc96e000700 1 -- 172.21.15.80:0/2432236069 >> v2:172.21.15.106:3300/0 conn(0x7fc9700b5c90 msgr2=0x7fc9700b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.464+0000 7fc96e000700 1 --2- 172.21.15.80:0/2432236069 >> v2:172.21.15.106:3300/0 conn(0x7fc9700b5c90 0x7fc9700b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.464+0000 7fc96e000700 1 -- 172.21.15.80:0/2432236069 >> v1:172.21.15.80:6789/0 conn(0x7fc970158c70 legacy=0x7fc970162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:26.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.464+0000 7fc96e000700 1 -- 172.21.15.80:0/2432236069 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc970162850 con 0x7fc97015ea10 2024-05-10T04:23:26.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.464+0000 7fc96f400700 1 --2- 172.21.15.80:0/2432236069 >> v2:172.21.15.106:3300/0 conn(0x7fc9700b5c90 0x7fc9700b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:26.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.464+0000 7fc96d600700 1 -- 172.21.15.80:0/2432236069 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257202173 0 0) 0x7fc97006c5f0 con 0x7fc970158c70 2024-05-10T04:23:26.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.465+0000 7fc96e000700 1 --2- 172.21.15.80:0/2432236069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97015ea10 0x7fc97006ca80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc9700ce790 tx=0x7fc95c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94591820f91c4040 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:26.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.465+0000 7fc96d600700 1 -- 172.21.15.80:0/2432236069 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00b870 con 0x7fc97015ea10 2024-05-10T04:23:26.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.465+0000 7fc96d600700 1 -- 172.21.15.80:0/2432236069 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c00b9d0 con 0x7fc97015ea10 2024-05-10T04:23:26.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.465+0000 7fc96d600700 1 -- 172.21.15.80:0/2432236069 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00bd60 con 0x7fc97015ea10 2024-05-10T04:23:26.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.466+0000 7fc975600700 1 -- 172.21.15.80:0/2432236069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97015ea10 msgr2=0x7fc97006ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:26.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.466+0000 7fc975600700 1 --2- 172.21.15.80:0/2432236069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97015ea10 0x7fc97006ca80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc9700ce790 tx=0x7fc95c009bd0 comp rx=0 tx=0).stop 2024-05-10T04:23:26.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.466+0000 7fc975600700 1 -- 172.21.15.80:0/2432236069 shutdown_connections 2024-05-10T04:23:26.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.466+0000 7fc975600700 1 --2- 172.21.15.80:0/2432236069 >> v2:172.21.15.106:3300/0 conn(0x7fc9700b5c90 0x7fc9700b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:26.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.466+0000 7fc975600700 1 --2- 172.21.15.80:0/2432236069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97015ea10 0x7fc97006ca80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:26.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.466+0000 7fc975600700 1 -- 172.21.15.80:0/2432236069 >> 172.21.15.80:0/2432236069 conn(0x7fc9700d0d30 msgr2=0x7fc9700d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:26.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.466+0000 7fc975600700 1 -- 172.21.15.80:0/2432236069 shutdown_connections 2024-05-10T04:23:26.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.466+0000 7fc975600700 1 -- 172.21.15.80:0/2432236069 wait complete. 2024-05-10T04:23:26.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.468+0000 7fc975600700 1 Processor -- start 2024-05-10T04:23:26.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.468+0000 7fc975600700 1 -- start start 2024-05-10T04:23:26.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc975600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9700b5c90 0x7fc9700cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:26.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc975600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc970158c70 0x7fc9700c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:26.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc975600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc97015ea10 0x7fc9700ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:26.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc975600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97015c050 con 0x7fc9700b5c90 2024-05-10T04:23:26.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc975600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9700cc2b0 con 0x7fc970158c70 2024-05-10T04:23:26.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc975600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9700cc000 con 0x7fc97015ea10 2024-05-10T04:23:26.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc96ea00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9700b5c90 0x7fc9700cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:26.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc96ea00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9700b5c90 0x7fc9700cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55778/0 (socket says 172.21.15.80:55778) 2024-05-10T04:23:26.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc96ea00700 1 -- 172.21.15.80:0/653500971 learned_addr learned my addr 172.21.15.80:0/653500971 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:26.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc96e000700 1 --2- 172.21.15.80:0/653500971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc970158c70 0x7fc9700c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:26.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc96ea00700 1 -- 172.21.15.80:0/653500971 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc97015ea10 msgr2=0x7fc9700ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:26.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc96f400700 1 --2- 172.21.15.80:0/653500971 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc97015ea10 0x7fc9700ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:26.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc96ea00700 1 --2- 172.21.15.80:0/653500971 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc97015ea10 0x7fc9700ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:26.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc96ea00700 1 -- 172.21.15.80:0/653500971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc970158c70 msgr2=0x7fc9700c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:26.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc96ea00700 1 --2- 172.21.15.80:0/653500971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc970158c70 0x7fc9700c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:26.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc96ea00700 1 -- 172.21.15.80:0/653500971 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c009550 con 0x7fc9700b5c90 2024-05-10T04:23:26.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc96e000700 1 --2- 172.21.15.80:0/653500971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc970158c70 0x7fc9700c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:26.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.470+0000 7fc96f400700 1 --2- 172.21.15.80:0/653500971 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc97015ea10 0x7fc9700ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:26.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.471+0000 7fc96ea00700 1 --2- 172.21.15.80:0/653500971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9700b5c90 0x7fc9700cdec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc96000c460 tx=0x7fc96000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:26.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.471+0000 7fc966a00700 1 -- 172.21.15.80:0/653500971 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960004c80 con 0x7fc9700b5c90 2024-05-10T04:23:26.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.471+0000 7fc966a00700 1 -- 172.21.15.80:0/653500971 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc960004e00 con 0x7fc9700b5c90 2024-05-10T04:23:26.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.471+0000 7fc975600700 1 -- 172.21.15.80:0/653500971 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9700cc500 con 0x7fc9700b5c90 2024-05-10T04:23:26.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.471+0000 7fc966a00700 1 -- 172.21.15.80:0/653500971 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960007310 con 0x7fc9700b5c90 2024-05-10T04:23:26.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.471+0000 7fc975600700 1 -- 172.21.15.80:0/653500971 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9700ccac0 con 0x7fc9700b5c90 2024-05-10T04:23:26.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.472+0000 7fc975600700 1 -- 172.21.15.80:0/653500971 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9700732b0 con 0x7fc9700b5c90 2024-05-10T04:23:26.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.473+0000 7fc966a00700 1 -- 172.21.15.80:0/653500971 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc960007470 con 0x7fc9700b5c90 2024-05-10T04:23:26.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.474+0000 7fc966a00700 1 --2- 172.21.15.80:0/653500971 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc95006ac90 0x7fc95006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:26.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.474+0000 7fc966a00700 1 -- 172.21.15.80:0/653500971 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc960089100 con 0x7fc9700b5c90 2024-05-10T04:23:26.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.475+0000 7fc96e000700 1 --2- 172.21.15.80:0/653500971 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc95006ac90 0x7fc95006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:26.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.475+0000 7fc96e000700 1 --2- 172.21.15.80:0/653500971 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc95006ac90 0x7fc95006d1a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc97015f650 tx=0x7fc95c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:26.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.479+0000 7fc966a00700 1 -- 172.21.15.80:0/653500971 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc9600541b0 con 0x7fc9700b5c90 2024-05-10T04:23:26.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.696+0000 7fc975600700 1 -- 172.21.15.80:0/653500971 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc970074af0 con 0x7fc9700b5c90 2024-05-10T04:23:26.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.696+0000 7fc966a00700 1 -- 172.21.15.80:0/653500971 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc9600577d0 con 0x7fc9700b5c90 2024-05-10T04:23:26.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.698+0000 7fc975600700 1 -- 172.21.15.80:0/653500971 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc95006ac90 msgr2=0x7fc95006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:26.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.698+0000 7fc975600700 1 --2- 172.21.15.80:0/653500971 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc95006ac90 0x7fc95006d1a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc97015f650 tx=0x7fc95c008030 comp rx=0 tx=0).stop 2024-05-10T04:23:26.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.698+0000 7fc975600700 1 -- 172.21.15.80:0/653500971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9700b5c90 msgr2=0x7fc9700cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:26.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.698+0000 7fc975600700 1 --2- 172.21.15.80:0/653500971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9700b5c90 0x7fc9700cdec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc96000c460 tx=0x7fc96000c820 comp rx=0 tx=0).stop 2024-05-10T04:23:26.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.698+0000 7fc975600700 1 -- 172.21.15.80:0/653500971 shutdown_connections 2024-05-10T04:23:26.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.699+0000 7fc975600700 1 --2- 172.21.15.80:0/653500971 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc95006ac90 0x7fc95006d1a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:26.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.699+0000 7fc975600700 1 --2- 172.21.15.80:0/653500971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9700b5c90 0x7fc9700cdec0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:26.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.699+0000 7fc975600700 1 --2- 172.21.15.80:0/653500971 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc97015ea10 0x7fc9700ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:26.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.699+0000 7fc975600700 1 --2- 172.21.15.80:0/653500971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc970158c70 0x7fc9700c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:26.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.699+0000 7fc975600700 1 -- 172.21.15.80:0/653500971 >> 172.21.15.80:0/653500971 conn(0x7fc9700d0d30 msgr2=0x7fc970160540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:26.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.699+0000 7fc975600700 1 -- 172.21.15.80:0/653500971 shutdown_connections 2024-05-10T04:23:26.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:26.699+0000 7fc975600700 1 -- 172.21.15.80:0/653500971 wait complete. 2024-05-10T04:23:26.701 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-05-10T04:23:26.725 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T04:23:26.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:26.725 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-10T04:23:26.795 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-05-10T04:23:26.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:26.795 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T04:23:26.880 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:23:26.880 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:23:26.928 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:23:26.928 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:23:27.016 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:23:27.016 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:23:27.101 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:23:27.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.359+0000 7f4d31e00700 1 Processor -- start 2024-05-10T04:23:27.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.359+0000 7f4d31e00700 1 -- start start 2024-05-10T04:23:27.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.361+0000 7f4d31e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4d2c0ce370 0x7f4d2c0ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:27.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.361+0000 7f4d31e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d2c15e9e0 0x7f4d2c15edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:27.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.361+0000 7f4d31e00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2c0cfeb0 con 0x7f4d2c06d740 2024-05-10T04:23:27.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.361+0000 7f4d31e00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c162f30 con 0x7f4d2c0ce370 2024-05-10T04:23:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.361+0000 7f4d31e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0d0110 con 0x7f4d2c15e9e0 2024-05-10T04:23:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.361+0000 7f4d2a000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4d2c0ce370 0x7f4d2c0ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.361+0000 7f4d2aa00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4d2c06d740 0x7f4d2c0cf7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41492/0 (socket says 172.21.15.80:41492) 2024-05-10T04:23:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.361+0000 7f4d2aa00700 1 -- 172.21.15.80:0/1414987731 learned_addr learned my addr 172.21.15.80:0/1414987731 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.361+0000 7f4d2b400700 1 --2- 172.21.15.80:0/1414987731 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d2c15e9e0 0x7f4d2c15edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.362+0000 7f4d2a000700 1 -- 172.21.15.80:0/1414987731 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d2c15e9e0 msgr2=0x7f4d2c15edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.362+0000 7f4d2a000700 1 --2- 172.21.15.80:0/1414987731 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d2c15e9e0 0x7f4d2c15edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.362+0000 7f4d2a000700 1 -- 172.21.15.80:0/1414987731 >> v1:172.21.15.80:6789/0 conn(0x7f4d2c06d740 legacy=0x7f4d2c0cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.362+0000 7f4d2a000700 1 -- 172.21.15.80:0/1414987731 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c0cecc0 con 0x7f4d2c0ce370 2024-05-10T04:23:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.362+0000 7f4d29600700 1 -- 172.21.15.80:0/1414987731 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829121955 0 0) 0x7f4d2c0cfeb0 con 0x7f4d2c06d740 2024-05-10T04:23:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.362+0000 7f4d2a000700 1 --2- 172.21.15.80:0/1414987731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c0ce370 0x7f4d2c0ce780 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009840 tx=0x7f4d18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b2e605276dc293 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.362+0000 7f4d29600700 1 -- 172.21.15.80:0/1414987731 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18011830 con 0x7f4d2c0ce370 2024-05-10T04:23:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.362+0000 7f4d29600700 1 -- 172.21.15.80:0/1414987731 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d18011990 con 0x7f4d2c0ce370 2024-05-10T04:23:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.362+0000 7f4d29600700 1 -- 172.21.15.80:0/1414987731 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18011d20 con 0x7f4d2c0ce370 2024-05-10T04:23:27.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.363+0000 7f4d31e00700 1 -- 172.21.15.80:0/1414987731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c0ce370 msgr2=0x7f4d2c0ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:27.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.363+0000 7f4d31e00700 1 --2- 172.21.15.80:0/1414987731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c0ce370 0x7f4d2c0ce780 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009840 tx=0x7f4d18009b50 comp rx=0 tx=0).stop 2024-05-10T04:23:27.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.363+0000 7f4d31e00700 1 -- 172.21.15.80:0/1414987731 shutdown_connections 2024-05-10T04:23:27.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.363+0000 7f4d31e00700 1 --2- 172.21.15.80:0/1414987731 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d2c15e9e0 0x7f4d2c15edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:27.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.363+0000 7f4d31e00700 1 --2- 172.21.15.80:0/1414987731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c0ce370 0x7f4d2c0ce780 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:27.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.363+0000 7f4d31e00700 1 -- 172.21.15.80:0/1414987731 >> 172.21.15.80:0/1414987731 conn(0x7f4d2c06f810 msgr2=0x7f4d2c06fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:27.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.363+0000 7f4d31e00700 1 -- 172.21.15.80:0/1414987731 shutdown_connections 2024-05-10T04:23:27.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.363+0000 7f4d31e00700 1 -- 172.21.15.80:0/1414987731 wait complete. 2024-05-10T04:23:27.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.365+0000 7f4d31e00700 1 Processor -- start 2024-05-10T04:23:27.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.366+0000 7f4d31e00700 1 -- start start 2024-05-10T04:23:27.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.367+0000 7f4d31e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d2c06d740 0x7f4d2c147f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:27.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.367+0000 7f4d31e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d2c0ce370 0x7f4d2c1e7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:27.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.367+0000 7f4d31e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c15e9e0 0x7f4d2c159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:27.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.367+0000 7f4d31e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c1e9680 con 0x7f4d2c15e9e0 2024-05-10T04:23:27.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.367+0000 7f4d31e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c15ac40 con 0x7f4d2c0ce370 2024-05-10T04:23:27.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.367+0000 7f4d31e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c1e87b0 con 0x7f4d2c06d740 2024-05-10T04:23:27.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.367+0000 7f4d2b400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c15e9e0 0x7f4d2c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:27.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.367+0000 7f4d2b400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c15e9e0 0x7f4d2c159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55804/0 (socket says 172.21.15.80:55804) 2024-05-10T04:23:27.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.367+0000 7f4d2b400700 1 -- 172.21.15.80:0/3974223598 learned_addr learned my addr 172.21.15.80:0/3974223598 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:27.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.367+0000 7f4d2aa00700 1 --2- 172.21.15.80:0/3974223598 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d2c06d740 0x7f4d2c147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:27.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.367+0000 7f4d2a000700 1 --2- 172.21.15.80:0/3974223598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d2c0ce370 0x7f4d2c1e7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:27.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.368+0000 7f4d2b400700 1 -- 172.21.15.80:0/3974223598 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d2c06d740 msgr2=0x7f4d2c147f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:27.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.368+0000 7f4d2b400700 1 --2- 172.21.15.80:0/3974223598 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d2c06d740 0x7f4d2c147f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:27.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.368+0000 7f4d2b400700 1 -- 172.21.15.80:0/3974223598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d2c0ce370 msgr2=0x7f4d2c1e7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:27.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.368+0000 7f4d2b400700 1 --2- 172.21.15.80:0/3974223598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d2c0ce370 0x7f4d2c1e7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:27.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.368+0000 7f4d2b400700 1 -- 172.21.15.80:0/3974223598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d180094a0 con 0x7f4d2c15e9e0 2024-05-10T04:23:27.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.368+0000 7f4d2b400700 1 --2- 172.21.15.80:0/3974223598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c15e9e0 0x7f4d2c159900 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4d24009d30 tx=0x7f4d2400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:27.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.368+0000 7f4d23400700 1 -- 172.21.15.80:0/3974223598 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2400cc90 con 0x7f4d2c15e9e0 2024-05-10T04:23:27.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.368+0000 7f4d23400700 1 -- 172.21.15.80:0/3974223598 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2400f040 con 0x7f4d2c15e9e0 2024-05-10T04:23:27.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.368+0000 7f4d31e00700 1 -- 172.21.15.80:0/3974223598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c1e8a00 con 0x7f4d2c15e9e0 2024-05-10T04:23:27.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.368+0000 7f4d23400700 1 -- 172.21.15.80:0/3974223598 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d24009e80 con 0x7f4d2c15e9e0 2024-05-10T04:23:27.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.369+0000 7f4d31e00700 1 -- 172.21.15.80:0/3974223598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2c1e8fc0 con 0x7f4d2c15e9e0 2024-05-10T04:23:27.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.369+0000 7f4d31e00700 1 -- 172.21.15.80:0/3974223598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2c0d0990 con 0x7f4d2c15e9e0 2024-05-10T04:23:27.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.370+0000 7f4d23400700 1 -- 172.21.15.80:0/3974223598 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4d24014480 con 0x7f4d2c15e9e0 2024-05-10T04:23:27.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.371+0000 7f4d23400700 1 --2- 172.21.15.80:0/3974223598 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f4d0c06ac90 0x7f4d0c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:27.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.371+0000 7f4d23400700 1 -- 172.21.15.80:0/3974223598 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4d24089c40 con 0x7f4d2c15e9e0 2024-05-10T04:23:27.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.372+0000 7f4d2aa00700 1 --2- 172.21.15.80:0/3974223598 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f4d0c06ac90 0x7f4d0c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:27.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.372+0000 7f4d2aa00700 1 --2- 172.21.15.80:0/3974223598 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f4d0c06ac90 0x7f4d0c06d1a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c000f60 tx=0x7f4d1c007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:27.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.376+0000 7f4d23400700 1 -- 172.21.15.80:0/3974223598 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4d24054d00 con 0x7f4d2c15e9e0 2024-05-10T04:23:27.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.582+0000 7f4d31e00700 1 -- 172.21.15.80:0/3974223598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d2c1e97c0 con 0x7f4d2c15e9e0 2024-05-10T04:23:27.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.584+0000 7f4d23400700 1 -- 172.21.15.80:0/3974223598 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16286 (secure 0 0 0) 0x7f4d2c1e97c0 con 0x7f4d2c15e9e0 2024-05-10T04:23:27.585 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:27.585 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:23:20.092453+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:23:27.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.586+0000 7f4d31e00700 1 -- 172.21.15.80:0/3974223598 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f4d0c06ac90 msgr2=0x7f4d0c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:27.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.586+0000 7f4d31e00700 1 --2- 172.21.15.80:0/3974223598 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f4d0c06ac90 0x7f4d0c06d1a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c000f60 tx=0x7f4d1c007e70 comp rx=0 tx=0).stop 2024-05-10T04:23:27.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.586+0000 7f4d31e00700 1 -- 172.21.15.80:0/3974223598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c15e9e0 msgr2=0x7f4d2c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:27.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.586+0000 7f4d31e00700 1 --2- 172.21.15.80:0/3974223598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c15e9e0 0x7f4d2c159900 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4d24009d30 tx=0x7f4d2400c3a0 comp rx=0 tx=0).stop 2024-05-10T04:23:27.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.586+0000 7f4d31e00700 1 -- 172.21.15.80:0/3974223598 shutdown_connections 2024-05-10T04:23:27.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.586+0000 7f4d31e00700 1 --2- 172.21.15.80:0/3974223598 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f4d0c06ac90 0x7f4d0c06d1a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:27.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.586+0000 7f4d31e00700 1 --2- 172.21.15.80:0/3974223598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c15e9e0 0x7f4d2c159900 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:27.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.586+0000 7f4d31e00700 1 --2- 172.21.15.80:0/3974223598 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d2c06d740 0x7f4d2c147f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:27.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.586+0000 7f4d31e00700 1 --2- 172.21.15.80:0/3974223598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d2c0ce370 0x7f4d2c1e7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:27.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.586+0000 7f4d31e00700 1 -- 172.21.15.80:0/3974223598 >> 172.21.15.80:0/3974223598 conn(0x7f4d2c06f810 msgr2=0x7f4d2c15fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:27.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.586+0000 7f4d31e00700 1 -- 172.21.15.80:0/3974223598 shutdown_connections 2024-05-10T04:23:27.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.586+0000 7f4d31e00700 1 -- 172.21.15.80:0/3974223598 wait complete. 2024-05-10T04:23:27.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:22:26.793377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:22:35.751764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:22:36.465587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:23:27.620 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:23:27.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.883+0000 7f9821800700 1 Processor -- start 2024-05-10T04:23:27.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.883+0000 7f9821800700 1 -- start start 2024-05-10T04:23:27.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.885+0000 7f9821800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f981c15e610 0x7f981c0b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:27.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.885+0000 7f9821800700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f981c0b7910 0x7f981c06c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:27.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.885+0000 7f9821800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981c0d2c00 con 0x7f981c162150 2024-05-10T04:23:27.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.885+0000 7f9821800700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981c15ea20 con 0x7f981c15e610 2024-05-10T04:23:27.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.885+0000 7f9821800700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981c162630 con 0x7f981c0b7910 2024-05-10T04:23:27.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.885+0000 7f981a000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f981c15e610 0x7f981c0b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:27.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.885+0000 7f981aa00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f981c162150 0x7f981c0cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41500/0 (socket says 172.21.15.80:41500) 2024-05-10T04:23:27.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.885+0000 7f981a000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f981c15e610 0x7f981c0b73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55806/0 (socket says 172.21.15.80:55806) 2024-05-10T04:23:27.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.885+0000 7f981aa00700 1 -- 172.21.15.80:0/3444664541 learned_addr learned my addr 172.21.15.80:0/3444664541 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:27.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.885+0000 7f981b400700 1 --2- 172.21.15.80:0/3444664541 >> v2:172.21.15.106:3300/0 conn(0x7f981c0b7910 0x7f981c06c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:27.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.886+0000 7f981a000700 1 -- 172.21.15.80:0/3444664541 >> v2:172.21.15.106:3300/0 conn(0x7f981c0b7910 msgr2=0x7f981c06c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:27.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.886+0000 7f981a000700 1 --2- 172.21.15.80:0/3444664541 >> v2:172.21.15.106:3300/0 conn(0x7f981c0b7910 0x7f981c06c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:27.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.886+0000 7f981a000700 1 -- 172.21.15.80:0/3444664541 >> v1:172.21.15.80:6789/0 conn(0x7f981c162150 legacy=0x7f981c0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:27.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.886+0000 7f981a000700 1 -- 172.21.15.80:0/3444664541 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c162910 con 0x7f981c15e610 2024-05-10T04:23:27.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.886+0000 7f981a000700 1 --2- 172.21.15.80:0/3444664541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c15e610 0x7f981c0b73d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f981c0d0120 tx=0x7f9808009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314d58265477e480 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:27.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.886+0000 7f9819600700 1 -- 172.21.15.80:0/3444664541 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808011830 con 0x7f981c15e610 2024-05-10T04:23:27.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.886+0000 7f9819600700 1 -- 172.21.15.80:0/3444664541 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9808011990 con 0x7f981c15e610 2024-05-10T04:23:27.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.886+0000 7f9819600700 1 -- 172.21.15.80:0/3444664541 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808011d20 con 0x7f981c15e610 2024-05-10T04:23:27.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.887+0000 7f9821800700 1 -- 172.21.15.80:0/3444664541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c15e610 msgr2=0x7f981c0b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:27.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.887+0000 7f9821800700 1 --2- 172.21.15.80:0/3444664541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c15e610 0x7f981c0b73d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f981c0d0120 tx=0x7f9808009b20 comp rx=0 tx=0).stop 2024-05-10T04:23:27.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.887+0000 7f9821800700 1 -- 172.21.15.80:0/3444664541 shutdown_connections 2024-05-10T04:23:27.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.887+0000 7f9821800700 1 --2- 172.21.15.80:0/3444664541 >> v2:172.21.15.106:3300/0 conn(0x7f981c0b7910 0x7f981c06c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:27.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.887+0000 7f9821800700 1 --2- 172.21.15.80:0/3444664541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c15e610 0x7f981c0b73d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:27.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.887+0000 7f9821800700 1 -- 172.21.15.80:0/3444664541 >> 172.21.15.80:0/3444664541 conn(0x7f981c0d3e10 msgr2=0x7f981c0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:27.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.887+0000 7f9821800700 1 -- 172.21.15.80:0/3444664541 shutdown_connections 2024-05-10T04:23:27.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.887+0000 7f9821800700 1 -- 172.21.15.80:0/3444664541 wait complete. 2024-05-10T04:23:27.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.890+0000 7f9821800700 1 Processor -- start 2024-05-10T04:23:27.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.890+0000 7f9821800700 1 -- start start 2024-05-10T04:23:27.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.892+0000 7f9821800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f981c0b7910 0x7f981c14c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:27.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.892+0000 7f9821800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f981c15e610 0x7f981c160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:27.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.892+0000 7f9821800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c162150 0x7f981c15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:27.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.892+0000 7f9821800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c1560f0 con 0x7f981c162150 2024-05-10T04:23:27.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.892+0000 7f9821800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c15fab0 con 0x7f981c0b7910 2024-05-10T04:23:27.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.892+0000 7f9821800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981c1e8960 con 0x7f981c15e610 2024-05-10T04:23:27.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.892+0000 7f981b400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c162150 0x7f981c15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:27.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.892+0000 7f981b400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c162150 0x7f981c15ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55812/0 (socket says 172.21.15.80:55812) 2024-05-10T04:23:27.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.892+0000 7f981aa00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f981c0b7910 0x7f981c14c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:27.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.892+0000 7f981b400700 1 -- 172.21.15.80:0/95461460 learned_addr learned my addr 172.21.15.80:0/95461460 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:27.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.892+0000 7f981a000700 1 --2- 172.21.15.80:0/95461460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f981c15e610 0x7f981c160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:27.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.893+0000 7f981b400700 1 -- 172.21.15.80:0/95461460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f981c15e610 msgr2=0x7f981c160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:27.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.893+0000 7f981b400700 1 --2- 172.21.15.80:0/95461460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f981c15e610 0x7f981c160800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:27.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.893+0000 7f981b400700 1 -- 172.21.15.80:0/95461460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f981c0b7910 msgr2=0x7f981c14c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:27.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.893+0000 7f981b400700 1 --2- 172.21.15.80:0/95461460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f981c0b7910 0x7f981c14c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:27.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.893+0000 7f981b400700 1 -- 172.21.15.80:0/95461460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98080094a0 con 0x7f981c162150 2024-05-10T04:23:27.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.893+0000 7f981b400700 1 --2- 172.21.15.80:0/95461460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c162150 0x7f981c15ec50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9814009d30 tx=0x7f981400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:27.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.893+0000 7f9812a00700 1 -- 172.21.15.80:0/95461460 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981400cc90 con 0x7f981c162150 2024-05-10T04:23:27.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.893+0000 7f9812a00700 1 -- 172.21.15.80:0/95461460 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981400f040 con 0x7f981c162150 2024-05-10T04:23:27.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.893+0000 7f9812a00700 1 -- 172.21.15.80:0/95461460 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814009e80 con 0x7f981c162150 2024-05-10T04:23:27.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.893+0000 7f9821800700 1 -- 172.21.15.80:0/95461460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981c1e97c0 con 0x7f981c162150 2024-05-10T04:23:27.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.893+0000 7f9821800700 1 -- 172.21.15.80:0/95461460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981c1e8e90 con 0x7f981c162150 2024-05-10T04:23:27.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.894+0000 7f9821800700 1 -- 172.21.15.80:0/95461460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981c074af0 con 0x7f981c162150 2024-05-10T04:23:27.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.895+0000 7f9812a00700 1 -- 172.21.15.80:0/95461460 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9814014480 con 0x7f981c162150 2024-05-10T04:23:27.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.896+0000 7f9812a00700 1 --2- 172.21.15.80:0/95461460 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f97fc06acc0 0x7f97fc06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:27.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.896+0000 7f9812a00700 1 -- 172.21.15.80:0/95461460 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9814089c60 con 0x7f981c162150 2024-05-10T04:23:27.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.897+0000 7f981aa00700 1 --2- 172.21.15.80:0/95461460 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f97fc06acc0 0x7f97fc06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:27.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.897+0000 7f981aa00700 1 --2- 172.21.15.80:0/95461460 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f97fc06acc0 0x7f97fc06d1d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f980c005910 tx=0x7f980c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:27.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:27.901+0000 7f9812a00700 1 -- 172.21.15.80:0/95461460 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9814054c90 con 0x7f981c162150 2024-05-10T04:23:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.104+0000 7f9821800700 1 -- 172.21.15.80:0/95461460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f981c161ec0 con 0x7f981c162150 2024-05-10T04:23:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.104+0000 7f9812a00700 1 -- 172.21.15.80:0/95461460 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9814018070 con 0x7f981c162150 2024-05-10T04:23:28.106 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-10T04:23:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.107+0000 7f9821800700 1 -- 172.21.15.80:0/95461460 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f97fc06acc0 msgr2=0x7f97fc06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.107+0000 7f9821800700 1 --2- 172.21.15.80:0/95461460 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f97fc06acc0 0x7f97fc06d1d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f980c005910 tx=0x7f980c009040 comp rx=0 tx=0).stop 2024-05-10T04:23:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.107+0000 7f9821800700 1 -- 172.21.15.80:0/95461460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c162150 msgr2=0x7f981c15ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.107+0000 7f9821800700 1 --2- 172.21.15.80:0/95461460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c162150 0x7f981c15ec50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9814009d30 tx=0x7f981400c3a0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.107+0000 7f9821800700 1 -- 172.21.15.80:0/95461460 shutdown_connections 2024-05-10T04:23:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.107+0000 7f9821800700 1 --2- 172.21.15.80:0/95461460 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f97fc06acc0 0x7f97fc06d1d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.107+0000 7f9821800700 1 --2- 172.21.15.80:0/95461460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c162150 0x7f981c15ec50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.107+0000 7f9821800700 1 --2- 172.21.15.80:0/95461460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f981c0b7910 0x7f981c14c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.107+0000 7f9821800700 1 --2- 172.21.15.80:0/95461460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f981c15e610 0x7f981c160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.107+0000 7f9821800700 1 -- 172.21.15.80:0/95461460 >> 172.21.15.80:0/95461460 conn(0x7f981c0d3e10 msgr2=0x7f981c0b4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.107+0000 7f9821800700 1 -- 172.21.15.80:0/95461460 shutdown_connections 2024-05-10T04:23:28.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.107+0000 7f9821800700 1 -- 172.21.15.80:0/95461460 wait complete. 2024-05-10T04:23:28.133 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:23:28.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.396+0000 7f0b84a00700 1 Processor -- start 2024-05-10T04:23:28.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.397+0000 7f0b84a00700 1 -- start start 2024-05-10T04:23:28.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.398+0000 7f0b84a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0b80162a10 0x7f0b800b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:28.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.398+0000 7f0b84a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b800d0a00 0x7f0b800d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:28.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.398+0000 7f0b84a00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b80162e20 con 0x7f0b8015f610 2024-05-10T04:23:28.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.398+0000 7f0b84a00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b800b34c0 con 0x7f0b80162a10 2024-05-10T04:23:28.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.398+0000 7f0b84a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b800d1350 con 0x7f0b800d0a00 2024-05-10T04:23:28.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.399+0000 7f0b7de00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0b80162a10 0x7f0b800b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:28.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.399+0000 7f0b7de00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0b80162a10 0x7f0b800b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55816/0 (socket says 172.21.15.80:55816) 2024-05-10T04:23:28.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.399+0000 7f0b7de00700 1 -- 172.21.15.80:0/350245978 learned_addr learned my addr 172.21.15.80:0/350245978 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:28.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.399+0000 7f0b7f200700 1 --2- 172.21.15.80:0/350245978 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b800d0a00 0x7f0b800d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:28.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.399+0000 7f0b7de00700 1 -- 172.21.15.80:0/350245978 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b800d0a00 msgr2=0x7f0b800d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:28.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.399+0000 7f0b7de00700 1 --2- 172.21.15.80:0/350245978 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b800d0a00 0x7f0b800d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.399+0000 7f0b7de00700 1 -- 172.21.15.80:0/350245978 >> v1:172.21.15.106:6789/0 conn(0x7f0b8015f610 legacy=0x7f0b800cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:28.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.399+0000 7f0b7de00700 1 -- 172.21.15.80:0/350245978 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b800cf160 con 0x7f0b80162a10 2024-05-10T04:23:28.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.400+0000 7f0b7de00700 1 --2- 172.21.15.80:0/350245978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b80162a10 0x7f0b800b2f80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0b800b3600 tx=0x7f0b6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abdda8e29b817674 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:28.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.400+0000 7f0b7d400700 1 -- 172.21.15.80:0/350245978 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c004230 con 0x7f0b80162a10 2024-05-10T04:23:28.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.400+0000 7f0b7d400700 1 -- 172.21.15.80:0/350245978 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c004390 con 0x7f0b80162a10 2024-05-10T04:23:28.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.400+0000 7f0b7d400700 1 -- 172.21.15.80:0/350245978 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c0036a0 con 0x7f0b80162a10 2024-05-10T04:23:28.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.401+0000 7f0b84a00700 1 -- 172.21.15.80:0/350245978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b80162a10 msgr2=0x7f0b800b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:28.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.401+0000 7f0b84a00700 1 --2- 172.21.15.80:0/350245978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b80162a10 0x7f0b800b2f80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0b800b3600 tx=0x7f0b6c009bd0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.401+0000 7f0b84a00700 1 -- 172.21.15.80:0/350245978 shutdown_connections 2024-05-10T04:23:28.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.401+0000 7f0b84a00700 1 --2- 172.21.15.80:0/350245978 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b800d0a00 0x7f0b800d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.401+0000 7f0b84a00700 1 --2- 172.21.15.80:0/350245978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b80162a10 0x7f0b800b2f80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.401+0000 7f0b84a00700 1 -- 172.21.15.80:0/350245978 >> 172.21.15.80:0/350245978 conn(0x7f0b8006c4e0 msgr2=0x7f0b8006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:28.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.401+0000 7f0b84a00700 1 -- 172.21.15.80:0/350245978 shutdown_connections 2024-05-10T04:23:28.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.401+0000 7f0b84a00700 1 -- 172.21.15.80:0/350245978 wait complete. 2024-05-10T04:23:28.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.403+0000 7f0b84a00700 1 Processor -- start 2024-05-10T04:23:28.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.403+0000 7f0b84a00700 1 -- start start 2024-05-10T04:23:28.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.404+0000 7f0b84a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b800d0a00 0x7f0b800cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:28.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.404+0000 7f0b84a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b8015f610 0x7f0b800b5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:28.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.405+0000 7f0b84a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b80162a10 0x7f0b800b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:28.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.405+0000 7f0b84a00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b801f6960 con 0x7f0b8015f610 2024-05-10T04:23:28.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.405+0000 7f0b84a00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b801f4330 con 0x7f0b800d0a00 2024-05-10T04:23:28.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.405+0000 7f0b84a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b801f5190 con 0x7f0b80162a10 2024-05-10T04:23:28.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.405+0000 7f0b7de00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b8015f610 0x7f0b800b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:28.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.405+0000 7f0b7de00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b8015f610 0x7f0b800b5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55830/0 (socket says 172.21.15.80:55830) 2024-05-10T04:23:28.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.405+0000 7f0b7de00700 1 -- 172.21.15.80:0/2550801087 learned_addr learned my addr 172.21.15.80:0/2550801087 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:28.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.405+0000 7f0b7f200700 1 --2- 172.21.15.80:0/2550801087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b80162a10 0x7f0b800b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:28.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.405+0000 7f0b7e800700 1 --2- 172.21.15.80:0/2550801087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b800d0a00 0x7f0b800cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:28.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.405+0000 7f0b7de00700 1 -- 172.21.15.80:0/2550801087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b80162a10 msgr2=0x7f0b800b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:28.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.405+0000 7f0b7de00700 1 --2- 172.21.15.80:0/2550801087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b80162a10 0x7f0b800b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.405+0000 7f0b7de00700 1 -- 172.21.15.80:0/2550801087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b800d0a00 msgr2=0x7f0b800cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:28.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.405+0000 7f0b7de00700 1 --2- 172.21.15.80:0/2550801087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b800d0a00 0x7f0b800cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.405+0000 7f0b7de00700 1 -- 172.21.15.80:0/2550801087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c009550 con 0x7f0b8015f610 2024-05-10T04:23:28.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.405+0000 7f0b7de00700 1 --2- 172.21.15.80:0/2550801087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b8015f610 0x7f0b800b5800 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009130 tx=0x7f0b6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:28.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.406+0000 7f0b76a00700 1 -- 172.21.15.80:0/2550801087 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c003e20 con 0x7f0b8015f610 2024-05-10T04:23:28.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.406+0000 7f0b76a00700 1 -- 172.21.15.80:0/2550801087 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c00b670 con 0x7f0b8015f610 2024-05-10T04:23:28.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.406+0000 7f0b84a00700 1 -- 172.21.15.80:0/2550801087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b801f4580 con 0x7f0b8015f610 2024-05-10T04:23:28.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.406+0000 7f0b76a00700 1 -- 172.21.15.80:0/2550801087 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c00ba20 con 0x7f0b8015f610 2024-05-10T04:23:28.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.406+0000 7f0b84a00700 1 -- 172.21.15.80:0/2550801087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b801f4b40 con 0x7f0b8015f610 2024-05-10T04:23:28.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.407+0000 7f0b84a00700 1 -- 172.21.15.80:0/2550801087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b80074af0 con 0x7f0b8015f610 2024-05-10T04:23:28.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.408+0000 7f0b76a00700 1 -- 172.21.15.80:0/2550801087 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0b6c021020 con 0x7f0b8015f610 2024-05-10T04:23:28.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.409+0000 7f0b76a00700 1 --2- 172.21.15.80:0/2550801087 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0b6006acc0 0x7f0b6006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:28.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.409+0000 7f0b76a00700 1 -- 172.21.15.80:0/2550801087 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0b6c08a980 con 0x7f0b8015f610 2024-05-10T04:23:28.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.409+0000 7f0b7e800700 1 --2- 172.21.15.80:0/2550801087 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0b6006acc0 0x7f0b6006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:28.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.410+0000 7f0b7e800700 1 --2- 172.21.15.80:0/2550801087 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0b6006acc0 0x7f0b6006d1d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0b70000f60 tx=0x7f0b70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:28.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.414+0000 7f0b76a00700 1 -- 172.21.15.80:0/2550801087 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0b6c055b70 con 0x7f0b8015f610 2024-05-10T04:23:28.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.615+0000 7f0b84a00700 1 -- 172.21.15.80:0/2550801087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b801f52d0 con 0x7f0b8015f610 2024-05-10T04:23:28.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.616+0000 7f0b76a00700 1 -- 172.21.15.80:0/2550801087 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0b6c029020 con 0x7f0b8015f610 2024-05-10T04:23:28.617 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-10T04:23:28.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.618+0000 7f0b84a00700 1 -- 172.21.15.80:0/2550801087 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0b6006acc0 msgr2=0x7f0b6006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:28.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.618+0000 7f0b84a00700 1 --2- 172.21.15.80:0/2550801087 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0b6006acc0 0x7f0b6006d1d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0b70000f60 tx=0x7f0b70009040 comp rx=0 tx=0).stop 2024-05-10T04:23:28.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.618+0000 7f0b84a00700 1 -- 172.21.15.80:0/2550801087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b8015f610 msgr2=0x7f0b800b5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:28.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.618+0000 7f0b84a00700 1 --2- 172.21.15.80:0/2550801087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b8015f610 0x7f0b800b5800 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009130 tx=0x7f0b6c004750 comp rx=0 tx=0).stop 2024-05-10T04:23:28.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.618+0000 7f0b84a00700 1 -- 172.21.15.80:0/2550801087 shutdown_connections 2024-05-10T04:23:28.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.618+0000 7f0b84a00700 1 --2- 172.21.15.80:0/2550801087 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0b6006acc0 0x7f0b6006d1d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.619+0000 7f0b84a00700 1 --2- 172.21.15.80:0/2550801087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b80162a10 0x7f0b800b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.619+0000 7f0b84a00700 1 --2- 172.21.15.80:0/2550801087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b800d0a00 0x7f0b800cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.619+0000 7f0b84a00700 1 --2- 172.21.15.80:0/2550801087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b8015f610 0x7f0b800b5800 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.619+0000 7f0b84a00700 1 -- 172.21.15.80:0/2550801087 >> 172.21.15.80:0/2550801087 conn(0x7f0b8006c4e0 msgr2=0x7f0b800d3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:28.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.619+0000 7f0b84a00700 1 -- 172.21.15.80:0/2550801087 shutdown_connections 2024-05-10T04:23:28.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.619+0000 7f0b84a00700 1 -- 172.21.15.80:0/2550801087 wait complete. 2024-05-10T04:23:28.645 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:23:28.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.909+0000 7f44d1c00700 1 Processor -- start 2024-05-10T04:23:28.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.909+0000 7f44d1c00700 1 -- start start 2024-05-10T04:23:28.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.910+0000 7f44d1c00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f44cc162150 0x7f44cc15e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:28.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.910+0000 7f44d1c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44cc0cf4d0 0x7f44cc0b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:28.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.911+0000 7f44d1c00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44cc0d2c00 con 0x7f44cc0b7910 2024-05-10T04:23:28.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.911+0000 7f44d1c00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44cc162630 con 0x7f44cc162150 2024-05-10T04:23:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.911+0000 7f44d1c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc162910 con 0x7f44cc0cf4d0 2024-05-10T04:23:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.911+0000 7f44caa00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f44cc162150 0x7f44cc15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.911+0000 7f44ca000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44cc0cf4d0 0x7f44cc0b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.911+0000 7f44caa00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f44cc162150 0x7f44cc15e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:36876/0 (socket says 172.21.15.80:36876) 2024-05-10T04:23:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.911+0000 7f44ca000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44cc0cf4d0 0x7f44cc0b73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:46380/0 (socket says 172.21.15.80:46380) 2024-05-10T04:23:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.911+0000 7f44caa00700 1 -- 172.21.15.80:0/2686104540 learned_addr learned my addr 172.21.15.80:0/2686104540 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.911+0000 7f44cb400700 1 --1- 172.21.15.80:0/2686104540 >> v1:172.21.15.106:6789/0 conn(0x7f44cc0b7910 0x7f44cc06c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:60078/0 (socket says 172.21.15.80:60078) 2024-05-10T04:23:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.912+0000 7f44ca000700 1 -- 172.21.15.80:0/2686104540 >> v2:172.21.15.106:3300/0 conn(0x7f44cc162150 msgr2=0x7f44cc15e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.912+0000 7f44ca000700 1 --2- 172.21.15.80:0/2686104540 >> v2:172.21.15.106:3300/0 conn(0x7f44cc162150 0x7f44cc15e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.912+0000 7f44ca000700 1 -- 172.21.15.80:0/2686104540 >> v1:172.21.15.106:6789/0 conn(0x7f44cc0b7910 legacy=0x7f44cc06c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.912+0000 7f44ca000700 1 -- 172.21.15.80:0/2686104540 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc162bf0 con 0x7f44cc0cf4d0 2024-05-10T04:23:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.912+0000 7f44caa00700 1 --2- 172.21.15.80:0/2686104540 >> v2:172.21.15.106:3300/0 conn(0x7f44cc162150 0x7f44cc15e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:23:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.912+0000 7f44ca000700 1 --2- 172.21.15.80:0/2686104540 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44cc0cf4d0 0x7f44cc0b73d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009840 tx=0x7f44b8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f905ce24742e159f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.912+0000 7f44c9600700 1 -- 172.21.15.80:0/2686104540 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8011830 con 0x7f44cc0cf4d0 2024-05-10T04:23:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.912+0000 7f44c9600700 1 -- 172.21.15.80:0/2686104540 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b8011990 con 0x7f44cc0cf4d0 2024-05-10T04:23:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.912+0000 7f44c9600700 1 -- 172.21.15.80:0/2686104540 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8011d20 con 0x7f44cc0cf4d0 2024-05-10T04:23:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.913+0000 7f44d1c00700 1 -- 172.21.15.80:0/2686104540 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44cc0cf4d0 msgr2=0x7f44cc0b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.913+0000 7f44d1c00700 1 --2- 172.21.15.80:0/2686104540 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44cc0cf4d0 0x7f44cc0b73d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009840 tx=0x7f44b8009b50 comp rx=0 tx=0).stop 2024-05-10T04:23:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.913+0000 7f44d1c00700 1 -- 172.21.15.80:0/2686104540 shutdown_connections 2024-05-10T04:23:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.913+0000 7f44d1c00700 1 --2- 172.21.15.80:0/2686104540 >> v2:172.21.15.106:3300/0 conn(0x7f44cc162150 0x7f44cc15e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.913+0000 7f44d1c00700 1 --2- 172.21.15.80:0/2686104540 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44cc0cf4d0 0x7f44cc0b73d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.913+0000 7f44d1c00700 1 -- 172.21.15.80:0/2686104540 >> 172.21.15.80:0/2686104540 conn(0x7f44cc0d3e10 msgr2=0x7f44cc0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.913+0000 7f44d1c00700 1 -- 172.21.15.80:0/2686104540 shutdown_connections 2024-05-10T04:23:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.913+0000 7f44d1c00700 1 -- 172.21.15.80:0/2686104540 wait complete. 2024-05-10T04:23:28.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.915+0000 7f44d1c00700 1 Processor -- start 2024-05-10T04:23:28.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.916+0000 7f44d1c00700 1 -- start start 2024-05-10T04:23:28.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.917+0000 7f44d1c00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44cc0b7910 0x7f44cc0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:28.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.917+0000 7f44d1c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44cc0cf4d0 0x7f44cc158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:28.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.917+0000 7f44d1c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44cc162150 0x7f44cc14ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:28.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.917+0000 7f44d1c00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc1f7870 con 0x7f44cc0cf4d0 2024-05-10T04:23:28.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.917+0000 7f44d1c00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc0c8690 con 0x7f44cc0b7910 2024-05-10T04:23:28.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.917+0000 7f44d1c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc1f60a0 con 0x7f44cc162150 2024-05-10T04:23:28.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.917+0000 7f44ca000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44cc0cf4d0 0x7f44cc158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:28.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.918+0000 7f44ca000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44cc0cf4d0 0x7f44cc158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55840/0 (socket says 172.21.15.80:55840) 2024-05-10T04:23:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.918+0000 7f44ca000700 1 -- 172.21.15.80:0/133491205 learned_addr learned my addr 172.21.15.80:0/133491205 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.918+0000 7f44caa00700 1 --2- 172.21.15.80:0/133491205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44cc0b7910 0x7f44cc0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.918+0000 7f44cb400700 1 --2- 172.21.15.80:0/133491205 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44cc162150 0x7f44cc14ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.918+0000 7f44ca000700 1 -- 172.21.15.80:0/133491205 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44cc162150 msgr2=0x7f44cc14ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.918+0000 7f44ca000700 1 --2- 172.21.15.80:0/133491205 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44cc162150 0x7f44cc14ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.918+0000 7f44ca000700 1 -- 172.21.15.80:0/133491205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44cc0b7910 msgr2=0x7f44cc0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.918+0000 7f44ca000700 1 --2- 172.21.15.80:0/133491205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44cc0b7910 0x7f44cc0c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.918+0000 7f44ca000700 1 -- 172.21.15.80:0/133491205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc009550 con 0x7f44cc0cf4d0 2024-05-10T04:23:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.918+0000 7f44cb400700 1 --2- 172.21.15.80:0/133491205 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44cc162150 0x7f44cc14ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.918+0000 7f44ca000700 1 --2- 172.21.15.80:0/133491205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44cc0cf4d0 0x7f44cc158520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009fd0 tx=0x7f44b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.919+0000 7f44c2a00700 1 -- 172.21.15.80:0/133491205 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b80036a0 con 0x7f44cc0cf4d0 2024-05-10T04:23:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.919+0000 7f44c2a00700 1 -- 172.21.15.80:0/133491205 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b801e070 con 0x7f44cc0cf4d0 2024-05-10T04:23:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.919+0000 7f44d1c00700 1 -- 172.21.15.80:0/133491205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b80094a0 con 0x7f44cc0cf4d0 2024-05-10T04:23:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.919+0000 7f44c2a00700 1 -- 172.21.15.80:0/133491205 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8003a40 con 0x7f44cc0cf4d0 2024-05-10T04:23:28.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.919+0000 7f44d1c00700 1 -- 172.21.15.80:0/133491205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44cc0c88e0 con 0x7f44cc0cf4d0 2024-05-10T04:23:28.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.920+0000 7f44d1c00700 1 -- 172.21.15.80:0/133491205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44cc1f6250 con 0x7f44cc0cf4d0 2024-05-10T04:23:28.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.921+0000 7f44c2a00700 1 -- 172.21.15.80:0/133491205 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f44b8003ba0 con 0x7f44cc0cf4d0 2024-05-10T04:23:28.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.922+0000 7f44c2a00700 1 --2- 172.21.15.80:0/133491205 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44ac06acc0 0x7f44ac06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:28.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.922+0000 7f44c2a00700 1 -- 172.21.15.80:0/133491205 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f44b808a350 con 0x7f44cc0cf4d0 2024-05-10T04:23:28.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.923+0000 7f44caa00700 1 --2- 172.21.15.80:0/133491205 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44ac06acc0 0x7f44ac06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:28.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.923+0000 7f44caa00700 1 --2- 172.21.15.80:0/133491205 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44ac06acc0 0x7f44ac06d1d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f44bc006d50 tx=0x7f44bc0092c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:28.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:28.927+0000 7f44c2a00700 1 -- 172.21.15.80:0/133491205 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f44cc1f6250 con 0x7f44cc0cf4d0 2024-05-10T04:23:29.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.132+0000 7f44d1c00700 1 -- 172.21.15.80:0/133491205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44cc1f6250 con 0x7f44cc0cf4d0 2024-05-10T04:23:29.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.133+0000 7f44c2a00700 1 -- 172.21.15.80:0/133491205 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44cc1f6250 con 0x7f44cc0cf4d0 2024-05-10T04:23:29.134 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-10T04:23:29.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.135+0000 7f44d1c00700 1 -- 172.21.15.80:0/133491205 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44ac06acc0 msgr2=0x7f44ac06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:29.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.135+0000 7f44d1c00700 1 --2- 172.21.15.80:0/133491205 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44ac06acc0 0x7f44ac06d1d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f44bc006d50 tx=0x7f44bc0092c0 comp rx=0 tx=0).stop 2024-05-10T04:23:29.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.135+0000 7f44d1c00700 1 -- 172.21.15.80:0/133491205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44cc0cf4d0 msgr2=0x7f44cc158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:29.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.135+0000 7f44d1c00700 1 --2- 172.21.15.80:0/133491205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44cc0cf4d0 0x7f44cc158520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009fd0 tx=0x7f44b8004750 comp rx=0 tx=0).stop 2024-05-10T04:23:29.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.135+0000 7f44d1c00700 1 -- 172.21.15.80:0/133491205 shutdown_connections 2024-05-10T04:23:29.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.135+0000 7f44d1c00700 1 --2- 172.21.15.80:0/133491205 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44ac06acc0 0x7f44ac06d1d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:29.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.135+0000 7f44d1c00700 1 --2- 172.21.15.80:0/133491205 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44cc162150 0x7f44cc14ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:29.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.135+0000 7f44d1c00700 1 --2- 172.21.15.80:0/133491205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44cc0b7910 0x7f44cc0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:29.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.135+0000 7f44d1c00700 1 --2- 172.21.15.80:0/133491205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44cc0cf4d0 0x7f44cc158520 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:29.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.135+0000 7f44d1c00700 1 -- 172.21.15.80:0/133491205 >> 172.21.15.80:0/133491205 conn(0x7f44cc0d3e10 msgr2=0x7f44cc06c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:29.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.135+0000 7f44d1c00700 1 -- 172.21.15.80:0/133491205 shutdown_connections 2024-05-10T04:23:29.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.135+0000 7f44d1c00700 1 -- 172.21.15.80:0/133491205 wait complete. 2024-05-10T04:23:29.165 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T04:23:29.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.425+0000 7f05c8400700 1 Processor -- start 2024-05-10T04:23:29.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.426+0000 7f05c8400700 1 -- start start 2024-05-10T04:23:29.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.427+0000 7f05c8400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f05c0162150 0x7f05c015e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:29.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.427+0000 7f05c8400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05c006c160 0x7f05c006c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:29.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.427+0000 7f05c8400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c00d2c00 con 0x7f05c00cf4d0 2024-05-10T04:23:29.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.427+0000 7f05c8400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c006cab0 con 0x7f05c0162150 2024-05-10T04:23:29.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.427+0000 7f05c8400700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c0162630 con 0x7f05c006c160 2024-05-10T04:23:29.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.427+0000 7f05c5a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f05c0162150 0x7f05c015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:29.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.428+0000 7f05c5000700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f05c00cf4d0 0x7f05c00b73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41508/0 (socket says 172.21.15.80:41508) 2024-05-10T04:23:29.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.428+0000 7f05c5000700 1 -- 172.21.15.80:0/1621110125 learned_addr learned my addr 172.21.15.80:0/1621110125 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:29.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.428+0000 7f05c6400700 1 --2- 172.21.15.80:0/1621110125 >> v2:172.21.15.106:3300/0 conn(0x7f05c006c160 0x7f05c006c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:29.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.428+0000 7f05c5a00700 1 -- 172.21.15.80:0/1621110125 >> v2:172.21.15.106:3300/0 conn(0x7f05c006c160 msgr2=0x7f05c006c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:29.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.428+0000 7f05c5a00700 1 --2- 172.21.15.80:0/1621110125 >> v2:172.21.15.106:3300/0 conn(0x7f05c006c160 0x7f05c006c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:29.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.428+0000 7f05c5a00700 1 -- 172.21.15.80:0/1621110125 >> v1:172.21.15.80:6789/0 conn(0x7f05c00cf4d0 legacy=0x7f05c00b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:29.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.428+0000 7f05c5a00700 1 -- 172.21.15.80:0/1621110125 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c0162910 con 0x7f05c0162150 2024-05-10T04:23:29.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.428+0000 7f05bfe00700 1 -- 172.21.15.80:0/1621110125 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749136522 0 0) 0x7f05c00d2c00 con 0x7f05c00cf4d0 2024-05-10T04:23:29.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.428+0000 7f05c5a00700 1 --2- 172.21.15.80:0/1621110125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05c0162150 0x7f05c015e610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009840 tx=0x7f05b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ccb5da583b57396 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:29.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.429+0000 7f05bfe00700 1 -- 172.21.15.80:0/1621110125 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4011830 con 0x7f05c0162150 2024-05-10T04:23:29.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.429+0000 7f05bfe00700 1 -- 172.21.15.80:0/1621110125 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b4011990 con 0x7f05c0162150 2024-05-10T04:23:29.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.429+0000 7f05bfe00700 1 -- 172.21.15.80:0/1621110125 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4011d20 con 0x7f05c0162150 2024-05-10T04:23:29.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.429+0000 7f05c8400700 1 -- 172.21.15.80:0/1621110125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05c0162150 msgr2=0x7f05c015e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:29.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.429+0000 7f05c8400700 1 --2- 172.21.15.80:0/1621110125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05c0162150 0x7f05c015e610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009840 tx=0x7f05b4009b50 comp rx=0 tx=0).stop 2024-05-10T04:23:29.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.429+0000 7f05c8400700 1 -- 172.21.15.80:0/1621110125 shutdown_connections 2024-05-10T04:23:29.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.429+0000 7f05c8400700 1 --2- 172.21.15.80:0/1621110125 >> v2:172.21.15.106:3300/0 conn(0x7f05c006c160 0x7f05c006c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:29.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.429+0000 7f05c8400700 1 --2- 172.21.15.80:0/1621110125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05c0162150 0x7f05c015e610 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:29.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.429+0000 7f05c8400700 1 -- 172.21.15.80:0/1621110125 >> 172.21.15.80:0/1621110125 conn(0x7f05c00d3e10 msgr2=0x7f05c00d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:29.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.429+0000 7f05c8400700 1 -- 172.21.15.80:0/1621110125 shutdown_connections 2024-05-10T04:23:29.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.429+0000 7f05c8400700 1 -- 172.21.15.80:0/1621110125 wait complete. 2024-05-10T04:23:29.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.432+0000 7f05c8400700 1 Processor -- start 2024-05-10T04:23:29.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.432+0000 7f05c8400700 1 -- start start 2024-05-10T04:23:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.433+0000 7f05c8400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05c006c160 0x7f05c015ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.433+0000 7f05c8400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05c00cf4d0 0x7f05c0160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.433+0000 7f05c8400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05c0162150 0x7f05c0153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.433+0000 7f05c8400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c0161220 con 0x7f05c0162150 2024-05-10T04:23:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.433+0000 7f05c8400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c015f450 con 0x7f05c006c160 2024-05-10T04:23:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.433+0000 7f05c8400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c015f6a0 con 0x7f05c00cf4d0 2024-05-10T04:23:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.433+0000 7f05c6400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05c0162150 0x7f05c0153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.433+0000 7f05c6400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05c0162150 0x7f05c0153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55862/0 (socket says 172.21.15.80:55862) 2024-05-10T04:23:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.433+0000 7f05c6400700 1 -- 172.21.15.80:0/4252395059 learned_addr learned my addr 172.21.15.80:0/4252395059 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.434+0000 7f05c5a00700 1 --2- 172.21.15.80:0/4252395059 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05c006c160 0x7f05c015ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.434+0000 7f05c5000700 1 --2- 172.21.15.80:0/4252395059 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05c00cf4d0 0x7f05c0160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.434+0000 7f05c6400700 1 -- 172.21.15.80:0/4252395059 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05c00cf4d0 msgr2=0x7f05c0160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:29.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.434+0000 7f05c6400700 1 --2- 172.21.15.80:0/4252395059 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05c00cf4d0 0x7f05c0160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:29.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.434+0000 7f05c6400700 1 -- 172.21.15.80:0/4252395059 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05c006c160 msgr2=0x7f05c015ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:29.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.434+0000 7f05c6400700 1 --2- 172.21.15.80:0/4252395059 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05c006c160 0x7f05c015ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:29.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.434+0000 7f05c6400700 1 -- 172.21.15.80:0/4252395059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b40094a0 con 0x7f05c0162150 2024-05-10T04:23:29.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.434+0000 7f05c5a00700 1 --2- 172.21.15.80:0/4252395059 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05c006c160 0x7f05c015ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:29.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.434+0000 7f05c6400700 1 --2- 172.21.15.80:0/4252395059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05c0162150 0x7f05c0153730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f05b8007d80 tx=0x7f05b800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:29.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.434+0000 7f05bd600700 1 -- 172.21.15.80:0/4252395059 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b800ede0 con 0x7f05c0162150 2024-05-10T04:23:29.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.434+0000 7f05bd600700 1 -- 172.21.15.80:0/4252395059 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b8014420 con 0x7f05c0162150 2024-05-10T04:23:29.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.434+0000 7f05bd600700 1 -- 172.21.15.80:0/4252395059 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b80147d0 con 0x7f05c0162150 2024-05-10T04:23:29.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.434+0000 7f05c8400700 1 -- 172.21.15.80:0/4252395059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c015f980 con 0x7f05c0162150 2024-05-10T04:23:29.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.434+0000 7f05c8400700 1 -- 172.21.15.80:0/4252395059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c0153210 con 0x7f05c0162150 2024-05-10T04:23:29.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.435+0000 7f05c8400700 1 -- 172.21.15.80:0/4252395059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c01533d0 con 0x7f05c0162150 2024-05-10T04:23:29.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.436+0000 7f05bd600700 1 -- 172.21.15.80:0/4252395059 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f05b8014930 con 0x7f05c0162150 2024-05-10T04:23:29.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.437+0000 7f05bd600700 1 --2- 172.21.15.80:0/4252395059 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f05a006acc0 0x7f05a006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:29.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.437+0000 7f05bd600700 1 -- 172.21.15.80:0/4252395059 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f05b8089ad0 con 0x7f05c0162150 2024-05-10T04:23:29.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.438+0000 7f05c5a00700 1 --2- 172.21.15.80:0/4252395059 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f05a006acc0 0x7f05a006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:29.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.439+0000 7f05c5a00700 1 --2- 172.21.15.80:0/4252395059 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f05a006acc0 0x7f05a006d1d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009840 tx=0x7f05b401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:29.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.442+0000 7f05bd600700 1 -- 172.21.15.80:0/4252395059 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f05b8054c20 con 0x7f05c0162150 2024-05-10T04:23:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.660+0000 7f05c8400700 1 -- 172.21.15.80:0/4252395059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f05c0152d90 con 0x7f05c0162150 2024-05-10T04:23:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.660+0000 7f05bd600700 1 -- 172.21.15.80:0/4252395059 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f05c0152d90 con 0x7f05c0162150 2024-05-10T04:23:29.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.662+0000 7f05c8400700 1 -- 172.21.15.80:0/4252395059 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f05a006acc0 msgr2=0x7f05a006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:29.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.662+0000 7f05c8400700 1 --2- 172.21.15.80:0/4252395059 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f05a006acc0 0x7f05a006d1d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009840 tx=0x7f05b401c040 comp rx=0 tx=0).stop 2024-05-10T04:23:29.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.662+0000 7f05c8400700 1 -- 172.21.15.80:0/4252395059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05c0162150 msgr2=0x7f05c0153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:29.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.662+0000 7f05c8400700 1 --2- 172.21.15.80:0/4252395059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05c0162150 0x7f05c0153730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f05b8007d80 tx=0x7f05b800e3c0 comp rx=0 tx=0).stop 2024-05-10T04:23:29.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.663+0000 7f05c8400700 1 -- 172.21.15.80:0/4252395059 shutdown_connections 2024-05-10T04:23:29.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.663+0000 7f05c8400700 1 --2- 172.21.15.80:0/4252395059 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f05a006acc0 0x7f05a006d1d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:29.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.663+0000 7f05c8400700 1 --2- 172.21.15.80:0/4252395059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05c0162150 0x7f05c0153730 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:29.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.663+0000 7f05c8400700 1 --2- 172.21.15.80:0/4252395059 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05c006c160 0x7f05c015ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:29.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.663+0000 7f05c8400700 1 --2- 172.21.15.80:0/4252395059 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05c00cf4d0 0x7f05c0160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:29.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.663+0000 7f05c8400700 1 -- 172.21.15.80:0/4252395059 >> 172.21.15.80:0/4252395059 conn(0x7f05c00d3e10 msgr2=0x7f05c0158d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:29.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.663+0000 7f05c8400700 1 -- 172.21.15.80:0/4252395059 shutdown_connections 2024-05-10T04:23:29.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:29.663+0000 7f05c8400700 1 -- 172.21.15.80:0/4252395059 wait complete. 2024-05-10T04:23:29.665 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-05-10T04:23:29.691 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-10T04:23:29.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:29.691 DEBUG:teuthology.orchestra.run.smithi106:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-05-10T04:23:29.769 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-05-10T04:23:29.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:29.769 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-10T04:23:29.910 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:23:29.910 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:23:29.952 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:23:29.953 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:23:30.034 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:23:30.035 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:23:30.117 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:23:30.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.417+0000 7eff46600700 1 Processor -- start 2024-05-10T04:23:30.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.417+0000 7eff46600700 1 -- start start 2024-05-10T04:23:30.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.418+0000 7eff46600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff400cf220 0x7eff400cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:30.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.418+0000 7eff46600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7eff400d2580 0x7eff400d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:30.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.418+0000 7eff46600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff400d21b0 con 0x7eff400d09d0 2024-05-10T04:23:30.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.418+0000 7eff46600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff400ce840 con 0x7eff400cf220 2024-05-10T04:23:30.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.418+0000 7eff46600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff400d2ed0 con 0x7eff400d2580 2024-05-10T04:23:30.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.419+0000 7eff45200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff400cf220 0x7eff400cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:30.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.419+0000 7eff45200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff400cf220 0x7eff400cf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55874/0 (socket says 172.21.15.80:55874) 2024-05-10T04:23:30.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.419+0000 7eff45200700 1 -- 172.21.15.80:0/3894187788 learned_addr learned my addr 172.21.15.80:0/3894187788 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:30.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.419+0000 7eff45c00700 1 --2- 172.21.15.80:0/3894187788 >> v2:172.21.15.106:3300/0 conn(0x7eff400d2580 0x7eff400d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:30.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.419+0000 7eff45200700 1 -- 172.21.15.80:0/3894187788 >> v2:172.21.15.106:3300/0 conn(0x7eff400d2580 msgr2=0x7eff400d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:30.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.419+0000 7eff45200700 1 --2- 172.21.15.80:0/3894187788 >> v2:172.21.15.106:3300/0 conn(0x7eff400d2580 0x7eff400d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:30.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.419+0000 7eff45200700 1 -- 172.21.15.80:0/3894187788 >> v1:172.21.15.106:6789/0 conn(0x7eff400d09d0 legacy=0x7eff400d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:30.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.419+0000 7eff45200700 1 -- 172.21.15.80:0/3894187788 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff400d3160 con 0x7eff400cf220 2024-05-10T04:23:30.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.419+0000 7eff45c00700 1 --2- 172.21.15.80:0/3894187788 >> v2:172.21.15.106:3300/0 conn(0x7eff400d2580 0x7eff400d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:30.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.419+0000 7eff45200700 1 --2- 172.21.15.80:0/3894187788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff400cf220 0x7eff400cf630 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7eff400c7700 tx=0x7eff34009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ad604d88693a94 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:30.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.420+0000 7eff3f400700 1 -- 172.21.15.80:0/3894187788 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34004230 con 0x7eff400cf220 2024-05-10T04:23:30.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.420+0000 7eff3f400700 1 -- 172.21.15.80:0/3894187788 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff34004390 con 0x7eff400cf220 2024-05-10T04:23:30.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.420+0000 7eff3f400700 1 -- 172.21.15.80:0/3894187788 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff340036a0 con 0x7eff400cf220 2024-05-10T04:23:30.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.420+0000 7eff46600700 1 -- 172.21.15.80:0/3894187788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff400cf220 msgr2=0x7eff400cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:30.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.420+0000 7eff46600700 1 --2- 172.21.15.80:0/3894187788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff400cf220 0x7eff400cf630 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7eff400c7700 tx=0x7eff34009bd0 comp rx=0 tx=0).stop 2024-05-10T04:23:30.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.420+0000 7eff46600700 1 -- 172.21.15.80:0/3894187788 shutdown_connections 2024-05-10T04:23:30.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.420+0000 7eff46600700 1 --2- 172.21.15.80:0/3894187788 >> v2:172.21.15.106:3300/0 conn(0x7eff400d2580 0x7eff400d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:30.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.420+0000 7eff46600700 1 --2- 172.21.15.80:0/3894187788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff400cf220 0x7eff400cf630 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:30.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.420+0000 7eff46600700 1 -- 172.21.15.80:0/3894187788 >> 172.21.15.80:0/3894187788 conn(0x7eff4006c580 msgr2=0x7eff4006c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:30.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.421+0000 7eff46600700 1 -- 172.21.15.80:0/3894187788 shutdown_connections 2024-05-10T04:23:30.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.421+0000 7eff46600700 1 -- 172.21.15.80:0/3894187788 wait complete. 2024-05-10T04:23:30.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.423+0000 7eff46600700 1 Processor -- start 2024-05-10T04:23:30.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.423+0000 7eff46600700 1 -- start start 2024-05-10T04:23:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.424+0000 7eff46600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff400cf220 0x7eff401f3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.424+0000 7eff46600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff400d09d0 0x7eff400cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.424+0000 7eff46600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff400d2580 0x7eff400ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.424+0000 7eff46600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff400c9dc0 con 0x7eff400cf220 2024-05-10T04:23:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.424+0000 7eff46600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff400b5e70 con 0x7eff400d09d0 2024-05-10T04:23:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.424+0000 7eff46600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff400c85f0 con 0x7eff400d2580 2024-05-10T04:23:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.425+0000 7eff45200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff400cf220 0x7eff401f3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.425+0000 7eff45200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff400cf220 0x7eff401f3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55882/0 (socket says 172.21.15.80:55882) 2024-05-10T04:23:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.425+0000 7eff45200700 1 -- 172.21.15.80:0/4092296197 learned_addr learned my addr 172.21.15.80:0/4092296197 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.425+0000 7eff45200700 1 -- 172.21.15.80:0/4092296197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff400d2580 msgr2=0x7eff400ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.425+0000 7eff45200700 1 --2- 172.21.15.80:0/4092296197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff400d2580 0x7eff400ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.425+0000 7eff45200700 1 -- 172.21.15.80:0/4092296197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff400d09d0 msgr2=0x7eff400cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.425+0000 7eff3fe00700 1 --2- 172.21.15.80:0/4092296197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff400d09d0 0x7eff400cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.425+0000 7eff45200700 1 --2- 172.21.15.80:0/4092296197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff400d09d0 0x7eff400cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.425+0000 7eff45200700 1 -- 172.21.15.80:0/4092296197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff34009550 con 0x7eff400cf220 2024-05-10T04:23:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.425+0000 7eff3fe00700 1 --2- 172.21.15.80:0/4092296197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff400d09d0 0x7eff400cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.425+0000 7eff45200700 1 --2- 172.21.15.80:0/4092296197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff400cf220 0x7eff401f3de0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7eff34009130 tx=0x7eff34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.426+0000 7eff3cc00700 1 -- 172.21.15.80:0/4092296197 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34011630 con 0x7eff400cf220 2024-05-10T04:23:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.426+0000 7eff3cc00700 1 -- 172.21.15.80:0/4092296197 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff34011790 con 0x7eff400cf220 2024-05-10T04:23:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.426+0000 7eff3cc00700 1 -- 172.21.15.80:0/4092296197 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34011b00 con 0x7eff400cf220 2024-05-10T04:23:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.426+0000 7eff46600700 1 -- 172.21.15.80:0/4092296197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff400c7cc0 con 0x7eff400cf220 2024-05-10T04:23:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.426+0000 7eff46600700 1 -- 172.21.15.80:0/4092296197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff400c8280 con 0x7eff400cf220 2024-05-10T04:23:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.427+0000 7eff46600700 1 -- 172.21.15.80:0/4092296197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff40074af0 con 0x7eff400cf220 2024-05-10T04:23:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.428+0000 7eff3cc00700 1 -- 172.21.15.80:0/4092296197 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7eff34011c60 con 0x7eff400cf220 2024-05-10T04:23:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.429+0000 7eff3cc00700 1 --2- 172.21.15.80:0/4092296197 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7eff2006acc0 0x7eff2006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:30.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.429+0000 7eff3cc00700 1 -- 172.21.15.80:0/4092296197 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7eff3408aa40 con 0x7eff400cf220 2024-05-10T04:23:30.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.429+0000 7eff3fe00700 1 --2- 172.21.15.80:0/4092296197 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7eff2006acc0 0x7eff2006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:30.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.430+0000 7eff3fe00700 1 --2- 172.21.15.80:0/4092296197 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7eff2006acc0 0x7eff2006d1d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff2c006fd0 tx=0x7eff2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:30.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.434+0000 7eff3cc00700 1 -- 172.21.15.80:0/4092296197 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7eff3408ce60 con 0x7eff400cf220 2024-05-10T04:23:30.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.641+0000 7eff46600700 1 -- 172.21.15.80:0/4092296197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff400c8730 con 0x7eff400cf220 2024-05-10T04:23:30.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.642+0000 7eff3cc00700 1 -- 172.21.15.80:0/4092296197 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16286 (secure 0 0 0) 0x7eff34055c30 con 0x7eff400cf220 2024-05-10T04:23:30.643 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:30.643 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:23:20.092453+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:23:30.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.644+0000 7eff46600700 1 -- 172.21.15.80:0/4092296197 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7eff2006acc0 msgr2=0x7eff2006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:30.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.644+0000 7eff46600700 1 --2- 172.21.15.80:0/4092296197 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7eff2006acc0 0x7eff2006d1d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff2c006fd0 tx=0x7eff2c008040 comp rx=0 tx=0).stop 2024-05-10T04:23:30.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.644+0000 7eff46600700 1 -- 172.21.15.80:0/4092296197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff400cf220 msgr2=0x7eff401f3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:30.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.644+0000 7eff46600700 1 --2- 172.21.15.80:0/4092296197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff400cf220 0x7eff401f3de0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7eff34009130 tx=0x7eff34004750 comp rx=0 tx=0).stop 2024-05-10T04:23:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.644+0000 7eff46600700 1 -- 172.21.15.80:0/4092296197 shutdown_connections 2024-05-10T04:23:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.644+0000 7eff46600700 1 --2- 172.21.15.80:0/4092296197 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7eff2006acc0 0x7eff2006d1d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.644+0000 7eff46600700 1 --2- 172.21.15.80:0/4092296197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff400cf220 0x7eff401f3de0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.644+0000 7eff46600700 1 --2- 172.21.15.80:0/4092296197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff400d2580 0x7eff400ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.644+0000 7eff46600700 1 --2- 172.21.15.80:0/4092296197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff400d09d0 0x7eff400cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.644+0000 7eff46600700 1 -- 172.21.15.80:0/4092296197 >> 172.21.15.80:0/4092296197 conn(0x7eff4006c580 msgr2=0x7eff400b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.645+0000 7eff46600700 1 -- 172.21.15.80:0/4092296197 shutdown_connections 2024-05-10T04:23:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.645+0000 7eff46600700 1 -- 172.21.15.80:0/4092296197 wait complete. 2024-05-10T04:23:30.674 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:22:26.793377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:22:35.751764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:22:36.465587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:23:30.675 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:23:30.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.936+0000 7f4e34e00700 1 Processor -- start 2024-05-10T04:23:30.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.936+0000 7f4e34e00700 1 -- start start 2024-05-10T04:23:30.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.938+0000 7f4e34e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e300b2cd0 0x7f4e3006e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:30.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.938+0000 7f4e34e00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4e3006ea70 0x7f4e300ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:30.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.938+0000 7f4e34e00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3006ee80 con 0x7f4e3015ebb0 2024-05-10T04:23:30.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.938+0000 7f4e34e00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e300cdf40 con 0x7f4e300b2cd0 2024-05-10T04:23:30.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.938+0000 7f4e34e00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e300ce0d0 con 0x7f4e3006ea70 2024-05-10T04:23:30.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.938+0000 7f4e27e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e300b2cd0 0x7f4e3006e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:30.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.938+0000 7f4e27e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e300b2cd0 0x7f4e3006e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55888/0 (socket says 172.21.15.80:55888) 2024-05-10T04:23:30.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.938+0000 7f4e27e00700 1 -- 172.21.15.80:0/3548869106 learned_addr learned my addr 172.21.15.80:0/3548869106 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:30.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.939+0000 7f4e2fe00700 1 --2- 172.21.15.80:0/3548869106 >> v2:172.21.15.106:3300/0 conn(0x7f4e3006ea70 0x7f4e300ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:30.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.939+0000 7f4e27e00700 1 -- 172.21.15.80:0/3548869106 >> v2:172.21.15.106:3300/0 conn(0x7f4e3006ea70 msgr2=0x7f4e300ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:30.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.939+0000 7f4e27e00700 1 --2- 172.21.15.80:0/3548869106 >> v2:172.21.15.106:3300/0 conn(0x7f4e3006ea70 0x7f4e300ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:30.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.939+0000 7f4e27e00700 1 -- 172.21.15.80:0/3548869106 >> v1:172.21.15.106:6789/0 conn(0x7f4e3015ebb0 legacy=0x7f4e3015aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:30.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.939+0000 7f4e27e00700 1 -- 172.21.15.80:0/3548869106 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3015f120 con 0x7f4e300b2cd0 2024-05-10T04:23:30.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.939+0000 7f4e2fe00700 1 --2- 172.21.15.80:0/3548869106 >> v2:172.21.15.106:3300/0 conn(0x7f4e3006ea70 0x7f4e300ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:30.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.939+0000 7f4e27e00700 1 --2- 172.21.15.80:0/3548869106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e300b2cd0 0x7f4e3006e530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800bb90 tx=0x7f4e1800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130c940871637926 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:30.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.939+0000 7f4e2ea00700 1 -- 172.21.15.80:0/3548869106 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1800dd10 con 0x7f4e300b2cd0 2024-05-10T04:23:30.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.939+0000 7f4e2ea00700 1 -- 172.21.15.80:0/3548869106 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1800de70 con 0x7f4e300b2cd0 2024-05-10T04:23:30.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.939+0000 7f4e2ea00700 1 -- 172.21.15.80:0/3548869106 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18010670 con 0x7f4e300b2cd0 2024-05-10T04:23:30.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.940+0000 7f4e34e00700 1 -- 172.21.15.80:0/3548869106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e300b2cd0 msgr2=0x7f4e3006e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:30.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.940+0000 7f4e34e00700 1 --2- 172.21.15.80:0/3548869106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e300b2cd0 0x7f4e3006e530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800bb90 tx=0x7f4e1800bea0 comp rx=0 tx=0).stop 2024-05-10T04:23:30.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.940+0000 7f4e34e00700 1 -- 172.21.15.80:0/3548869106 shutdown_connections 2024-05-10T04:23:30.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.940+0000 7f4e34e00700 1 --2- 172.21.15.80:0/3548869106 >> v2:172.21.15.106:3300/0 conn(0x7f4e3006ea70 0x7f4e300ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:30.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.940+0000 7f4e34e00700 1 --2- 172.21.15.80:0/3548869106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e300b2cd0 0x7f4e3006e530 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:30.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.940+0000 7f4e34e00700 1 -- 172.21.15.80:0/3548869106 >> 172.21.15.80:0/3548869106 conn(0x7f4e300cf800 msgr2=0x7f4e300cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:30.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.940+0000 7f4e34e00700 1 -- 172.21.15.80:0/3548869106 shutdown_connections 2024-05-10T04:23:30.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.940+0000 7f4e34e00700 1 -- 172.21.15.80:0/3548869106 wait complete. 2024-05-10T04:23:30.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.943+0000 7f4e34e00700 1 Processor -- start 2024-05-10T04:23:30.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.943+0000 7f4e34e00700 1 -- start start 2024-05-10T04:23:30.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.944+0000 7f4e34e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e3006ea70 0x7f4e30145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:30.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.944+0000 7f4e34e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e300b2cd0 0x7f4e3015df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:30.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.944+0000 7f4e34e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4e3015ebb0 0x7f4e3015e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:30.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.944+0000 7f4e34e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e301f16f0 con 0x7f4e300b2cd0 2024-05-10T04:23:30.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.944+0000 7f4e34e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3015bd10 con 0x7f4e3006ea70 2024-05-10T04:23:30.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.944+0000 7f4e34e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e30157c30 con 0x7f4e3015ebb0 2024-05-10T04:23:30.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.945+0000 7f4e27e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e300b2cd0 0x7f4e3015df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:30.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.945+0000 7f4e2f400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e3006ea70 0x7f4e30145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:30.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.945+0000 7f4e27e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e300b2cd0 0x7f4e3015df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55900/0 (socket says 172.21.15.80:55900) 2024-05-10T04:23:30.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.945+0000 7f4e27e00700 1 -- 172.21.15.80:0/880351874 learned_addr learned my addr 172.21.15.80:0/880351874 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:30.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.945+0000 7f4e2fe00700 1 --2- 172.21.15.80:0/880351874 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4e3015ebb0 0x7f4e3015e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:30.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.945+0000 7f4e27e00700 1 -- 172.21.15.80:0/880351874 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4e3015ebb0 msgr2=0x7f4e3015e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:30.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.945+0000 7f4e27e00700 1 --2- 172.21.15.80:0/880351874 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4e3015ebb0 0x7f4e3015e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:30.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.945+0000 7f4e27e00700 1 -- 172.21.15.80:0/880351874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e3006ea70 msgr2=0x7f4e30145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:30.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.945+0000 7f4e27e00700 1 --2- 172.21.15.80:0/880351874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e3006ea70 0x7f4e30145410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:30.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.945+0000 7f4e27e00700 1 -- 172.21.15.80:0/880351874 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1800b7f0 con 0x7f4e300b2cd0 2024-05-10T04:23:30.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.945+0000 7f4e27e00700 1 --2- 172.21.15.80:0/880351874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e300b2cd0 0x7f4e3015df30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4e30067ae0 tx=0x7f4e18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:30.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.945+0000 7f4e27400700 1 -- 172.21.15.80:0/880351874 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18003bf0 con 0x7f4e300b2cd0 2024-05-10T04:23:30.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.945+0000 7f4e27400700 1 -- 172.21.15.80:0/880351874 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e18003d50 con 0x7f4e300b2cd0 2024-05-10T04:23:30.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.946+0000 7f4e34e00700 1 -- 172.21.15.80:0/880351874 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3015bf60 con 0x7f4e300b2cd0 2024-05-10T04:23:30.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.946+0000 7f4e27400700 1 -- 172.21.15.80:0/880351874 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e180106b0 con 0x7f4e300b2cd0 2024-05-10T04:23:30.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.946+0000 7f4e34e00700 1 -- 172.21.15.80:0/880351874 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3015c520 con 0x7f4e300b2cd0 2024-05-10T04:23:30.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.947+0000 7f4e34e00700 1 -- 172.21.15.80:0/880351874 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e30074af0 con 0x7f4e300b2cd0 2024-05-10T04:23:30.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.948+0000 7f4e27400700 1 -- 172.21.15.80:0/880351874 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4e18019400 con 0x7f4e300b2cd0 2024-05-10T04:23:30.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.948+0000 7f4e27400700 1 --2- 172.21.15.80:0/880351874 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f4e0c06ac90 0x7f4e0c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:30.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.949+0000 7f4e27400700 1 -- 172.21.15.80:0/880351874 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4e1808aab0 con 0x7f4e300b2cd0 2024-05-10T04:23:30.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.949+0000 7f4e2f400700 1 --2- 172.21.15.80:0/880351874 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f4e0c06ac90 0x7f4e0c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:30.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.949+0000 7f4e2f400700 1 --2- 172.21.15.80:0/880351874 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f4e0c06ac90 0x7f4e0c06d1a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4e20007fd0 tx=0x7f4e20009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:30.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:30.953+0000 7f4e27400700 1 -- 172.21.15.80:0/880351874 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4e18055cb0 con 0x7f4e300b2cd0 2024-05-10T04:23:31.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.159+0000 7f4e34e00700 1 -- 172.21.15.80:0/880351874 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e30154e80 con 0x7f4e300b2cd0 2024-05-10T04:23:31.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.159+0000 7f4e27400700 1 -- 172.21.15.80:0/880351874 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e180592d0 con 0x7f4e300b2cd0 2024-05-10T04:23:31.161 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-10T04:23:31.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.162+0000 7f4e34e00700 1 -- 172.21.15.80:0/880351874 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f4e0c06ac90 msgr2=0x7f4e0c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:31.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.162+0000 7f4e34e00700 1 --2- 172.21.15.80:0/880351874 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f4e0c06ac90 0x7f4e0c06d1a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4e20007fd0 tx=0x7f4e20009040 comp rx=0 tx=0).stop 2024-05-10T04:23:31.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.162+0000 7f4e34e00700 1 -- 172.21.15.80:0/880351874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e300b2cd0 msgr2=0x7f4e3015df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:31.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.162+0000 7f4e34e00700 1 --2- 172.21.15.80:0/880351874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e300b2cd0 0x7f4e3015df30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4e30067ae0 tx=0x7f4e18004750 comp rx=0 tx=0).stop 2024-05-10T04:23:31.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.162+0000 7f4e34e00700 1 -- 172.21.15.80:0/880351874 shutdown_connections 2024-05-10T04:23:31.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.162+0000 7f4e34e00700 1 --2- 172.21.15.80:0/880351874 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f4e0c06ac90 0x7f4e0c06d1a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:31.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.162+0000 7f4e34e00700 1 --2- 172.21.15.80:0/880351874 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4e3015ebb0 0x7f4e3015e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:31.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.162+0000 7f4e34e00700 1 --2- 172.21.15.80:0/880351874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e3006ea70 0x7f4e30145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:31.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.162+0000 7f4e34e00700 1 --2- 172.21.15.80:0/880351874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e300b2cd0 0x7f4e3015df30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:31.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.162+0000 7f4e34e00700 1 -- 172.21.15.80:0/880351874 >> 172.21.15.80:0/880351874 conn(0x7f4e300cf800 msgr2=0x7f4e300b0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:31.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.162+0000 7f4e34e00700 1 -- 172.21.15.80:0/880351874 shutdown_connections 2024-05-10T04:23:31.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.162+0000 7f4e34e00700 1 -- 172.21.15.80:0/880351874 wait complete. 2024-05-10T04:23:31.188 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:23:31.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.453+0000 7ff6ba800700 1 Processor -- start 2024-05-10T04:23:31.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.453+0000 7ff6ba800700 1 -- start start 2024-05-10T04:23:31.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.455+0000 7ff6ba800700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff6b40b98e0 0x7ff6b40d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:31.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.455+0000 7ff6ba800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b40d0c90 0x7ff6b415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:31.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.455+0000 7ff6ba800700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b40d2e50 con 0x7ff6b40b6230 2024-05-10T04:23:31.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.455+0000 7ff6ba800700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b40d3130 con 0x7ff6b40b98e0 2024-05-10T04:23:31.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.455+0000 7ff6ba800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40d3410 con 0x7ff6b40d0c90 2024-05-10T04:23:31.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.455+0000 7ff6b9400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff6b40b98e0 0x7ff6b40d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:31.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.455+0000 7ff6b9400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff6b40b98e0 0x7ff6b40d2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:36970/0 (socket says 172.21.15.80:36970) 2024-05-10T04:23:31.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.455+0000 7ff6b9400700 1 -- 172.21.15.80:0/1622312409 learned_addr learned my addr 172.21.15.80:0/1622312409 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:31.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.455+0000 7ff6b9e00700 1 --2- 172.21.15.80:0/1622312409 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b40d0c90 0x7ff6b415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:31.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.456+0000 7ff6b9400700 1 -- 172.21.15.80:0/1622312409 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b40d0c90 msgr2=0x7ff6b415d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:31.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.456+0000 7ff6b9400700 1 --2- 172.21.15.80:0/1622312409 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b40d0c90 0x7ff6b415d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:31.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.456+0000 7ff6b9400700 1 -- 172.21.15.80:0/1622312409 >> v1:172.21.15.106:6789/0 conn(0x7ff6b40b6230 legacy=0x7ff6b40d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:31.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.456+0000 7ff6b9400700 1 -- 172.21.15.80:0/1622312409 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b40b7470 con 0x7ff6b40b98e0 2024-05-10T04:23:31.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.456+0000 7ff6b9400700 1 --2- 172.21.15.80:0/1622312409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6b40b98e0 0x7ff6b40d2520 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80098f0 tx=0x7ff6a8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa4b5d436a8652e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:31.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.456+0000 7ff6b3e00700 1 -- 172.21.15.80:0/1622312409 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8011830 con 0x7ff6b40b98e0 2024-05-10T04:23:31.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.457+0000 7ff6b3e00700 1 -- 172.21.15.80:0/1622312409 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a8011990 con 0x7ff6b40b98e0 2024-05-10T04:23:31.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.457+0000 7ff6b3e00700 1 -- 172.21.15.80:0/1622312409 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8011d20 con 0x7ff6b40b98e0 2024-05-10T04:23:31.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.457+0000 7ff6ba800700 1 -- 172.21.15.80:0/1622312409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6b40b98e0 msgr2=0x7ff6b40d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:31.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.457+0000 7ff6ba800700 1 --2- 172.21.15.80:0/1622312409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6b40b98e0 0x7ff6b40d2520 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80098f0 tx=0x7ff6a8009c00 comp rx=0 tx=0).stop 2024-05-10T04:23:31.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.457+0000 7ff6ba800700 1 -- 172.21.15.80:0/1622312409 shutdown_connections 2024-05-10T04:23:31.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.457+0000 7ff6ba800700 1 --2- 172.21.15.80:0/1622312409 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b40d0c90 0x7ff6b415d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:31.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.457+0000 7ff6ba800700 1 --2- 172.21.15.80:0/1622312409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6b40b98e0 0x7ff6b40d2520 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:31.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.457+0000 7ff6ba800700 1 -- 172.21.15.80:0/1622312409 >> 172.21.15.80:0/1622312409 conn(0x7ff6b40676c0 msgr2=0x7ff6b406c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:31.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.457+0000 7ff6ba800700 1 -- 172.21.15.80:0/1622312409 shutdown_connections 2024-05-10T04:23:31.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.457+0000 7ff6ba800700 1 -- 172.21.15.80:0/1622312409 wait complete. 2024-05-10T04:23:31.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.460+0000 7ff6ba800700 1 Processor -- start 2024-05-10T04:23:31.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.460+0000 7ff6ba800700 1 -- start start 2024-05-10T04:23:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.461+0000 7ff6ba800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b40b6230 0x7ff6b41e7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.461+0000 7ff6ba800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6b40b98e0 0x7ff6b41f3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.461+0000 7ff6ba800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6b40d0c90 0x7ff6b40c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.461+0000 7ff6ba800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b41f55a0 con 0x7ff6b40d0c90 2024-05-10T04:23:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.461+0000 7ff6ba800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40cd510 con 0x7ff6b40b98e0 2024-05-10T04:23:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.461+0000 7ff6ba800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40ce370 con 0x7ff6b40b6230 2024-05-10T04:23:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.461+0000 7ff6b9e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6b40d0c90 0x7ff6b40c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:31.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.461+0000 7ff6b9e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6b40d0c90 0x7ff6b40c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55916/0 (socket says 172.21.15.80:55916) 2024-05-10T04:23:31.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.461+0000 7ff6b9e00700 1 -- 172.21.15.80:0/2511193711 learned_addr learned my addr 172.21.15.80:0/2511193711 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:31.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.462+0000 7ff6b9400700 1 --2- 172.21.15.80:0/2511193711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b40b6230 0x7ff6b41e7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:31.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.462+0000 7ff6b8a00700 1 --2- 172.21.15.80:0/2511193711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6b40b98e0 0x7ff6b41f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:31.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.462+0000 7ff6b9e00700 1 -- 172.21.15.80:0/2511193711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b40b6230 msgr2=0x7ff6b41e7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:31.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.462+0000 7ff6b9e00700 1 --2- 172.21.15.80:0/2511193711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b40b6230 0x7ff6b41e7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:31.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.462+0000 7ff6b9e00700 1 -- 172.21.15.80:0/2511193711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6b40b98e0 msgr2=0x7ff6b41f3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:31.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.462+0000 7ff6b9e00700 1 --2- 172.21.15.80:0/2511193711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6b40b98e0 0x7ff6b41f3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:31.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.462+0000 7ff6b9e00700 1 -- 172.21.15.80:0/2511193711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a8009550 con 0x7ff6b40d0c90 2024-05-10T04:23:31.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.462+0000 7ff6b9e00700 1 --2- 172.21.15.80:0/2511193711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6b40d0c90 0x7ff6b40c9620 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00efc0 tx=0x7ff6ac00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.462+0000 7ff6b1600700 1 -- 172.21.15.80:0/2511193711 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00cad0 con 0x7ff6b40d0c90 2024-05-10T04:23:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.462+0000 7ff6b1600700 1 -- 172.21.15.80:0/2511193711 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac00f040 con 0x7ff6b40d0c90 2024-05-10T04:23:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.462+0000 7ff6ba800700 1 -- 172.21.15.80:0/2511193711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b41e7940 con 0x7ff6b40d0c90 2024-05-10T04:23:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.462+0000 7ff6b1600700 1 -- 172.21.15.80:0/2511193711 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00ce70 con 0x7ff6b40d0c90 2024-05-10T04:23:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.463+0000 7ff6ba800700 1 -- 172.21.15.80:0/2511193711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b40cda40 con 0x7ff6b40d0c90 2024-05-10T04:23:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.464+0000 7ff6ba800700 1 -- 172.21.15.80:0/2511193711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b4074af0 con 0x7ff6b40d0c90 2024-05-10T04:23:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.465+0000 7ff6b1600700 1 -- 172.21.15.80:0/2511193711 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff6ac014480 con 0x7ff6b40d0c90 2024-05-10T04:23:31.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.466+0000 7ff6b1600700 1 --2- 172.21.15.80:0/2511193711 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff69406ac90 0x7ff69406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:31.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.466+0000 7ff6b1600700 1 -- 172.21.15.80:0/2511193711 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff6ac089fc0 con 0x7ff6b40d0c90 2024-05-10T04:23:31.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.467+0000 7ff6b9400700 1 --2- 172.21.15.80:0/2511193711 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff69406ac90 0x7ff69406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:31.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.467+0000 7ff6b9400700 1 --2- 172.21.15.80:0/2511193711 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff69406ac90 0x7ff69406d1a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8014040 tx=0x7ff6a8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:31.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.471+0000 7ff6b1600700 1 -- 172.21.15.80:0/2511193711 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff6ac054ff0 con 0x7ff6b40d0c90 2024-05-10T04:23:31.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.675+0000 7ff6ba800700 1 -- 172.21.15.80:0/2511193711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff6b406b260 con 0x7ff6b40d0c90 2024-05-10T04:23:31.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.675+0000 7ff6b1600700 1 -- 172.21.15.80:0/2511193711 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff6ac0180a0 con 0x7ff6b40d0c90 2024-05-10T04:23:31.677 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-10T04:23:31.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.678+0000 7ff6ba800700 1 -- 172.21.15.80:0/2511193711 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff69406ac90 msgr2=0x7ff69406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:31.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.678+0000 7ff6ba800700 1 --2- 172.21.15.80:0/2511193711 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff69406ac90 0x7ff69406d1a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8014040 tx=0x7ff6a8008030 comp rx=0 tx=0).stop 2024-05-10T04:23:31.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.678+0000 7ff6ba800700 1 -- 172.21.15.80:0/2511193711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6b40d0c90 msgr2=0x7ff6b40c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:31.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.678+0000 7ff6ba800700 1 --2- 172.21.15.80:0/2511193711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6b40d0c90 0x7ff6b40c9620 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00efc0 tx=0x7ff6ac00c0c0 comp rx=0 tx=0).stop 2024-05-10T04:23:31.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.678+0000 7ff6ba800700 1 -- 172.21.15.80:0/2511193711 shutdown_connections 2024-05-10T04:23:31.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.678+0000 7ff6ba800700 1 --2- 172.21.15.80:0/2511193711 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff69406ac90 0x7ff69406d1a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:31.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.678+0000 7ff6ba800700 1 --2- 172.21.15.80:0/2511193711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6b40d0c90 0x7ff6b40c9620 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:31.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.678+0000 7ff6ba800700 1 --2- 172.21.15.80:0/2511193711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b40b6230 0x7ff6b41e7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:31.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.678+0000 7ff6ba800700 1 --2- 172.21.15.80:0/2511193711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6b40b98e0 0x7ff6b41f3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:31.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.678+0000 7ff6ba800700 1 -- 172.21.15.80:0/2511193711 >> 172.21.15.80:0/2511193711 conn(0x7ff6b40676c0 msgr2=0x7ff6b40b8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:31.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.678+0000 7ff6ba800700 1 -- 172.21.15.80:0/2511193711 shutdown_connections 2024-05-10T04:23:31.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.678+0000 7ff6ba800700 1 -- 172.21.15.80:0/2511193711 wait complete. 2024-05-10T04:23:31.704 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:23:31.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.966+0000 7fb44aa00700 1 Processor -- start 2024-05-10T04:23:31.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.967+0000 7fb44aa00700 1 -- start start 2024-05-10T04:23:31.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.968+0000 7fb44aa00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb4440d0c90 0x7fb44415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:31.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.968+0000 7fb44aa00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4440d2e50 con 0x7fb4440b98e0 2024-05-10T04:23:31.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.968+0000 7fb44aa00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4440d3130 con 0x7fb4440b6230 2024-05-10T04:23:31.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.968+0000 7fb44aa00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4440d2c30 con 0x7fb4440d0c90 2024-05-10T04:23:31.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.968+0000 7fb449600700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb4440b98e0 0x7fb4440d2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41516/0 (socket says 172.21.15.80:41516) 2024-05-10T04:23:31.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.969+0000 7fb449600700 1 -- 172.21.15.80:0/3041779461 learned_addr learned my addr 172.21.15.80:0/3041779461 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:31.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.969+0000 7fb44a000700 1 --2- 172.21.15.80:0/3041779461 >> v2:172.21.15.106:3300/0 conn(0x7fb4440d0c90 0x7fb44415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:31.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.969+0000 7fb443e00700 1 -- 172.21.15.80:0/3041779461 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331344396 0 0) 0x7fb4440d2e50 con 0x7fb4440b98e0 2024-05-10T04:23:31.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.969+0000 7fb443e00700 1 -- 172.21.15.80:0/3041779461 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb42c0035b0 con 0x7fb4440b98e0 2024-05-10T04:23:31.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.969+0000 7fb44a000700 1 -- 172.21.15.80:0/3041779461 >> v1:172.21.15.106:6789/0 conn(0x7fb4440b6230 legacy=0x7fb4440d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:31.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.969+0000 7fb44a000700 1 -- 172.21.15.80:0/3041779461 >> v1:172.21.15.80:6789/0 conn(0x7fb4440b98e0 legacy=0x7fb4440d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:31.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.969+0000 7fb44a000700 1 -- 172.21.15.80:0/3041779461 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4440d3410 con 0x7fb4440d0c90 2024-05-10T04:23:31.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.970+0000 7fb44a000700 1 --2- 172.21.15.80:0/3041779461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4440d0c90 0x7fb44415d7f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb43c009d90 tx=0x7fb43c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a58a3fa3989550f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:31.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.970+0000 7fb443e00700 1 -- 172.21.15.80:0/3041779461 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c00e070 con 0x7fb4440d0c90 2024-05-10T04:23:31.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.970+0000 7fb443e00700 1 -- 172.21.15.80:0/3041779461 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c00bb20 con 0x7fb4440d0c90 2024-05-10T04:23:31.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.970+0000 7fb443e00700 1 -- 172.21.15.80:0/3041779461 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c012430 con 0x7fb4440d0c90 2024-05-10T04:23:31.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.970+0000 7fb44aa00700 1 -- 172.21.15.80:0/3041779461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4440d0c90 msgr2=0x7fb44415d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:31.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.970+0000 7fb44aa00700 1 --2- 172.21.15.80:0/3041779461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4440d0c90 0x7fb44415d7f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb43c009d90 tx=0x7fb43c00b330 comp rx=0 tx=0).stop 2024-05-10T04:23:31.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.971+0000 7fb44aa00700 1 -- 172.21.15.80:0/3041779461 shutdown_connections 2024-05-10T04:23:31.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.971+0000 7fb44aa00700 1 --2- 172.21.15.80:0/3041779461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4440d0c90 0x7fb44415d7f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:31.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.971+0000 7fb44aa00700 1 -- 172.21.15.80:0/3041779461 >> 172.21.15.80:0/3041779461 conn(0x7fb4440676c0 msgr2=0x7fb44406c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:31.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.971+0000 7fb44aa00700 1 -- 172.21.15.80:0/3041779461 shutdown_connections 2024-05-10T04:23:31.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.971+0000 7fb44aa00700 1 -- 172.21.15.80:0/3041779461 wait complete. 2024-05-10T04:23:31.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.973+0000 7fb44aa00700 1 Processor -- start 2024-05-10T04:23:31.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.973+0000 7fb44aa00700 1 -- start start 2024-05-10T04:23:31.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.974+0000 7fb44aa00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4440b6230 0x7fb44415ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:31.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.974+0000 7fb44aa00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4440b98e0 0x7fb44415cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:31.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.975+0000 7fb44aa00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4440d0c90 0x7fb4441f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:31.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.975+0000 7fb44aa00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4441f3e20 con 0x7fb4440b6230 2024-05-10T04:23:31.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.975+0000 7fb44aa00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4441495c0 con 0x7fb4440d0c90 2024-05-10T04:23:31.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.975+0000 7fb44aa00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44415d770 con 0x7fb4440b98e0 2024-05-10T04:23:31.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.975+0000 7fb449600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4440b6230 0x7fb44415ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:31.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.975+0000 7fb449600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4440b6230 0x7fb44415ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55928/0 (socket says 172.21.15.80:55928) 2024-05-10T04:23:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.975+0000 7fb449600700 1 -- 172.21.15.80:0/2928053074 learned_addr learned my addr 172.21.15.80:0/2928053074 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.975+0000 7fb44a000700 1 --2- 172.21.15.80:0/2928053074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4440d0c90 0x7fb4441f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.975+0000 7fb448c00700 1 --2- 172.21.15.80:0/2928053074 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4440b98e0 0x7fb44415cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.975+0000 7fb449600700 1 -- 172.21.15.80:0/2928053074 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4440b98e0 msgr2=0x7fb44415cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.975+0000 7fb449600700 1 --2- 172.21.15.80:0/2928053074 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4440b98e0 0x7fb44415cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.975+0000 7fb449600700 1 -- 172.21.15.80:0/2928053074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4440d0c90 msgr2=0x7fb4441f7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.975+0000 7fb449600700 1 --2- 172.21.15.80:0/2928053074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4440d0c90 0x7fb4441f7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.975+0000 7fb449600700 1 -- 172.21.15.80:0/2928053074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c009a70 con 0x7fb4440b6230 2024-05-10T04:23:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.975+0000 7fb448c00700 1 --2- 172.21.15.80:0/2928053074 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4440b98e0 0x7fb44415cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.976+0000 7fb449600700 1 --2- 172.21.15.80:0/2928053074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4440b6230 0x7fb44415ea70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb43800c4d0 tx=0x7fb43800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.976+0000 7fb441600700 1 -- 172.21.15.80:0/2928053074 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438005d70 con 0x7fb4440b6230 2024-05-10T04:23:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.976+0000 7fb441600700 1 -- 172.21.15.80:0/2928053074 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4380070d0 con 0x7fb4440b6230 2024-05-10T04:23:31.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.976+0000 7fb441600700 1 -- 172.21.15.80:0/2928053074 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438007460 con 0x7fb4440b6230 2024-05-10T04:23:31.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.976+0000 7fb44aa00700 1 -- 172.21.15.80:0/2928053074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44415d9c0 con 0x7fb4440b6230 2024-05-10T04:23:31.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.976+0000 7fb44aa00700 1 -- 172.21.15.80:0/2928053074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44415df80 con 0x7fb4440b6230 2024-05-10T04:23:31.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.977+0000 7fb44aa00700 1 -- 172.21.15.80:0/2928053074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4441480d0 con 0x7fb4440b6230 2024-05-10T04:23:31.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.978+0000 7fb441600700 1 -- 172.21.15.80:0/2928053074 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb4380075c0 con 0x7fb4440b6230 2024-05-10T04:23:31.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.979+0000 7fb441600700 1 --2- 172.21.15.80:0/2928053074 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb42406acc0 0x7fb42406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:31.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.979+0000 7fb441600700 1 -- 172.21.15.80:0/2928053074 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb4380888c0 con 0x7fb4440b6230 2024-05-10T04:23:31.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.979+0000 7fb448c00700 1 --2- 172.21.15.80:0/2928053074 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb42406acc0 0x7fb42406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:31.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.980+0000 7fb448c00700 1 --2- 172.21.15.80:0/2928053074 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb42406acc0 0x7fb42406d1d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb4441f73d0 tx=0x7fb430009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:31.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:31.984+0000 7fb441600700 1 -- 172.21.15.80:0/2928053074 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb438053980 con 0x7fb4440b6230 2024-05-10T04:23:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.197+0000 7fb44aa00700 1 -- 172.21.15.80:0/2928053074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb444074af0 con 0x7fb4440b6230 2024-05-10T04:23:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.197+0000 7fb441600700 1 -- 172.21.15.80:0/2928053074 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb4380170a0 con 0x7fb4440b6230 2024-05-10T04:23:32.199 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-10T04:23:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.200+0000 7fb44aa00700 1 -- 172.21.15.80:0/2928053074 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb42406acc0 msgr2=0x7fb42406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.200+0000 7fb44aa00700 1 --2- 172.21.15.80:0/2928053074 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb42406acc0 0x7fb42406d1d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb4441f73d0 tx=0x7fb430009040 comp rx=0 tx=0).stop 2024-05-10T04:23:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.200+0000 7fb44aa00700 1 -- 172.21.15.80:0/2928053074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4440b6230 msgr2=0x7fb44415ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.200+0000 7fb44aa00700 1 --2- 172.21.15.80:0/2928053074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4440b6230 0x7fb44415ea70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb43800c4d0 tx=0x7fb43800c7e0 comp rx=0 tx=0).stop 2024-05-10T04:23:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.200+0000 7fb44aa00700 1 -- 172.21.15.80:0/2928053074 shutdown_connections 2024-05-10T04:23:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.200+0000 7fb44aa00700 1 --2- 172.21.15.80:0/2928053074 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb42406acc0 0x7fb42406d1d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.200+0000 7fb44aa00700 1 --2- 172.21.15.80:0/2928053074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4440b6230 0x7fb44415ea70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.200+0000 7fb44aa00700 1 --2- 172.21.15.80:0/2928053074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4440d0c90 0x7fb4441f7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.200+0000 7fb44aa00700 1 --2- 172.21.15.80:0/2928053074 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4440b98e0 0x7fb44415cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.200+0000 7fb44aa00700 1 -- 172.21.15.80:0/2928053074 >> 172.21.15.80:0/2928053074 conn(0x7fb4440676c0 msgr2=0x7fb4440b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.200+0000 7fb44aa00700 1 -- 172.21.15.80:0/2928053074 shutdown_connections 2024-05-10T04:23:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.200+0000 7fb44aa00700 1 -- 172.21.15.80:0/2928053074 wait complete. 2024-05-10T04:23:32.226 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T04:23:32.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.487+0000 7f74d4400700 1 Processor -- start 2024-05-10T04:23:32.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.487+0000 7f74d4400700 1 -- start start 2024-05-10T04:23:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.488+0000 7f74d4400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74cc158c70 0x7f74cc15ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.488+0000 7f74d4400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74cc0b5c90 0x7f74cc0b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.488+0000 7f74d4400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74cc06c5f0 con 0x7f74cc162000 2024-05-10T04:23:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.488+0000 7f74d4400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74cc0b65e0 con 0x7f74cc158c70 2024-05-10T04:23:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.488+0000 7f74d4400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc06d190 con 0x7f74cc0b5c90 2024-05-10T04:23:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.489+0000 7f74d1a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74cc158c70 0x7f74cc15ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.489+0000 7f74d1000700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f74cc162000 0x7f74cc06ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41528/0 (socket says 172.21.15.80:41528) 2024-05-10T04:23:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.489+0000 7f74d1000700 1 -- 172.21.15.80:0/811673496 learned_addr learned my addr 172.21.15.80:0/811673496 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.489+0000 7f74d2400700 1 --2- 172.21.15.80:0/811673496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74cc0b5c90 0x7f74cc0b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.489+0000 7f74d1a00700 1 -- 172.21.15.80:0/811673496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74cc0b5c90 msgr2=0x7f74cc0b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.489+0000 7f74d1a00700 1 --2- 172.21.15.80:0/811673496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74cc0b5c90 0x7f74cc0b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.489+0000 7f74d1a00700 1 -- 172.21.15.80:0/811673496 >> v1:172.21.15.80:6789/0 conn(0x7f74cc162000 legacy=0x7f74cc06ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.489+0000 7f74d1a00700 1 -- 172.21.15.80:0/811673496 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc162850 con 0x7f74cc158c70 2024-05-10T04:23:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.489+0000 7f74cbe00700 1 -- 172.21.15.80:0/811673496 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35543746 0 0) 0x7f74cc06c5f0 con 0x7f74cc162000 2024-05-10T04:23:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.490+0000 7f74d1a00700 1 --2- 172.21.15.80:0/811673496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74cc158c70 0x7f74cc15ea10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f74c0009840 tx=0x7f74c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350914f67a5aec74 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.490+0000 7f74cbe00700 1 -- 172.21.15.80:0/811673496 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0011830 con 0x7f74cc158c70 2024-05-10T04:23:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.490+0000 7f74cbe00700 1 -- 172.21.15.80:0/811673496 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c0011990 con 0x7f74cc158c70 2024-05-10T04:23:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.490+0000 7f74cbe00700 1 -- 172.21.15.80:0/811673496 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0011d20 con 0x7f74cc158c70 2024-05-10T04:23:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.490+0000 7f74d4400700 1 -- 172.21.15.80:0/811673496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74cc158c70 msgr2=0x7f74cc15ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.490+0000 7f74d4400700 1 --2- 172.21.15.80:0/811673496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74cc158c70 0x7f74cc15ea10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f74c0009840 tx=0x7f74c0009b50 comp rx=0 tx=0).stop 2024-05-10T04:23:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.491+0000 7f74d4400700 1 -- 172.21.15.80:0/811673496 shutdown_connections 2024-05-10T04:23:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.491+0000 7f74d4400700 1 --2- 172.21.15.80:0/811673496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74cc0b5c90 0x7f74cc0b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.491+0000 7f74d4400700 1 --2- 172.21.15.80:0/811673496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74cc158c70 0x7f74cc15ea10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.491+0000 7f74d4400700 1 -- 172.21.15.80:0/811673496 >> 172.21.15.80:0/811673496 conn(0x7f74cc0d0d30 msgr2=0x7f74cc0d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.491+0000 7f74d4400700 1 -- 172.21.15.80:0/811673496 shutdown_connections 2024-05-10T04:23:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.491+0000 7f74d4400700 1 -- 172.21.15.80:0/811673496 wait complete. 2024-05-10T04:23:32.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.493+0000 7f74d4400700 1 Processor -- start 2024-05-10T04:23:32.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.493+0000 7f74d4400700 1 -- start start 2024-05-10T04:23:32.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.494+0000 7f74d4400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74cc0b5c90 0x7f74cc1f8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:32.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.494+0000 7f74d4400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74cc158c70 0x7f74cc157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:32.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.494+0000 7f74d4400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74cc162000 0x7f74cc0c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:32.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.494+0000 7f74d4400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc0cc9e0 con 0x7f74cc162000 2024-05-10T04:23:32.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.494+0000 7f74d4400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc0ce140 con 0x7f74cc158c70 2024-05-10T04:23:32.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.494+0000 7f74d4400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc1f8dc0 con 0x7f74cc0b5c90 2024-05-10T04:23:32.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.495+0000 7f74d2400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74cc162000 0x7f74cc0c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:32.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.495+0000 7f74d2400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74cc162000 0x7f74cc0c9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55950/0 (socket says 172.21.15.80:55950) 2024-05-10T04:23:32.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.495+0000 7f74d2400700 1 -- 172.21.15.80:0/1754333113 learned_addr learned my addr 172.21.15.80:0/1754333113 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:32.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.495+0000 7f74d1a00700 1 --2- 172.21.15.80:0/1754333113 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74cc0b5c90 0x7f74cc1f8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:32.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.495+0000 7f74d1000700 1 --2- 172.21.15.80:0/1754333113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74cc158c70 0x7f74cc157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:32.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.495+0000 7f74d2400700 1 -- 172.21.15.80:0/1754333113 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74cc0b5c90 msgr2=0x7f74cc1f8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:32.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.495+0000 7f74d2400700 1 --2- 172.21.15.80:0/1754333113 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74cc0b5c90 0x7f74cc1f8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:32.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.495+0000 7f74d2400700 1 -- 172.21.15.80:0/1754333113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74cc158c70 msgr2=0x7f74cc157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:32.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.495+0000 7f74d2400700 1 --2- 172.21.15.80:0/1754333113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74cc158c70 0x7f74cc157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:32.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.495+0000 7f74d2400700 1 -- 172.21.15.80:0/1754333113 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c00094a0 con 0x7f74cc162000 2024-05-10T04:23:32.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.496+0000 7f74d2400700 1 --2- 172.21.15.80:0/1754333113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74cc162000 0x7f74cc0c9210 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f74c4007d80 tx=0x7f74c400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:32.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.496+0000 7f74c9600700 1 -- 172.21.15.80:0/1754333113 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c400ecd0 con 0x7f74cc162000 2024-05-10T04:23:32.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.496+0000 7f74c9600700 1 -- 172.21.15.80:0/1754333113 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c400ee30 con 0x7f74cc162000 2024-05-10T04:23:32.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.496+0000 7f74c9600700 1 -- 172.21.15.80:0/1754333113 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c4014660 con 0x7f74cc162000 2024-05-10T04:23:32.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.496+0000 7f74d4400700 1 -- 172.21.15.80:0/1754333113 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74cc0cc3b0 con 0x7f74cc162000 2024-05-10T04:23:32.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.496+0000 7f74d4400700 1 -- 172.21.15.80:0/1754333113 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74cc159700 con 0x7f74cc162000 2024-05-10T04:23:32.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.497+0000 7f74d4400700 1 -- 172.21.15.80:0/1754333113 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74cc0732b0 con 0x7f74cc162000 2024-05-10T04:23:32.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.498+0000 7f74c9600700 1 -- 172.21.15.80:0/1754333113 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f74c40147c0 con 0x7f74cc162000 2024-05-10T04:23:32.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.499+0000 7f74c9600700 1 --2- 172.21.15.80:0/1754333113 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f74ac06ac90 0x7f74ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:32.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.499+0000 7f74c9600700 1 -- 172.21.15.80:0/1754333113 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f74c40898b0 con 0x7f74cc162000 2024-05-10T04:23:32.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.499+0000 7f74d1a00700 1 --2- 172.21.15.80:0/1754333113 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f74ac06ac90 0x7f74ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:32.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.500+0000 7f74d1a00700 1 --2- 172.21.15.80:0/1754333113 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f74ac06ac90 0x7f74ac06d1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f74c0009840 tx=0x7f74c0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:32.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.503+0000 7f74c9600700 1 -- 172.21.15.80:0/1754333113 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f74c4054a10 con 0x7f74cc162000 2024-05-10T04:23:32.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.722+0000 7f74d4400700 1 -- 172.21.15.80:0/1754333113 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f74cc074af0 con 0x7f74cc162000 2024-05-10T04:23:32.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.723+0000 7f74c9600700 1 -- 172.21.15.80:0/1754333113 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f74c4058030 con 0x7f74cc162000 2024-05-10T04:23:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.725+0000 7f74d4400700 1 -- 172.21.15.80:0/1754333113 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f74ac06ac90 msgr2=0x7f74ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.725+0000 7f74d4400700 1 --2- 172.21.15.80:0/1754333113 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f74ac06ac90 0x7f74ac06d1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f74c0009840 tx=0x7f74c0008030 comp rx=0 tx=0).stop 2024-05-10T04:23:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.725+0000 7f74d4400700 1 -- 172.21.15.80:0/1754333113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74cc162000 msgr2=0x7f74cc0c9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.725+0000 7f74d4400700 1 --2- 172.21.15.80:0/1754333113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74cc162000 0x7f74cc0c9210 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f74c4007d80 tx=0x7f74c400e3c0 comp rx=0 tx=0).stop 2024-05-10T04:23:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.725+0000 7f74d4400700 1 -- 172.21.15.80:0/1754333113 shutdown_connections 2024-05-10T04:23:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.725+0000 7f74d4400700 1 --2- 172.21.15.80:0/1754333113 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f74ac06ac90 0x7f74ac06d1a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.725+0000 7f74d4400700 1 --2- 172.21.15.80:0/1754333113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74cc162000 0x7f74cc0c9210 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.725+0000 7f74d4400700 1 --2- 172.21.15.80:0/1754333113 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74cc0b5c90 0x7f74cc1f8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.725+0000 7f74d4400700 1 --2- 172.21.15.80:0/1754333113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74cc158c70 0x7f74cc157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.725+0000 7f74d4400700 1 -- 172.21.15.80:0/1754333113 >> 172.21.15.80:0/1754333113 conn(0x7f74cc0d0d30 msgr2=0x7f74cc0b4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.725+0000 7f74d4400700 1 -- 172.21.15.80:0/1754333113 shutdown_connections 2024-05-10T04:23:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:32.726+0000 7f74d4400700 1 -- 172.21.15.80:0/1754333113 wait complete. 2024-05-10T04:23:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-05-10T04:23:32.752 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-05-10T04:23:32.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:32.752 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-05-10T04:23:32.822 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-05-10T04:23:32.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:32.822 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-10T04:23:32.865 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:23:32.865 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:23:32.911 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:23:32.911 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:23:32.995 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:23:32.996 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:23:33.078 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:23:33.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.337+0000 7ff84e200700 1 Processor -- start 2024-05-10T04:23:33.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.337+0000 7ff84e200700 1 -- start start 2024-05-10T04:23:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.339+0000 7ff84e200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff848142ca0 0x7ff848142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.339+0000 7ff84e200700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff8480ceec0 0x7ff848071490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.339+0000 7ff84e200700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff848142790 con 0x7ff8480cf2d0 2024-05-10T04:23:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.339+0000 7ff84e200700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8480b4de0 con 0x7ff848142ca0 2024-05-10T04:23:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.339+0000 7ff84e200700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8481430b0 con 0x7ff8480ceec0 2024-05-10T04:23:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.339+0000 7ff84ce00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff848142ca0 0x7ff848142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.339+0000 7ff84d800700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff8480cf2d0 0x7ff8480b2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48958/0 (socket says 172.21.15.80:48958) 2024-05-10T04:23:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.339+0000 7ff84d800700 1 -- 172.21.15.80:0/4127881366 learned_addr learned my addr 172.21.15.80:0/4127881366 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.340+0000 7ff847e00700 1 --2- 172.21.15.80:0/4127881366 >> v2:172.21.15.106:3300/0 conn(0x7ff8480ceec0 0x7ff848071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:33.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.340+0000 7ff84ce00700 1 -- 172.21.15.80:0/4127881366 >> v2:172.21.15.106:3300/0 conn(0x7ff8480ceec0 msgr2=0x7ff848071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:33.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.340+0000 7ff84ce00700 1 --2- 172.21.15.80:0/4127881366 >> v2:172.21.15.106:3300/0 conn(0x7ff8480ceec0 0x7ff848071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:33.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.340+0000 7ff84ce00700 1 -- 172.21.15.80:0/4127881366 >> v1:172.21.15.80:6789/0 conn(0x7ff8480cf2d0 legacy=0x7ff8480b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:33.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.340+0000 7ff84ce00700 1 -- 172.21.15.80:0/4127881366 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff848145b30 con 0x7ff848142ca0 2024-05-10T04:23:33.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.340+0000 7ff84ce00700 1 --2- 172.21.15.80:0/4127881366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff848142ca0 0x7ff848142250 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009840 tx=0x7ff83c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d149363f75ef9405 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:33.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.340+0000 7ff847400700 1 -- 172.21.15.80:0/4127881366 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c011830 con 0x7ff848142ca0 2024-05-10T04:23:33.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.340+0000 7ff847400700 1 -- 172.21.15.80:0/4127881366 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c011990 con 0x7ff848142ca0 2024-05-10T04:23:33.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.340+0000 7ff847400700 1 -- 172.21.15.80:0/4127881366 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c011d20 con 0x7ff848142ca0 2024-05-10T04:23:33.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.341+0000 7ff84e200700 1 -- 172.21.15.80:0/4127881366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff848142ca0 msgr2=0x7ff848142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:33.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.341+0000 7ff84e200700 1 --2- 172.21.15.80:0/4127881366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff848142ca0 0x7ff848142250 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009840 tx=0x7ff83c009b50 comp rx=0 tx=0).stop 2024-05-10T04:23:33.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.341+0000 7ff84e200700 1 -- 172.21.15.80:0/4127881366 shutdown_connections 2024-05-10T04:23:33.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.341+0000 7ff84e200700 1 --2- 172.21.15.80:0/4127881366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff848142ca0 0x7ff848142250 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:33.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.341+0000 7ff84e200700 1 --2- 172.21.15.80:0/4127881366 >> v2:172.21.15.106:3300/0 conn(0x7ff8480ceec0 0x7ff848071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:33.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.341+0000 7ff84e200700 1 -- 172.21.15.80:0/4127881366 >> 172.21.15.80:0/4127881366 conn(0x7ff8480b1dd0 msgr2=0x7ff8480cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:33.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.341+0000 7ff84e200700 1 -- 172.21.15.80:0/4127881366 shutdown_connections 2024-05-10T04:23:33.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.341+0000 7ff84e200700 1 -- 172.21.15.80:0/4127881366 wait complete. 2024-05-10T04:23:33.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.343+0000 7ff84e200700 1 Processor -- start 2024-05-10T04:23:33.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.344+0000 7ff84e200700 1 -- start start 2024-05-10T04:23:33.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.345+0000 7ff84e200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8480ceec0 0x7ff84815dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:33.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.345+0000 7ff84e200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8480cf2d0 0x7ff84813e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:33.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.345+0000 7ff84e200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff848142ca0 0x7ff8481f4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:33.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.345+0000 7ff84e200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84813e0e0 con 0x7ff8480ceec0 2024-05-10T04:23:33.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.345+0000 7ff84e200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84813daf0 con 0x7ff848142ca0 2024-05-10T04:23:33.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.345+0000 7ff84e200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84815d1b0 con 0x7ff8480cf2d0 2024-05-10T04:23:33.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.345+0000 7ff84ce00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8480ceec0 0x7ff84815dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:33.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.345+0000 7ff84ce00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8480ceec0 0x7ff84815dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35332/0 (socket says 172.21.15.80:35332) 2024-05-10T04:23:33.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.345+0000 7ff84ce00700 1 -- 172.21.15.80:0/2588198930 learned_addr learned my addr 172.21.15.80:0/2588198930 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:33.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.346+0000 7ff847e00700 1 --2- 172.21.15.80:0/2588198930 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8480cf2d0 0x7ff84813e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:33.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.346+0000 7ff84d800700 1 --2- 172.21.15.80:0/2588198930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff848142ca0 0x7ff8481f4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:33.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.346+0000 7ff84ce00700 1 -- 172.21.15.80:0/2588198930 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8480cf2d0 msgr2=0x7ff84813e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:33.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.346+0000 7ff84ce00700 1 --2- 172.21.15.80:0/2588198930 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8480cf2d0 0x7ff84813e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:33.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.346+0000 7ff84ce00700 1 -- 172.21.15.80:0/2588198930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff848142ca0 msgr2=0x7ff8481f4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:33.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.346+0000 7ff84ce00700 1 --2- 172.21.15.80:0/2588198930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff848142ca0 0x7ff8481f4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:33.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.346+0000 7ff84ce00700 1 -- 172.21.15.80:0/2588198930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c0094a0 con 0x7ff8480ceec0 2024-05-10T04:23:33.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.346+0000 7ff84ce00700 1 --2- 172.21.15.80:0/2588198930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8480ceec0 0x7ff84815dac0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009b90 tx=0x7ff83c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:33.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.346+0000 7ff844c00700 1 -- 172.21.15.80:0/2588198930 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0036a0 con 0x7ff8480ceec0 2024-05-10T04:23:33.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.346+0000 7ff844c00700 1 -- 172.21.15.80:0/2588198930 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c01e070 con 0x7ff8480ceec0 2024-05-10T04:23:33.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.346+0000 7ff84e200700 1 -- 172.21.15.80:0/2588198930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8481f5180 con 0x7ff8480ceec0 2024-05-10T04:23:33.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.346+0000 7ff844c00700 1 -- 172.21.15.80:0/2588198930 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c003a60 con 0x7ff8480ceec0 2024-05-10T04:23:33.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.347+0000 7ff84e200700 1 -- 172.21.15.80:0/2588198930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84815e000 con 0x7ff8480ceec0 2024-05-10T04:23:33.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.347+0000 7ff84e200700 1 -- 172.21.15.80:0/2588198930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff848074af0 con 0x7ff8480ceec0 2024-05-10T04:23:33.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.348+0000 7ff844c00700 1 -- 172.21.15.80:0/2588198930 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff83c003bc0 con 0x7ff8480ceec0 2024-05-10T04:23:33.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.349+0000 7ff844c00700 1 --2- 172.21.15.80:0/2588198930 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff82806ac90 0x7ff82806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:33.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.349+0000 7ff844c00700 1 -- 172.21.15.80:0/2588198930 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff83c08a390 con 0x7ff8480ceec0 2024-05-10T04:23:33.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.350+0000 7ff847e00700 1 --2- 172.21.15.80:0/2588198930 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff82806ac90 0x7ff82806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:33.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.351+0000 7ff847e00700 1 --2- 172.21.15.80:0/2588198930 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff82806ac90 0x7ff82806d1a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff848140040 tx=0x7ff834008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:33.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.354+0000 7ff844c00700 1 -- 172.21.15.80:0/2588198930 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff83c0554e0 con 0x7ff8480ceec0 2024-05-10T04:23:33.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.566+0000 7ff84e200700 1 -- 172.21.15.80:0/2588198930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8480cd920 con 0x7ff8480ceec0 2024-05-10T04:23:33.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.567+0000 7ff844c00700 1 -- 172.21.15.80:0/2588198930 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16286 (secure 0 0 0) 0x7ff83c058b00 con 0x7ff8480ceec0 2024-05-10T04:23:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:33.569 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:23:20.092453+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:23:33.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.569+0000 7ff84e200700 1 -- 172.21.15.80:0/2588198930 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff82806ac90 msgr2=0x7ff82806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:33.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.569+0000 7ff84e200700 1 --2- 172.21.15.80:0/2588198930 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff82806ac90 0x7ff82806d1a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff848140040 tx=0x7ff834008040 comp rx=0 tx=0).stop 2024-05-10T04:23:33.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.569+0000 7ff84e200700 1 -- 172.21.15.80:0/2588198930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8480ceec0 msgr2=0x7ff84815dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:33.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.569+0000 7ff84e200700 1 --2- 172.21.15.80:0/2588198930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8480ceec0 0x7ff84815dac0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009b90 tx=0x7ff83c004750 comp rx=0 tx=0).stop 2024-05-10T04:23:33.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.569+0000 7ff84e200700 1 -- 172.21.15.80:0/2588198930 shutdown_connections 2024-05-10T04:23:33.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.569+0000 7ff84e200700 1 --2- 172.21.15.80:0/2588198930 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff82806ac90 0x7ff82806d1a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:33.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.569+0000 7ff84e200700 1 --2- 172.21.15.80:0/2588198930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8480ceec0 0x7ff84815dac0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:33.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.569+0000 7ff84e200700 1 --2- 172.21.15.80:0/2588198930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff848142ca0 0x7ff8481f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:33.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.569+0000 7ff84e200700 1 --2- 172.21.15.80:0/2588198930 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8480cf2d0 0x7ff84813e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:33.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.569+0000 7ff84e200700 1 -- 172.21.15.80:0/2588198930 >> 172.21.15.80:0/2588198930 conn(0x7ff8480b1dd0 msgr2=0x7ff8480addb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:33.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.570+0000 7ff84e200700 1 -- 172.21.15.80:0/2588198930 shutdown_connections 2024-05-10T04:23:33.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.570+0000 7ff84e200700 1 -- 172.21.15.80:0/2588198930 wait complete. 2024-05-10T04:23:33.596 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:22:26.793377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:22:35.751764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:22:36.465587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:23:33.596 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:23:33.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.857+0000 7ffa1f200700 1 Processor -- start 2024-05-10T04:23:33.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.857+0000 7ffa1f200700 1 -- start start 2024-05-10T04:23:33.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.859+0000 7ffa1f200700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ffa200b98e0 0x7ffa200d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:33.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.859+0000 7ffa1f200700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa200d2e50 con 0x7ffa200b6230 2024-05-10T04:23:33.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.859+0000 7ffa1f200700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa200d3130 con 0x7ffa200d0c90 2024-05-10T04:23:33.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.859+0000 7ffa1f200700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa200d3410 con 0x7ffa200b98e0 2024-05-10T04:23:33.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.859+0000 7ffa17e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ffa200b6230 0x7ffa200d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48964/0 (socket says 172.21.15.80:48964) 2024-05-10T04:23:33.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.859+0000 7ffa17e00700 1 -- 172.21.15.80:0/3282502032 learned_addr learned my addr 172.21.15.80:0/3282502032 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:33.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.860+0000 7ffa1de00700 1 --2- 172.21.15.80:0/3282502032 >> v2:172.21.15.106:3300/0 conn(0x7ffa200b98e0 0x7ffa200d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:33.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.860+0000 7ffa1d400700 1 -- 172.21.15.80:0/3282502032 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347260156 0 0) 0x7ffa200d2e50 con 0x7ffa200b6230 2024-05-10T04:23:33.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.860+0000 7ffa1d400700 1 -- 172.21.15.80:0/3282502032 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa040035b0 con 0x7ffa200b6230 2024-05-10T04:23:33.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.860+0000 7ffa1d400700 1 -- 172.21.15.80:0/3282502032 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3416515909 0 0) 0x7ffa040035b0 con 0x7ffa200b6230 2024-05-10T04:23:33.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.860+0000 7ffa1de00700 1 -- 172.21.15.80:0/3282502032 >> v1:172.21.15.106:6789/0 conn(0x7ffa200d0c90 legacy=0x7ffa2015d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:33.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.860+0000 7ffa1de00700 1 -- 172.21.15.80:0/3282502032 >> v1:172.21.15.80:6789/0 conn(0x7ffa200b6230 legacy=0x7ffa200d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:33.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.860+0000 7ffa1de00700 1 -- 172.21.15.80:0/3282502032 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa200b7470 con 0x7ffa200b98e0 2024-05-10T04:23:33.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.860+0000 7ffa1de00700 1 --2- 172.21.15.80:0/3282502032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa200b98e0 0x7ffa200d2520 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009840 tx=0x7ffa10009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70556dd72fe8809e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:33.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.861+0000 7ffa1d400700 1 -- 172.21.15.80:0/3282502032 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa08001670 con 0x7ffa200b98e0 2024-05-10T04:23:33.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.861+0000 7ffa1d400700 1 -- 172.21.15.80:0/3282502032 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa10004030 con 0x7ffa200b98e0 2024-05-10T04:23:33.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.861+0000 7ffa1d400700 1 -- 172.21.15.80:0/3282502032 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa100043a0 con 0x7ffa200b98e0 2024-05-10T04:23:33.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.861+0000 7ffa1f200700 1 -- 172.21.15.80:0/3282502032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa200b98e0 msgr2=0x7ffa200d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:33.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.861+0000 7ffa1f200700 1 --2- 172.21.15.80:0/3282502032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa200b98e0 0x7ffa200d2520 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009840 tx=0x7ffa10009b50 comp rx=0 tx=0).stop 2024-05-10T04:23:33.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.862+0000 7ffa1f200700 1 -- 172.21.15.80:0/3282502032 shutdown_connections 2024-05-10T04:23:33.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.862+0000 7ffa1f200700 1 --2- 172.21.15.80:0/3282502032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa200b98e0 0x7ffa200d2520 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:33.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.862+0000 7ffa1f200700 1 -- 172.21.15.80:0/3282502032 >> 172.21.15.80:0/3282502032 conn(0x7ffa200676c0 msgr2=0x7ffa2006c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:33.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.862+0000 7ffa1f200700 1 -- 172.21.15.80:0/3282502032 shutdown_connections 2024-05-10T04:23:33.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.862+0000 7ffa1f200700 1 -- 172.21.15.80:0/3282502032 wait complete. 2024-05-10T04:23:33.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.864+0000 7ffa1f200700 1 Processor -- start 2024-05-10T04:23:33.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.864+0000 7ffa1f200700 1 -- start start 2024-05-10T04:23:33.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.865+0000 7ffa1f200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa200b6230 0x7ffa201f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:33.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.865+0000 7ffa1f200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa200b98e0 0x7ffa200cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:33.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.865+0000 7ffa1f200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffa200d0c90 0x7ffa201e83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:33.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.865+0000 7ffa1f200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa200cb6f0 con 0x7ffa200b6230 2024-05-10T04:23:33.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.865+0000 7ffa1f200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa201e78d0 con 0x7ffa200b98e0 2024-05-10T04:23:33.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.865+0000 7ffa1f200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa201f7410 con 0x7ffa200d0c90 2024-05-10T04:23:33.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.866+0000 7ffa1de00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa200b6230 0x7ffa201f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:33.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.866+0000 7ffa1de00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa200b6230 0x7ffa201f6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35348/0 (socket says 172.21.15.80:35348) 2024-05-10T04:23:33.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.866+0000 7ffa1de00700 1 -- 172.21.15.80:0/3018344348 learned_addr learned my addr 172.21.15.80:0/3018344348 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:33.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.866+0000 7ffa17e00700 1 --2- 172.21.15.80:0/3018344348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa200b98e0 0x7ffa200cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:33.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.866+0000 7ffa1e800700 1 --2- 172.21.15.80:0/3018344348 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffa200d0c90 0x7ffa201e83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:33.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.866+0000 7ffa1de00700 1 -- 172.21.15.80:0/3018344348 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffa200d0c90 msgr2=0x7ffa201e83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:33.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.866+0000 7ffa1de00700 1 --2- 172.21.15.80:0/3018344348 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffa200d0c90 0x7ffa201e83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:33.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.866+0000 7ffa1de00700 1 -- 172.21.15.80:0/3018344348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa200b98e0 msgr2=0x7ffa200cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:33.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.866+0000 7ffa1de00700 1 --2- 172.21.15.80:0/3018344348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa200b98e0 0x7ffa200cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:33.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.866+0000 7ffa1de00700 1 -- 172.21.15.80:0/3018344348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa100094a0 con 0x7ffa200b6230 2024-05-10T04:23:33.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.866+0000 7ffa17e00700 1 --2- 172.21.15.80:0/3018344348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa200b98e0 0x7ffa200cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:33.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.866+0000 7ffa1de00700 1 --2- 172.21.15.80:0/3018344348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa200b6230 0x7ffa201f6ed0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ffa10000c00 tx=0x7ffa10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:33.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.867+0000 7ffa16000700 1 -- 172.21.15.80:0/3018344348 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10003df0 con 0x7ffa200b6230 2024-05-10T04:23:33.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.867+0000 7ffa16000700 1 -- 172.21.15.80:0/3018344348 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1001f070 con 0x7ffa200b6230 2024-05-10T04:23:33.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.867+0000 7ffa1f200700 1 -- 172.21.15.80:0/3018344348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa201f5670 con 0x7ffa200b6230 2024-05-10T04:23:33.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.867+0000 7ffa16000700 1 -- 172.21.15.80:0/3018344348 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10011870 con 0x7ffa200b6230 2024-05-10T04:23:33.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.867+0000 7ffa1f200700 1 -- 172.21.15.80:0/3018344348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa200cbbe0 con 0x7ffa200b6230 2024-05-10T04:23:33.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.868+0000 7ffa1f200700 1 -- 172.21.15.80:0/3018344348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa20074af0 con 0x7ffa200b6230 2024-05-10T04:23:33.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.869+0000 7ffa16000700 1 -- 172.21.15.80:0/3018344348 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffa10021030 con 0x7ffa200b6230 2024-05-10T04:23:33.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.869+0000 7ffa16000700 1 --2- 172.21.15.80:0/3018344348 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff9fc06ac90 0x7ff9fc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:33.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.870+0000 7ffa16000700 1 -- 172.21.15.80:0/3018344348 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ffa1008a9d0 con 0x7ffa200b6230 2024-05-10T04:23:33.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.870+0000 7ffa17e00700 1 --2- 172.21.15.80:0/3018344348 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff9fc06ac90 0x7ff9fc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:33.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.871+0000 7ffa17e00700 1 --2- 172.21.15.80:0/3018344348 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff9fc06ac90 0x7ff9fc06d1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffa08001eb0 tx=0x7ffa08001c80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:33.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:33.874+0000 7ffa16000700 1 -- 172.21.15.80:0/3018344348 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ffa10059640 con 0x7ffa200b6230 2024-05-10T04:23:34.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.080+0000 7ffa1f200700 1 -- 172.21.15.80:0/3018344348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa2006b260 con 0x7ffa200b6230 2024-05-10T04:23:34.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.080+0000 7ffa16000700 1 -- 172.21.15.80:0/3018344348 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa100591d0 con 0x7ffa200b6230 2024-05-10T04:23:34.081 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-10T04:23:34.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.083+0000 7ffa1f200700 1 -- 172.21.15.80:0/3018344348 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff9fc06ac90 msgr2=0x7ff9fc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:34.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.083+0000 7ffa1f200700 1 --2- 172.21.15.80:0/3018344348 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff9fc06ac90 0x7ff9fc06d1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffa08001eb0 tx=0x7ffa08001c80 comp rx=0 tx=0).stop 2024-05-10T04:23:34.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.083+0000 7ffa1f200700 1 -- 172.21.15.80:0/3018344348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa200b6230 msgr2=0x7ffa201f6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:34.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.083+0000 7ffa1f200700 1 --2- 172.21.15.80:0/3018344348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa200b6230 0x7ffa201f6ed0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ffa10000c00 tx=0x7ffa10004750 comp rx=0 tx=0).stop 2024-05-10T04:23:34.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.083+0000 7ffa1f200700 1 -- 172.21.15.80:0/3018344348 shutdown_connections 2024-05-10T04:23:34.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.083+0000 7ffa1f200700 1 --2- 172.21.15.80:0/3018344348 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff9fc06ac90 0x7ff9fc06d1a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.083+0000 7ffa1f200700 1 --2- 172.21.15.80:0/3018344348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa200b6230 0x7ffa201f6ed0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.083+0000 7ffa1f200700 1 --2- 172.21.15.80:0/3018344348 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffa200d0c90 0x7ffa201e83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.083+0000 7ffa1f200700 1 --2- 172.21.15.80:0/3018344348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa200b98e0 0x7ffa200cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.083+0000 7ffa1f200700 1 -- 172.21.15.80:0/3018344348 >> 172.21.15.80:0/3018344348 conn(0x7ffa200676c0 msgr2=0x7ffa200b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:34.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.083+0000 7ffa1f200700 1 -- 172.21.15.80:0/3018344348 shutdown_connections 2024-05-10T04:23:34.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.083+0000 7ffa1f200700 1 -- 172.21.15.80:0/3018344348 wait complete. 2024-05-10T04:23:34.110 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:23:34.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.375+0000 7f6a95200700 1 Processor -- start 2024-05-10T04:23:34.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.375+0000 7f6a95200700 1 -- start start 2024-05-10T04:23:34.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.376+0000 7f6a95200700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6a90158c70 0x7f6a9015ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:34.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.376+0000 7f6a95200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a90162000 0x7f6a9006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:34.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.376+0000 7f6a95200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a900b5c90 0x7f6a900b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:34.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.377+0000 7f6a95200700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9006c5f0 con 0x7f6a900b5c90 2024-05-10T04:23:34.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.377+0000 7f6a95200700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a900b65e0 con 0x7f6a90158c70 2024-05-10T04:23:34.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.377+0000 7f6a95200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a90162850 con 0x7f6a90162000 2024-05-10T04:23:34.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.377+0000 7f6a8e800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a900b5c90 0x7f6a900b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:34.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.377+0000 7f6a8e800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a900b5c90 0x7f6a900b60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35356/0 (socket says 172.21.15.80:35356) 2024-05-10T04:23:34.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.377+0000 7f6a8e800700 1 -- 172.21.15.80:0/1383629048 learned_addr learned my addr 172.21.15.80:0/1383629048 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:34.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.377+0000 7f6a8d400700 1 --2- 172.21.15.80:0/1383629048 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a90162000 0x7f6a9006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:34.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.377+0000 7f6a8de00700 1 --2- 172.21.15.80:0/1383629048 >> v2:172.21.15.106:3300/0 conn(0x7f6a90158c70 0x7f6a9015ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:34.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.377+0000 7f6a8e800700 1 -- 172.21.15.80:0/1383629048 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a90162000 msgr2=0x7f6a9006ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:34.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.377+0000 7f6a8e800700 1 --2- 172.21.15.80:0/1383629048 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a90162000 0x7f6a9006ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.377+0000 7f6a8e800700 1 -- 172.21.15.80:0/1383629048 >> v2:172.21.15.106:3300/0 conn(0x7f6a90158c70 msgr2=0x7f6a9015ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:34.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.377+0000 7f6a8e800700 1 --2- 172.21.15.80:0/1383629048 >> v2:172.21.15.106:3300/0 conn(0x7f6a90158c70 0x7f6a9015ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.377+0000 7f6a8e800700 1 -- 172.21.15.80:0/1383629048 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a90162b30 con 0x7f6a900b5c90 2024-05-10T04:23:34.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.377+0000 7f6a8d400700 1 --2- 172.21.15.80:0/1383629048 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a90162000 0x7f6a9006ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:34.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.377+0000 7f6a8e800700 1 --2- 172.21.15.80:0/1383629048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a900b5c90 0x7f6a900b60a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6a9008cba0 tx=0x7f6a8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3afa3de21a018ac5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:34.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.378+0000 7f6a8ca00700 1 -- 172.21.15.80:0/1383629048 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800e070 con 0x7f6a900b5c90 2024-05-10T04:23:34.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.378+0000 7f6a8ca00700 1 -- 172.21.15.80:0/1383629048 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8800b9c0 con 0x7f6a900b5c90 2024-05-10T04:23:34.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.378+0000 7f6a8ca00700 1 -- 172.21.15.80:0/1383629048 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800bd70 con 0x7f6a900b5c90 2024-05-10T04:23:34.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.378+0000 7f6a95200700 1 -- 172.21.15.80:0/1383629048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a900b5c90 msgr2=0x7f6a900b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:34.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.378+0000 7f6a95200700 1 --2- 172.21.15.80:0/1383629048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a900b5c90 0x7f6a900b60a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6a9008cba0 tx=0x7f6a8800b330 comp rx=0 tx=0).stop 2024-05-10T04:23:34.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.378+0000 7f6a95200700 1 -- 172.21.15.80:0/1383629048 shutdown_connections 2024-05-10T04:23:34.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.378+0000 7f6a95200700 1 --2- 172.21.15.80:0/1383629048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a900b5c90 0x7f6a900b60a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.378+0000 7f6a95200700 1 --2- 172.21.15.80:0/1383629048 >> v2:172.21.15.106:3300/0 conn(0x7f6a90158c70 0x7f6a9015ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.378+0000 7f6a95200700 1 --2- 172.21.15.80:0/1383629048 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a90162000 0x7f6a9006ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.378+0000 7f6a95200700 1 -- 172.21.15.80:0/1383629048 >> 172.21.15.80:0/1383629048 conn(0x7f6a900d0d30 msgr2=0x7f6a900d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:34.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.379+0000 7f6a95200700 1 -- 172.21.15.80:0/1383629048 shutdown_connections 2024-05-10T04:23:34.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.379+0000 7f6a95200700 1 -- 172.21.15.80:0/1383629048 wait complete. 2024-05-10T04:23:34.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.381+0000 7f6a95200700 1 Processor -- start 2024-05-10T04:23:34.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.381+0000 7f6a95200700 1 -- start start 2024-05-10T04:23:34.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.382+0000 7f6a95200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a900b5c90 0x7f6a9014aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:34.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.383+0000 7f6a95200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a90158c70 0x7f6a9015d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.383+0000 7f6a95200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a90162000 0x7f6a900c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.383+0000 7f6a95200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a90149010 con 0x7f6a90158c70 2024-05-10T04:23:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.383+0000 7f6a95200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a90148180 con 0x7f6a90162000 2024-05-10T04:23:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.383+0000 7f6a95200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9014bc50 con 0x7f6a900b5c90 2024-05-10T04:23:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.383+0000 7f6a8d400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a90158c70 0x7f6a9015d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.383+0000 7f6a8d400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a90158c70 0x7f6a9015d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35372/0 (socket says 172.21.15.80:35372) 2024-05-10T04:23:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.383+0000 7f6a8d400700 1 -- 172.21.15.80:0/2316737919 learned_addr learned my addr 172.21.15.80:0/2316737919 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.383+0000 7f6a8de00700 1 --2- 172.21.15.80:0/2316737919 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a900b5c90 0x7f6a9014aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.383+0000 7f6a8e800700 1 --2- 172.21.15.80:0/2316737919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a90162000 0x7f6a900c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.383+0000 7f6a8d400700 1 -- 172.21.15.80:0/2316737919 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a900b5c90 msgr2=0x7f6a9014aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.383+0000 7f6a8d400700 1 --2- 172.21.15.80:0/2316737919 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a900b5c90 0x7f6a9014aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.383+0000 7f6a8d400700 1 -- 172.21.15.80:0/2316737919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a90162000 msgr2=0x7f6a900c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.383+0000 7f6a8d400700 1 --2- 172.21.15.80:0/2316737919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a90162000 0x7f6a900c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.383+0000 7f6a8d400700 1 -- 172.21.15.80:0/2316737919 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a88009b30 con 0x7f6a90158c70 2024-05-10T04:23:34.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.384+0000 7f6a8d400700 1 --2- 172.21.15.80:0/2316737919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a90158c70 0x7f6a9015d8c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00e840 tx=0x7f6a7c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:34.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.384+0000 7f6a86000700 1 -- 172.21.15.80:0/2316737919 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c00c020 con 0x7f6a90158c70 2024-05-10T04:23:34.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.384+0000 7f6a86000700 1 -- 172.21.15.80:0/2316737919 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7c004230 con 0x7f6a90158c70 2024-05-10T04:23:34.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.384+0000 7f6a95200700 1 -- 172.21.15.80:0/2316737919 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9014afd0 con 0x7f6a90158c70 2024-05-10T04:23:34.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.384+0000 7f6a86000700 1 -- 172.21.15.80:0/2316737919 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c0036a0 con 0x7f6a90158c70 2024-05-10T04:23:34.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.384+0000 7f6a95200700 1 -- 172.21.15.80:0/2316737919 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a90148670 con 0x7f6a90158c70 2024-05-10T04:23:34.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.385+0000 7f6a95200700 1 -- 172.21.15.80:0/2316737919 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a900732b0 con 0x7f6a90158c70 2024-05-10T04:23:34.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.386+0000 7f6a86000700 1 -- 172.21.15.80:0/2316737919 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6a7c003800 con 0x7f6a90158c70 2024-05-10T04:23:34.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.387+0000 7f6a86000700 1 --2- 172.21.15.80:0/2316737919 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a7006acc0 0x7f6a7006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:34.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.387+0000 7f6a86000700 1 -- 172.21.15.80:0/2316737919 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6a7c089080 con 0x7f6a90158c70 2024-05-10T04:23:34.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.388+0000 7f6a8de00700 1 --2- 172.21.15.80:0/2316737919 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a7006acc0 0x7f6a7006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:34.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.388+0000 7f6a8de00700 1 --2- 172.21.15.80:0/2316737919 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a7006acc0 0x7f6a7006d1d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6a900d2210 tx=0x7f6a80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:34.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.391+0000 7f6a86000700 1 -- 172.21.15.80:0/2316737919 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6a7c054150 con 0x7f6a90158c70 2024-05-10T04:23:34.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.594+0000 7f6a95200700 1 -- 172.21.15.80:0/2316737919 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a90074af0 con 0x7f6a90158c70 2024-05-10T04:23:34.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.595+0000 7f6a86000700 1 -- 172.21.15.80:0/2316737919 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6a7c057770 con 0x7f6a90158c70 2024-05-10T04:23:34.596 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-10T04:23:34.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.597+0000 7f6a95200700 1 -- 172.21.15.80:0/2316737919 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a7006acc0 msgr2=0x7f6a7006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:34.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.597+0000 7f6a95200700 1 --2- 172.21.15.80:0/2316737919 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a7006acc0 0x7f6a7006d1d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6a900d2210 tx=0x7f6a80008040 comp rx=0 tx=0).stop 2024-05-10T04:23:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.597+0000 7f6a95200700 1 -- 172.21.15.80:0/2316737919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a90158c70 msgr2=0x7f6a9015d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.597+0000 7f6a95200700 1 --2- 172.21.15.80:0/2316737919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a90158c70 0x7f6a9015d8c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00e840 tx=0x7f6a7c00eb50 comp rx=0 tx=0).stop 2024-05-10T04:23:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.597+0000 7f6a95200700 1 -- 172.21.15.80:0/2316737919 shutdown_connections 2024-05-10T04:23:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.597+0000 7f6a95200700 1 --2- 172.21.15.80:0/2316737919 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a7006acc0 0x7f6a7006d1d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.597+0000 7f6a95200700 1 --2- 172.21.15.80:0/2316737919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a90162000 0x7f6a900c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.597+0000 7f6a95200700 1 --2- 172.21.15.80:0/2316737919 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a900b5c90 0x7f6a9014aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.597+0000 7f6a95200700 1 --2- 172.21.15.80:0/2316737919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a90158c70 0x7f6a9015d8c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.597+0000 7f6a95200700 1 -- 172.21.15.80:0/2316737919 >> 172.21.15.80:0/2316737919 conn(0x7f6a900d0d30 msgr2=0x7f6a900b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.597+0000 7f6a95200700 1 -- 172.21.15.80:0/2316737919 shutdown_connections 2024-05-10T04:23:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.597+0000 7f6a95200700 1 -- 172.21.15.80:0/2316737919 wait complete. 2024-05-10T04:23:34.625 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:23:34.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.887+0000 7ff925200700 1 Processor -- start 2024-05-10T04:23:34.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.888+0000 7ff925200700 1 -- start start 2024-05-10T04:23:34.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.889+0000 7ff925200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff920158c70 0x7ff92015ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:34.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.889+0000 7ff925200700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff920162000 0x7ff92006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:34.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.889+0000 7ff925200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff9200b5c90 0x7ff9200b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:34.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.889+0000 7ff925200700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff92006c5f0 con 0x7ff9200b5c90 2024-05-10T04:23:34.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.889+0000 7ff925200700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9200b65e0 con 0x7ff920162000 2024-05-10T04:23:34.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.889+0000 7ff925200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff920162850 con 0x7ff920158c70 2024-05-10T04:23:34.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.890+0000 7ff91e800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff9200b5c90 0x7ff9200b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:34.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.890+0000 7ff91e800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff9200b5c90 0x7ff9200b60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35388/0 (socket says 172.21.15.80:35388) 2024-05-10T04:23:34.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.890+0000 7ff91e800700 1 -- 172.21.15.80:0/3843800850 learned_addr learned my addr 172.21.15.80:0/3843800850 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:34.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.890+0000 7ff917e00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff920162000 0x7ff92006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:34.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.890+0000 7ff91de00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff920158c70 0x7ff92015ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:34.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.890+0000 7ff91e800700 1 -- 172.21.15.80:0/3843800850 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff920158c70 msgr2=0x7ff92015ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:34.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.890+0000 7ff91e800700 1 --2- 172.21.15.80:0/3843800850 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff920158c70 0x7ff92015ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.890+0000 7ff91e800700 1 -- 172.21.15.80:0/3843800850 >> v2:172.21.15.106:3300/0 conn(0x7ff920162000 msgr2=0x7ff92006ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:34.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.890+0000 7ff91e800700 1 --2- 172.21.15.80:0/3843800850 >> v2:172.21.15.106:3300/0 conn(0x7ff920162000 0x7ff92006ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.890+0000 7ff91e800700 1 -- 172.21.15.80:0/3843800850 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff920162b30 con 0x7ff9200b5c90 2024-05-10T04:23:34.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.891+0000 7ff91e800700 1 --2- 172.21.15.80:0/3843800850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9200b5c90 0x7ff9200b60a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff92008c970 tx=0x7ff91800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7421d6f2e300e6f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:34.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.891+0000 7ff91d400700 1 -- 172.21.15.80:0/3843800850 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91800e070 con 0x7ff9200b5c90 2024-05-10T04:23:34.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.891+0000 7ff91d400700 1 -- 172.21.15.80:0/3843800850 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91800b910 con 0x7ff9200b5c90 2024-05-10T04:23:34.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.891+0000 7ff91d400700 1 -- 172.21.15.80:0/3843800850 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91800bcc0 con 0x7ff9200b5c90 2024-05-10T04:23:34.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.892+0000 7ff925200700 1 -- 172.21.15.80:0/3843800850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9200b5c90 msgr2=0x7ff9200b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:34.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.892+0000 7ff925200700 1 --2- 172.21.15.80:0/3843800850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9200b5c90 0x7ff9200b60a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff92008c970 tx=0x7ff91800b330 comp rx=0 tx=0).stop 2024-05-10T04:23:34.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.892+0000 7ff925200700 1 -- 172.21.15.80:0/3843800850 shutdown_connections 2024-05-10T04:23:34.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.892+0000 7ff925200700 1 --2- 172.21.15.80:0/3843800850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9200b5c90 0x7ff9200b60a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.892+0000 7ff925200700 1 --2- 172.21.15.80:0/3843800850 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff920158c70 0x7ff92015ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.892+0000 7ff925200700 1 --2- 172.21.15.80:0/3843800850 >> v2:172.21.15.106:3300/0 conn(0x7ff920162000 0x7ff92006ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.892+0000 7ff925200700 1 -- 172.21.15.80:0/3843800850 >> 172.21.15.80:0/3843800850 conn(0x7ff9200d0d30 msgr2=0x7ff9200d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:34.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.892+0000 7ff925200700 1 -- 172.21.15.80:0/3843800850 shutdown_connections 2024-05-10T04:23:34.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.892+0000 7ff925200700 1 -- 172.21.15.80:0/3843800850 wait complete. 2024-05-10T04:23:34.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.894+0000 7ff925200700 1 Processor -- start 2024-05-10T04:23:34.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.894+0000 7ff925200700 1 -- start start 2024-05-10T04:23:34.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.896+0000 7ff925200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9200b5c90 0x7ff9200cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:34.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.896+0000 7ff925200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff920158c70 0x7ff9200c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:34.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.896+0000 7ff925200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff920162000 0x7ff9200ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:34.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.896+0000 7ff925200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9200ccbf0 con 0x7ff9200b5c90 2024-05-10T04:23:34.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.896+0000 7ff925200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9200cbe70 con 0x7ff920158c70 2024-05-10T04:23:34.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.896+0000 7ff925200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff920148070 con 0x7ff920162000 2024-05-10T04:23:34.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.896+0000 7ff91de00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9200b5c90 0x7ff9200cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:34.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.896+0000 7ff91de00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9200b5c90 0x7ff9200cf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35390/0 (socket says 172.21.15.80:35390) 2024-05-10T04:23:34.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.896+0000 7ff91de00700 1 -- 172.21.15.80:0/1097144792 learned_addr learned my addr 172.21.15.80:0/1097144792 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:34.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.896+0000 7ff917e00700 1 --2- 172.21.15.80:0/1097144792 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff920158c70 0x7ff9200c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:34.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.896+0000 7ff91e800700 1 --2- 172.21.15.80:0/1097144792 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff920162000 0x7ff9200ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:34.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.896+0000 7ff91de00700 1 -- 172.21.15.80:0/1097144792 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff920162000 msgr2=0x7ff9200ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:34.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.896+0000 7ff91de00700 1 --2- 172.21.15.80:0/1097144792 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff920162000 0x7ff9200ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.896+0000 7ff91de00700 1 -- 172.21.15.80:0/1097144792 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff920158c70 msgr2=0x7ff9200c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:34.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.896+0000 7ff91de00700 1 --2- 172.21.15.80:0/1097144792 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff920158c70 0x7ff9200c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:34.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.896+0000 7ff91de00700 1 -- 172.21.15.80:0/1097144792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff918009b30 con 0x7ff9200b5c90 2024-05-10T04:23:34.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.897+0000 7ff91de00700 1 --2- 172.21.15.80:0/1097144792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9200b5c90 0x7ff9200cf1f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff91000e870 tx=0x7ff91000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:34.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.897+0000 7ff916000700 1 -- 172.21.15.80:0/1097144792 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91000c640 con 0x7ff9200b5c90 2024-05-10T04:23:34.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.897+0000 7ff916000700 1 -- 172.21.15.80:0/1097144792 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91000c7a0 con 0x7ff9200b5c90 2024-05-10T04:23:34.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.897+0000 7ff925200700 1 -- 172.21.15.80:0/1097144792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff920148f30 con 0x7ff9200b5c90 2024-05-10T04:23:34.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.897+0000 7ff916000700 1 -- 172.21.15.80:0/1097144792 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91000cb30 con 0x7ff9200b5c90 2024-05-10T04:23:34.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.897+0000 7ff925200700 1 -- 172.21.15.80:0/1097144792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff920148600 con 0x7ff9200b5c90 2024-05-10T04:23:34.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.898+0000 7ff925200700 1 -- 172.21.15.80:0/1097144792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9200732b0 con 0x7ff9200b5c90 2024-05-10T04:23:34.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.899+0000 7ff916000700 1 -- 172.21.15.80:0/1097144792 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff91000cc90 con 0x7ff9200b5c90 2024-05-10T04:23:34.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.900+0000 7ff916000700 1 --2- 172.21.15.80:0/1097144792 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff8fc06ac90 0x7ff8fc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:34.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.901+0000 7ff916000700 1 -- 172.21.15.80:0/1097144792 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff910089400 con 0x7ff9200b5c90 2024-05-10T04:23:34.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.901+0000 7ff917e00700 1 --2- 172.21.15.80:0/1097144792 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff8fc06ac90 0x7ff8fc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:34.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.902+0000 7ff917e00700 1 --2- 172.21.15.80:0/1097144792 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff8fc06ac90 0x7ff8fc06d1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff920158a60 tx=0x7ff908008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:34.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:34.905+0000 7ff916000700 1 -- 172.21.15.80:0/1097144792 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff910054430 con 0x7ff9200b5c90 2024-05-10T04:23:35.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.110+0000 7ff925200700 1 -- 172.21.15.80:0/1097144792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff920074af0 con 0x7ff9200b5c90 2024-05-10T04:23:35.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.111+0000 7ff916000700 1 -- 172.21.15.80:0/1097144792 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff910057a50 con 0x7ff9200b5c90 2024-05-10T04:23:35.112 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-10T04:23:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.113+0000 7ff925200700 1 -- 172.21.15.80:0/1097144792 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff8fc06ac90 msgr2=0x7ff8fc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.113+0000 7ff925200700 1 --2- 172.21.15.80:0/1097144792 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff8fc06ac90 0x7ff8fc06d1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff920158a60 tx=0x7ff908008040 comp rx=0 tx=0).stop 2024-05-10T04:23:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.113+0000 7ff925200700 1 -- 172.21.15.80:0/1097144792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9200b5c90 msgr2=0x7ff9200cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.113+0000 7ff925200700 1 --2- 172.21.15.80:0/1097144792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9200b5c90 0x7ff9200cf1f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff91000e870 tx=0x7ff91000ec30 comp rx=0 tx=0).stop 2024-05-10T04:23:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.113+0000 7ff925200700 1 -- 172.21.15.80:0/1097144792 shutdown_connections 2024-05-10T04:23:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.113+0000 7ff925200700 1 --2- 172.21.15.80:0/1097144792 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff8fc06ac90 0x7ff8fc06d1a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.113+0000 7ff925200700 1 --2- 172.21.15.80:0/1097144792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9200b5c90 0x7ff9200cf1f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.113+0000 7ff925200700 1 --2- 172.21.15.80:0/1097144792 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff920162000 0x7ff9200ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.113+0000 7ff925200700 1 --2- 172.21.15.80:0/1097144792 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff920158c70 0x7ff9200c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.113+0000 7ff925200700 1 -- 172.21.15.80:0/1097144792 >> 172.21.15.80:0/1097144792 conn(0x7ff9200d0d30 msgr2=0x7ff9200b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.113+0000 7ff925200700 1 -- 172.21.15.80:0/1097144792 shutdown_connections 2024-05-10T04:23:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.113+0000 7ff925200700 1 -- 172.21.15.80:0/1097144792 wait complete. 2024-05-10T04:23:35.139 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T04:23:35.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.399+0000 7f3e52800700 1 Processor -- start 2024-05-10T04:23:35.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.399+0000 7f3e52800700 1 -- start start 2024-05-10T04:23:35.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.401+0000 7f3e52800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e4c0b98e0 0x7f3e4c0d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:35.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.401+0000 7f3e52800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e4c0b6230 0x7f3e4c0d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:35.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.401+0000 7f3e52800700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3e4c0d0ac0 0x7f3e4c15d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:35.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.401+0000 7f3e52800700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c0d0ed0 con 0x7f3e4c0b98e0 2024-05-10T04:23:35.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.401+0000 7f3e52800700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c0d2e50 con 0x7f3e4c0d0ac0 2024-05-10T04:23:35.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.401+0000 7f3e52800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0d3130 con 0x7f3e4c0b6230 2024-05-10T04:23:35.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.401+0000 7f3e51400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e4c0b98e0 0x7f3e4c0d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:35.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.401+0000 7f3e51400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e4c0b98e0 0x7f3e4c0d2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35396/0 (socket says 172.21.15.80:35396) 2024-05-10T04:23:35.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.401+0000 7f3e51400700 1 -- 172.21.15.80:0/350810331 learned_addr learned my addr 172.21.15.80:0/350810331 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:35.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.401+0000 7f3e50a00700 1 --2- 172.21.15.80:0/350810331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e4c0b6230 0x7f3e4c0d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:35.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.401+0000 7f3e51e00700 1 --2- 172.21.15.80:0/350810331 >> v2:172.21.15.106:3300/0 conn(0x7f3e4c0d0ac0 0x7f3e4c15d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:35.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.402+0000 7f3e51400700 1 -- 172.21.15.80:0/350810331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e4c0b6230 msgr2=0x7f3e4c0d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:35.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.402+0000 7f3e51400700 1 --2- 172.21.15.80:0/350810331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e4c0b6230 0x7f3e4c0d0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:35.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.402+0000 7f3e51400700 1 -- 172.21.15.80:0/350810331 >> v2:172.21.15.106:3300/0 conn(0x7f3e4c0d0ac0 msgr2=0x7f3e4c15d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:35.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.402+0000 7f3e51400700 1 --2- 172.21.15.80:0/350810331 >> v2:172.21.15.106:3300/0 conn(0x7f3e4c0d0ac0 0x7f3e4c15d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:35.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.402+0000 7f3e51400700 1 -- 172.21.15.80:0/350810331 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c0d3410 con 0x7f3e4c0b98e0 2024-05-10T04:23:35.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.402+0000 7f3e51400700 1 --2- 172.21.15.80:0/350810331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c0b98e0 0x7f3e4c0d2520 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0b3150 tx=0x7f3e40009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e26f59226ee5b06 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:35.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.402+0000 7f3e4be00700 1 -- 172.21.15.80:0/350810331 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40011830 con 0x7f3e4c0b98e0 2024-05-10T04:23:35.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.402+0000 7f3e4be00700 1 -- 172.21.15.80:0/350810331 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e40011990 con 0x7f3e4c0b98e0 2024-05-10T04:23:35.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.402+0000 7f3e4be00700 1 -- 172.21.15.80:0/350810331 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40011d20 con 0x7f3e4c0b98e0 2024-05-10T04:23:35.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.403+0000 7f3e52800700 1 -- 172.21.15.80:0/350810331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c0b98e0 msgr2=0x7f3e4c0d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:35.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.403+0000 7f3e52800700 1 --2- 172.21.15.80:0/350810331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c0b98e0 0x7f3e4c0d2520 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0b3150 tx=0x7f3e40009bd0 comp rx=0 tx=0).stop 2024-05-10T04:23:35.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.403+0000 7f3e52800700 1 -- 172.21.15.80:0/350810331 shutdown_connections 2024-05-10T04:23:35.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.403+0000 7f3e52800700 1 --2- 172.21.15.80:0/350810331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c0b98e0 0x7f3e4c0d2520 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:35.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.403+0000 7f3e52800700 1 --2- 172.21.15.80:0/350810331 >> v2:172.21.15.106:3300/0 conn(0x7f3e4c0d0ac0 0x7f3e4c15d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:35.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.403+0000 7f3e52800700 1 --2- 172.21.15.80:0/350810331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e4c0b6230 0x7f3e4c0d0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:35.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.403+0000 7f3e52800700 1 -- 172.21.15.80:0/350810331 >> 172.21.15.80:0/350810331 conn(0x7f3e4c0676c0 msgr2=0x7f3e4c06c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:35.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.403+0000 7f3e52800700 1 -- 172.21.15.80:0/350810331 shutdown_connections 2024-05-10T04:23:35.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.403+0000 7f3e52800700 1 -- 172.21.15.80:0/350810331 wait complete. 2024-05-10T04:23:35.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.405+0000 7f3e52800700 1 Processor -- start 2024-05-10T04:23:35.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.406+0000 7f3e52800700 1 -- start start 2024-05-10T04:23:35.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.407+0000 7f3e52800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c0b6230 0x7f3e4c1e7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:35.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.407+0000 7f3e52800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e4c0b98e0 0x7f3e4c0b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:35.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.407+0000 7f3e52800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e4c0d0ac0 0x7f3e4c1e8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:35.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.407+0000 7f3e52800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c1f5cd0 con 0x7f3e4c0b6230 2024-05-10T04:23:35.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.407+0000 7f3e52800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0ccc40 con 0x7f3e4c0b98e0 2024-05-10T04:23:35.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.407+0000 7f3e52800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0cd730 con 0x7f3e4c0d0ac0 2024-05-10T04:23:35.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.407+0000 7f3e51400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c0b6230 0x7f3e4c1e7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:35.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.407+0000 7f3e51400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c0b6230 0x7f3e4c1e7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35406/0 (socket says 172.21.15.80:35406) 2024-05-10T04:23:35.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.407+0000 7f3e51400700 1 -- 172.21.15.80:0/3381956674 learned_addr learned my addr 172.21.15.80:0/3381956674 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.408+0000 7f3e51e00700 1 --2- 172.21.15.80:0/3381956674 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e4c0d0ac0 0x7f3e4c1e8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.408+0000 7f3e50a00700 1 --2- 172.21.15.80:0/3381956674 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e4c0b98e0 0x7f3e4c0b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.408+0000 7f3e51400700 1 -- 172.21.15.80:0/3381956674 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e4c0d0ac0 msgr2=0x7f3e4c1e8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.408+0000 7f3e51400700 1 --2- 172.21.15.80:0/3381956674 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e4c0d0ac0 0x7f3e4c1e8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.408+0000 7f3e51400700 1 -- 172.21.15.80:0/3381956674 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e4c0b98e0 msgr2=0x7f3e4c0b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.408+0000 7f3e51400700 1 --2- 172.21.15.80:0/3381956674 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e4c0b98e0 0x7f3e4c0b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.408+0000 7f3e51400700 1 -- 172.21.15.80:0/3381956674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e40009550 con 0x7f3e4c0b6230 2024-05-10T04:23:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.408+0000 7f3e51400700 1 --2- 172.21.15.80:0/3381956674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c0b6230 0x7f3e4c1e7620 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3e40014040 tx=0x7f3e40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:35.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.408+0000 7f3e49600700 1 -- 172.21.15.80:0/3381956674 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40004510 con 0x7f3e4c0b6230 2024-05-10T04:23:35.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.408+0000 7f3e49600700 1 -- 172.21.15.80:0/3381956674 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4001e070 con 0x7f3e4c0b6230 2024-05-10T04:23:35.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.408+0000 7f3e52800700 1 -- 172.21.15.80:0/3381956674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c1f4500 con 0x7f3e4c0b6230 2024-05-10T04:23:35.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.408+0000 7f3e49600700 1 -- 172.21.15.80:0/3381956674 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e400038e0 con 0x7f3e4c0b6230 2024-05-10T04:23:35.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.408+0000 7f3e52800700 1 -- 172.21.15.80:0/3381956674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c0cce90 con 0x7f3e4c0b6230 2024-05-10T04:23:35.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.409+0000 7f3e52800700 1 -- 172.21.15.80:0/3381956674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4c1f4690 con 0x7f3e4c0b6230 2024-05-10T04:23:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.410+0000 7f3e49600700 1 -- 172.21.15.80:0/3381956674 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3e40003a40 con 0x7f3e4c0b6230 2024-05-10T04:23:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.411+0000 7f3e49600700 1 --2- 172.21.15.80:0/3381956674 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3e2c06ac90 0x7f3e2c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.411+0000 7f3e49600700 1 -- 172.21.15.80:0/3381956674 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3e4008a290 con 0x7f3e4c0b6230 2024-05-10T04:23:35.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.412+0000 7f3e50a00700 1 --2- 172.21.15.80:0/3381956674 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3e2c06ac90 0x7f3e2c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:35.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.412+0000 7f3e50a00700 1 --2- 172.21.15.80:0/3381956674 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3e2c06ac90 0x7f3e2c06d1a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0b6100 tx=0x7f3e38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:35.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.416+0000 7f3e49600700 1 -- 172.21.15.80:0/3381956674 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3e40055350 con 0x7f3e4c0b6230 2024-05-10T04:23:35.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.637+0000 7f3e52800700 1 -- 172.21.15.80:0/3381956674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3e4c074af0 con 0x7f3e4c0b6230 2024-05-10T04:23:35.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.638+0000 7f3e49600700 1 -- 172.21.15.80:0/3381956674 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3e40058970 con 0x7f3e4c0b6230 2024-05-10T04:23:35.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.640+0000 7f3e52800700 1 -- 172.21.15.80:0/3381956674 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3e2c06ac90 msgr2=0x7f3e2c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:35.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.640+0000 7f3e52800700 1 --2- 172.21.15.80:0/3381956674 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3e2c06ac90 0x7f3e2c06d1a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0b6100 tx=0x7f3e38008040 comp rx=0 tx=0).stop 2024-05-10T04:23:35.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.640+0000 7f3e52800700 1 -- 172.21.15.80:0/3381956674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c0b6230 msgr2=0x7f3e4c1e7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:35.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.640+0000 7f3e52800700 1 --2- 172.21.15.80:0/3381956674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c0b6230 0x7f3e4c1e7620 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3e40014040 tx=0x7f3e40004750 comp rx=0 tx=0).stop 2024-05-10T04:23:35.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.640+0000 7f3e52800700 1 -- 172.21.15.80:0/3381956674 shutdown_connections 2024-05-10T04:23:35.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.640+0000 7f3e52800700 1 --2- 172.21.15.80:0/3381956674 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3e2c06ac90 0x7f3e2c06d1a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:35.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.640+0000 7f3e52800700 1 --2- 172.21.15.80:0/3381956674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c0b6230 0x7f3e4c1e7620 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:35.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.640+0000 7f3e52800700 1 --2- 172.21.15.80:0/3381956674 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e4c0d0ac0 0x7f3e4c1e8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:35.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.640+0000 7f3e52800700 1 --2- 172.21.15.80:0/3381956674 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e4c0b98e0 0x7f3e4c0b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:35.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.640+0000 7f3e52800700 1 -- 172.21.15.80:0/3381956674 >> 172.21.15.80:0/3381956674 conn(0x7f3e4c0676c0 msgr2=0x7f3e4c0b82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:35.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.640+0000 7f3e52800700 1 -- 172.21.15.80:0/3381956674 shutdown_connections 2024-05-10T04:23:35.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:35.641+0000 7f3e52800700 1 -- 172.21.15.80:0/3381956674 wait complete. 2024-05-10T04:23:35.643 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-05-10T04:23:35.669 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-05-10T04:23:35.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:35.669 DEBUG:teuthology.orchestra.run.smithi106:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-05-10T04:23:35.751 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-05-10T04:23:35.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:23:35.751 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-10T04:23:35.799 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-10T04:23:35.800 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:23:36.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.060+0000 7f5bfea00700 1 Processor -- start 2024-05-10T04:23:36.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.060+0000 7f5bfea00700 1 -- start start 2024-05-10T04:23:36.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.061+0000 7f5bfea00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bf80d0d40 0x7f5bf80b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:36.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.061+0000 7f5bfea00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf80d28c0 con 0x7f5bf8161fa0 2024-05-10T04:23:36.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.061+0000 7f5bfea00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf80d2ba0 con 0x7f5bf80b2f50 2024-05-10T04:23:36.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.061+0000 7f5bfea00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf80b3360 con 0x7f5bf80d0d40 2024-05-10T04:23:36.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.062+0000 7f5befe00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5bf8161fa0 0x7f5bf80d0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48968/0 (socket says 172.21.15.80:48968) 2024-05-10T04:23:36.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.062+0000 7f5befe00700 1 -- 172.21.15.80:0/1098601471 learned_addr learned my addr 172.21.15.80:0/1098601471 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:36.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.062+0000 7f5bfca00700 1 --2- 172.21.15.80:0/1098601471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bf80d0d40 0x7f5bf80b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:36.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.062+0000 7f5bf7400700 1 -- 172.21.15.80:0/1098601471 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612040780 0 0) 0x7f5bf80d28c0 con 0x7f5bf8161fa0 2024-05-10T04:23:36.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.062+0000 7f5bf7400700 1 -- 172.21.15.80:0/1098601471 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bdc0035b0 con 0x7f5bf8161fa0 2024-05-10T04:23:36.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.062+0000 7f5bf7400700 1 -- 172.21.15.80:0/1098601471 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565427096 0 0) 0x7f5bf80d2ba0 con 0x7f5bf80b2f50 2024-05-10T04:23:36.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.062+0000 7f5bf7400700 1 -- 172.21.15.80:0/1098601471 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bf80d28c0 con 0x7f5bf80b2f50 2024-05-10T04:23:36.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.062+0000 7f5bf7400700 1 -- 172.21.15.80:0/1098601471 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2976618351 0 0) 0x7f5bdc0035b0 con 0x7f5bf8161fa0 2024-05-10T04:23:36.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.062+0000 7f5bf7400700 1 -- 172.21.15.80:0/1098601471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bf80d0d40 msgr2=0x7f5bf80b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:36.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.062+0000 7f5bf7400700 1 --2- 172.21.15.80:0/1098601471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bf80d0d40 0x7f5bf80b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.062+0000 7f5bf7400700 1 -- 172.21.15.80:0/1098601471 >> v1:172.21.15.106:6789/0 conn(0x7f5bf80b2f50 legacy=0x7f5bf80d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:36.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.062+0000 7f5bf7400700 1 -- 172.21.15.80:0/1098601471 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf80cf970 con 0x7f5bf8161fa0 2024-05-10T04:23:36.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.062+0000 7f5bf7400700 1 -- 172.21.15.80:0/1098601471 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7f5be0001670 con 0x7f5bf8161fa0 2024-05-10T04:23:36.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.063+0000 7f5bf7400700 1 -- 172.21.15.80:0/1098601471 >> v1:172.21.15.80:6789/0 conn(0x7f5bf8161fa0 legacy=0x7f5bf80d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:36.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.063+0000 7f5bf7400700 1 --2- 172.21.15.80:0/1098601471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bf80d0d40 0x7f5bdc003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:36.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.063+0000 7f5bf7400700 1 --2- 172.21.15.80:0/1098601471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5bdc004120 0x7f5bdc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:36.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.063+0000 7f5bf7400700 1 --2- 172.21.15.80:0/1098601471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bdc004d90 0x7f5bdc0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:36.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.063+0000 7f5bf7400700 1 -- 172.21.15.80:0/1098601471 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf80b3360 con 0x7f5bdc004d90 2024-05-10T04:23:36.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.063+0000 7f5bf7400700 1 -- 172.21.15.80:0/1098601471 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc00bb70 con 0x7f5bdc004120 2024-05-10T04:23:36.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.063+0000 7f5bf7400700 1 -- 172.21.15.80:0/1098601471 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc00bd30 con 0x7f5bf80d0d40 2024-05-10T04:23:36.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.063+0000 7f5bfca00700 1 --2- 172.21.15.80:0/1098601471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bdc004d90 0x7f5bdc0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:36.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.063+0000 7f5bf7e00700 1 --2- 172.21.15.80:0/1098601471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bf80d0d40 0x7f5bdc003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:36.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.063+0000 7f5befe00700 1 --2- 172.21.15.80:0/1098601471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5bdc004120 0x7f5bdc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:36.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.063+0000 7f5bfca00700 1 -- 172.21.15.80:0/1098601471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bf80d0d40 msgr2=0x7f5bdc003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:36.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.063+0000 7f5bfca00700 1 --2- 172.21.15.80:0/1098601471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bf80d0d40 0x7f5bdc003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.063+0000 7f5bfca00700 1 -- 172.21.15.80:0/1098601471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5bdc004120 msgr2=0x7f5bdc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:36.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.063+0000 7f5bfca00700 1 --2- 172.21.15.80:0/1098601471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5bdc004120 0x7f5bdc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.063+0000 7f5bfca00700 1 -- 172.21.15.80:0/1098601471 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc0035b0 con 0x7f5bdc004d90 2024-05-10T04:23:36.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.063+0000 7f5befe00700 1 --2- 172.21.15.80:0/1098601471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5bdc004120 0x7f5bdc004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:36.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.064+0000 7f5bfca00700 1 --2- 172.21.15.80:0/1098601471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bdc004d90 0x7f5bdc0051a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009fc0 tx=0x7f5bdc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd9a99f16b90f86 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:36.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.064+0000 7f5bf7400700 1 -- 172.21.15.80:0/1098601471 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf000ec30 con 0x7f5bdc004d90 2024-05-10T04:23:36.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.064+0000 7f5bf7400700 1 -- 172.21.15.80:0/1098601471 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf000f040 con 0x7f5bdc004d90 2024-05-10T04:23:36.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.064+0000 7f5bf7400700 1 -- 172.21.15.80:0/1098601471 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0014480 con 0x7f5bdc004d90 2024-05-10T04:23:36.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.065+0000 7f5bfea00700 1 -- 172.21.15.80:0/1098601471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bdc004d90 msgr2=0x7f5bdc0051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:36.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.065+0000 7f5bfea00700 1 --2- 172.21.15.80:0/1098601471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bdc004d90 0x7f5bdc0051a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009fc0 tx=0x7f5bdc005880 comp rx=0 tx=0).stop 2024-05-10T04:23:36.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.065+0000 7f5bfca00700 1 -- 172.21.15.80:0/1098601471 reap_dead start 2024-05-10T04:23:36.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.065+0000 7f5bfea00700 1 -- 172.21.15.80:0/1098601471 shutdown_connections 2024-05-10T04:23:36.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.065+0000 7f5bfea00700 1 -- 172.21.15.80:0/1098601471 >> 172.21.15.80:0/1098601471 conn(0x7f5bf806c3f0 msgr2=0x7f5bf806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:36.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.065+0000 7f5bfea00700 1 -- 172.21.15.80:0/1098601471 shutdown_connections 2024-05-10T04:23:36.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.065+0000 7f5bfea00700 1 -- 172.21.15.80:0/1098601471 wait complete. 2024-05-10T04:23:36.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.068+0000 7f5bfea00700 1 Processor -- start 2024-05-10T04:23:36.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.068+0000 7f5bfea00700 1 -- start start 2024-05-10T04:23:36.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.070+0000 7f5bfea00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bdc004d90 0x7f5bf81577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:36.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.070+0000 7f5bfea00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5bf8157fb0 0x7f5bf815d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:36.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.070+0000 7f5bfea00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bf815d600 0x7f5bf80cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:36.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.070+0000 7f5bfea00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf80cd340 con 0x7f5bf815d600 2024-05-10T04:23:36.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.070+0000 7f5bfea00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf815e230 con 0x7f5bf8157fb0 2024-05-10T04:23:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.070+0000 7f5bfea00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf80b6560 con 0x7f5bdc004d90 2024-05-10T04:23:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.070+0000 7f5bfca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bf815d600 0x7f5bf80cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.070+0000 7f5bfca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bf815d600 0x7f5bf80cadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35418/0 (socket says 172.21.15.80:35418) 2024-05-10T04:23:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.070+0000 7f5bfca00700 1 -- 172.21.15.80:0/4137578658 learned_addr learned my addr 172.21.15.80:0/4137578658 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.070+0000 7f5bf7e00700 1 --2- 172.21.15.80:0/4137578658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bdc004d90 0x7f5bf81577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.070+0000 7f5befe00700 1 --2- 172.21.15.80:0/4137578658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5bf8157fb0 0x7f5bf815d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.070+0000 7f5bfca00700 1 -- 172.21.15.80:0/4137578658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bdc004d90 msgr2=0x7f5bf81577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.070+0000 7f5bfca00700 1 --2- 172.21.15.80:0/4137578658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bdc004d90 0x7f5bf81577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.070+0000 7f5bfca00700 1 -- 172.21.15.80:0/4137578658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5bf8157fb0 msgr2=0x7f5bf815d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.070+0000 7f5bfca00700 1 --2- 172.21.15.80:0/4137578658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5bf8157fb0 0x7f5bf815d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.070+0000 7f5bfca00700 1 -- 172.21.15.80:0/4137578658 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf8158830 con 0x7f5bf815d600 2024-05-10T04:23:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.071+0000 7f5bfca00700 1 --2- 172.21.15.80:0/4137578658 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bf815d600 0x7f5bf80cadf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0016000 tx=0x7f5bf0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.071+0000 7f5bf4c00700 1 -- 172.21.15.80:0/4137578658 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0007000 con 0x7f5bf815d600 2024-05-10T04:23:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.071+0000 7f5bf4c00700 1 -- 172.21.15.80:0/4137578658 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf00148b0 con 0x7f5bf815d600 2024-05-10T04:23:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.071+0000 7f5bf4c00700 1 -- 172.21.15.80:0/4137578658 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0014c60 con 0x7f5bf815d600 2024-05-10T04:23:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.071+0000 7f5bfea00700 1 -- 172.21.15.80:0/4137578658 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf815da10 con 0x7f5bf815d600 2024-05-10T04:23:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.071+0000 7f5bfea00700 1 -- 172.21.15.80:0/4137578658 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf80b5c30 con 0x7f5bf815d600 2024-05-10T04:23:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.072+0000 7f5bfea00700 1 -- 172.21.15.80:0/4137578658 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf8074af0 con 0x7f5bf815d600 2024-05-10T04:23:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.073+0000 7f5bf4c00700 1 -- 172.21.15.80:0/4137578658 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5bf0023070 con 0x7f5bf815d600 2024-05-10T04:23:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.074+0000 7f5bf4c00700 1 --2- 172.21.15.80:0/4137578658 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5bd406acc0 0x7f5bd406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.074+0000 7f5bf4c00700 1 -- 172.21.15.80:0/4137578658 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5bf008a750 con 0x7f5bf815d600 2024-05-10T04:23:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.074+0000 7f5bf7e00700 1 --2- 172.21.15.80:0/4137578658 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5bd406acc0 0x7f5bd406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.075+0000 7f5bf7e00700 1 --2- 172.21.15.80:0/4137578658 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5bd406acc0 0x7f5bd406d1d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5be8000c00 tx=0x7f5be8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:36.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.078+0000 7f5bf4c00700 1 -- 172.21.15.80:0/4137578658 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5bf00558a0 con 0x7f5bf815d600 2024-05-10T04:23:36.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.333+0000 7f5bfea00700 1 -- 172.21.15.80:0/4137578658 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5bf80b6940 con 0x7f5bf815d600 2024-05-10T04:23:36.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.334+0000 7f5bf4c00700 1 -- 172.21.15.80:0/4137578658 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4731 (secure 0 0 0) 0x7f5bf0058ec0 con 0x7f5bf815d600 2024-05-10T04:23:36.335 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:36.335 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4189316245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4189316245},{"type":"v1","addr":"172.21.15.106:6836","nonce":4189316245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/4150483341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":4150483341},{"type":"v1","addr":"172.21.15.80:6833","nonce":4150483341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1287697381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1287697381},{"type":"v1","addr":"172.21.15.80:6835","nonce":1287697381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:22:37.482943+0000","modified":"2024-05-10T04:22:40.916280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/961352916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":961352916},{"type":"v1","addr":"172.21.15.106:6837","nonce":961352916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:23:36.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.336+0000 7f5bfea00700 1 -- 172.21.15.80:0/4137578658 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5bd406acc0 msgr2=0x7f5bd406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:36.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.336+0000 7f5bfea00700 1 --2- 172.21.15.80:0/4137578658 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5bd406acc0 0x7f5bd406d1d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5be8000c00 tx=0x7f5be8009040 comp rx=0 tx=0).stop 2024-05-10T04:23:36.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.336+0000 7f5bfea00700 1 -- 172.21.15.80:0/4137578658 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bf815d600 msgr2=0x7f5bf80cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:36.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.336+0000 7f5bfea00700 1 --2- 172.21.15.80:0/4137578658 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bf815d600 0x7f5bf80cadf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0016000 tx=0x7f5bf0009750 comp rx=0 tx=0).stop 2024-05-10T04:23:36.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.336+0000 7f5bfea00700 1 -- 172.21.15.80:0/4137578658 shutdown_connections 2024-05-10T04:23:36.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.336+0000 7f5bfea00700 1 --2- 172.21.15.80:0/4137578658 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f5bd406acc0 0x7f5bd406d1d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.336+0000 7f5bfea00700 1 --2- 172.21.15.80:0/4137578658 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bf815d600 0x7f5bf80cadf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.336+0000 7f5bfea00700 1 --2- 172.21.15.80:0/4137578658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bdc004d90 0x7f5bf81577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.336+0000 7f5bfea00700 1 --2- 172.21.15.80:0/4137578658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5bf8157fb0 0x7f5bf815d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.336+0000 7f5bfea00700 1 -- 172.21.15.80:0/4137578658 >> 172.21.15.80:0/4137578658 conn(0x7f5bf806c3f0 msgr2=0x7f5bf80d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:36.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.337+0000 7f5bfea00700 1 -- 172.21.15.80:0/4137578658 shutdown_connections 2024-05-10T04:23:36.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.337+0000 7f5bfea00700 1 -- 172.21.15.80:0/4137578658 wait complete. 2024-05-10T04:23:36.339 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2024-05-10T04:23:36.367 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:23:36.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.625+0000 7f9db0e00700 1 Processor -- start 2024-05-10T04:23:36.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.625+0000 7f9db0e00700 1 -- start start 2024-05-10T04:23:36.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.626+0000 7f9db0e00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9dac06ea60 0x7f9dac165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:36.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.626+0000 7f9db0e00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dac0ce960 con 0x7f9dac141560 2024-05-10T04:23:36.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.626+0000 7f9db0e00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dac0cec40 con 0x7f9dac15ea60 2024-05-10T04:23:36.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.626+0000 7f9db0e00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dac0cef20 con 0x7f9dac06ea60 2024-05-10T04:23:36.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.626+0000 7f9dab400700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9dac141560 0x7f9dac0cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48974/0 (socket says 172.21.15.80:48974) 2024-05-10T04:23:36.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.626+0000 7f9dab400700 1 -- 172.21.15.80:0/3744182151 learned_addr learned my addr 172.21.15.80:0/3744182151 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:36.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.627+0000 7f9dabe00700 1 --2- 172.21.15.80:0/3744182151 >> v2:172.21.15.106:3300/0 conn(0x7f9dac06ea60 0x7f9dac165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:36.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.627+0000 7f9daaa00700 1 -- 172.21.15.80:0/3744182151 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957590920 0 0) 0x7f9dac0ce960 con 0x7f9dac141560 2024-05-10T04:23:36.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.627+0000 7f9daaa00700 1 -- 172.21.15.80:0/3744182151 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d900057c0 con 0x7f9dac141560 2024-05-10T04:23:36.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.627+0000 7f9daaa00700 1 -- 172.21.15.80:0/3744182151 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 240990815 0 0) 0x7f9d900057c0 con 0x7f9dac141560 2024-05-10T04:23:36.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.627+0000 7f9daaa00700 1 -- 172.21.15.80:0/3744182151 >> v2:172.21.15.106:3300/0 conn(0x7f9dac06ea60 msgr2=0x7f9dac165df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:36.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.627+0000 7f9daaa00700 1 --2- 172.21.15.80:0/3744182151 >> v2:172.21.15.106:3300/0 conn(0x7f9dac06ea60 0x7f9dac165df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.627+0000 7f9daaa00700 1 -- 172.21.15.80:0/3744182151 >> v1:172.21.15.106:6789/0 conn(0x7f9dac15ea60 legacy=0x7f9dac15ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:36.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.627+0000 7f9daaa00700 1 -- 172.21.15.80:0/3744182151 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac0cf200 con 0x7f9dac141560 2024-05-10T04:23:36.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.627+0000 7f9daaa00700 1 -- 172.21.15.80:0/3744182151 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7f9d9c001670 con 0x7f9dac141560 2024-05-10T04:23:36.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.627+0000 7f9daaa00700 1 -- 172.21.15.80:0/3744182151 >> v1:172.21.15.80:6789/0 conn(0x7f9dac141560 legacy=0x7f9dac0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:36.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.627+0000 7f9daaa00700 1 --2- 172.21.15.80:0/3744182151 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d90005c10 0x7f9d90006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:36.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.627+0000 7f9daaa00700 1 --2- 172.21.15.80:0/3744182151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d90006a60 0x7f9d90006e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:36.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.627+0000 7f9daaa00700 1 --2- 172.21.15.80:0/3744182151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d900073b0 0x7f9d9000dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:36.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.627+0000 7f9daaa00700 1 -- 172.21.15.80:0/3744182151 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0cef20 con 0x7f9d90006a60 2024-05-10T04:23:36.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.627+0000 7f9daaa00700 1 -- 172.21.15.80:0/3744182151 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9000e320 con 0x7f9d900073b0 2024-05-10T04:23:36.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.627+0000 7f9daaa00700 1 -- 172.21.15.80:0/3744182151 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9000e4e0 con 0x7f9d90005c10 2024-05-10T04:23:36.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.628+0000 7f9da3e00700 1 --2- 172.21.15.80:0/3744182151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d90006a60 0x7f9d90006e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:36.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.628+0000 7f9dab400700 1 --2- 172.21.15.80:0/3744182151 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d90005c10 0x7f9d90006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:36.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.628+0000 7f9dabe00700 1 --2- 172.21.15.80:0/3744182151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d900073b0 0x7f9d9000dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:36.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.628+0000 7f9da3e00700 1 -- 172.21.15.80:0/3744182151 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d90005c10 msgr2=0x7f9d90006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:36.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.628+0000 7f9da3e00700 1 --2- 172.21.15.80:0/3744182151 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d90005c10 0x7f9d90006040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.628+0000 7f9da3e00700 1 -- 172.21.15.80:0/3744182151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d900073b0 msgr2=0x7f9d9000dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:36.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.628+0000 7f9da3e00700 1 --2- 172.21.15.80:0/3744182151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d900073b0 0x7f9d9000dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.628+0000 7f9da3e00700 1 -- 172.21.15.80:0/3744182151 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d900057c0 con 0x7f9d90006a60 2024-05-10T04:23:36.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.628+0000 7f9dabe00700 1 -- 172.21.15.80:0/3744182151 reap_dead start 2024-05-10T04:23:36.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.628+0000 7f9da3e00700 1 --2- 172.21.15.80:0/3744182151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d90006a60 0x7f9d90006e70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9d940018d0 tx=0x7f9d90007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12283f91d85f7fc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:36.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.628+0000 7f9daaa00700 1 -- 172.21.15.80:0/3744182151 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d940052d0 con 0x7f9d90006a60 2024-05-10T04:23:36.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.629+0000 7f9daaa00700 1 -- 172.21.15.80:0/3744182151 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d94005430 con 0x7f9d90006a60 2024-05-10T04:23:36.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.629+0000 7f9daaa00700 1 -- 172.21.15.80:0/3744182151 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d940038a0 con 0x7f9d90006a60 2024-05-10T04:23:36.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.629+0000 7f9db0e00700 1 -- 172.21.15.80:0/3744182151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d90006a60 msgr2=0x7f9d90006e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:36.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.629+0000 7f9db0e00700 1 --2- 172.21.15.80:0/3744182151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d90006a60 0x7f9d90006e70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9d940018d0 tx=0x7f9d90007a90 comp rx=0 tx=0).stop 2024-05-10T04:23:36.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.629+0000 7f9db0e00700 1 -- 172.21.15.80:0/3744182151 shutdown_connections 2024-05-10T04:23:36.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.629+0000 7f9db0e00700 1 --2- 172.21.15.80:0/3744182151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d90006a60 0x7f9d90006e70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.629+0000 7f9db0e00700 1 -- 172.21.15.80:0/3744182151 >> 172.21.15.80:0/3744182151 conn(0x7f9dac0b1dd0 msgr2=0x7f9dac0cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:36.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.629+0000 7f9db0e00700 1 -- 172.21.15.80:0/3744182151 shutdown_connections 2024-05-10T04:23:36.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.629+0000 7f9db0e00700 1 -- 172.21.15.80:0/3744182151 wait complete. 2024-05-10T04:23:36.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.632+0000 7f9db0e00700 1 Processor -- start 2024-05-10T04:23:36.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.632+0000 7f9db0e00700 1 -- start start 2024-05-10T04:23:36.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.633+0000 7f9db0e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d90006a60 0x7f9dac0a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:36.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.633+0000 7f9db0e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dac144720 0x7f9dac1351a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:36.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.633+0000 7f9db0e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9dac15db80 0x7f9dac15df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:36.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.633+0000 7f9db0e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac143a30 con 0x7f9d90006a60 2024-05-10T04:23:36.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.633+0000 7f9db0e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0ab720 con 0x7f9dac144720 2024-05-10T04:23:36.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.633+0000 7f9db0e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0a8760 con 0x7f9dac15db80 2024-05-10T04:23:36.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.633+0000 7f9dab400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d90006a60 0x7f9dac0a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:36.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.633+0000 7f9dab400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d90006a60 0x7f9dac0a8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35428/0 (socket says 172.21.15.80:35428) 2024-05-10T04:23:36.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.633+0000 7f9dab400700 1 -- 172.21.15.80:0/3212600512 learned_addr learned my addr 172.21.15.80:0/3212600512 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:36.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.633+0000 7f9dabe00700 1 --2- 172.21.15.80:0/3212600512 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9dac15db80 0x7f9dac15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:36.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.634+0000 7f9da3e00700 1 --2- 172.21.15.80:0/3212600512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dac144720 0x7f9dac1351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:36.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.634+0000 7f9dab400700 1 -- 172.21.15.80:0/3212600512 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9dac15db80 msgr2=0x7f9dac15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:36.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.634+0000 7f9dab400700 1 --2- 172.21.15.80:0/3212600512 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9dac15db80 0x7f9dac15df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.634+0000 7f9dab400700 1 -- 172.21.15.80:0/3212600512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dac144720 msgr2=0x7f9dac1351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:36.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.634+0000 7f9dab400700 1 --2- 172.21.15.80:0/3212600512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dac144720 0x7f9dac1351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.634+0000 7f9dab400700 1 -- 172.21.15.80:0/3212600512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac15e4d0 con 0x7f9d90006a60 2024-05-10T04:23:36.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.634+0000 7f9da3e00700 1 --2- 172.21.15.80:0/3212600512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dac144720 0x7f9dac1351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:36.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.634+0000 7f9dab400700 1 --2- 172.21.15.80:0/3212600512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d90006a60 0x7f9dac0a8e60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0072f0 tx=0x7f9d9c007600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:36.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.634+0000 7f9da3400700 1 -- 172.21.15.80:0/3212600512 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c011580 con 0x7f9d90006a60 2024-05-10T04:23:36.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.634+0000 7f9da3400700 1 -- 172.21.15.80:0/3212600512 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c011720 con 0x7f9d90006a60 2024-05-10T04:23:36.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.634+0000 7f9db0e00700 1 -- 172.21.15.80:0/3212600512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dac0a89b0 con 0x7f9d90006a60 2024-05-10T04:23:36.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.634+0000 7f9da3400700 1 -- 172.21.15.80:0/3212600512 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c011ad0 con 0x7f9d90006a60 2024-05-10T04:23:36.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.635+0000 7f9db0e00700 1 -- 172.21.15.80:0/3212600512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dac143f20 con 0x7f9d90006a60 2024-05-10T04:23:36.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.635+0000 7f9db0e00700 1 -- 172.21.15.80:0/3212600512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dac074af0 con 0x7f9d90006a60 2024-05-10T04:23:36.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.636+0000 7f9da3400700 1 -- 172.21.15.80:0/3212600512 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9d9c011c30 con 0x7f9d90006a60 2024-05-10T04:23:36.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.637+0000 7f9da3400700 1 --2- 172.21.15.80:0/3212600512 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9d8806acc0 0x7f9d8806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:36.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.637+0000 7f9da3400700 1 -- 172.21.15.80:0/3212600512 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9d9c0894e0 con 0x7f9d90006a60 2024-05-10T04:23:36.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.638+0000 7f9da3e00700 1 --2- 172.21.15.80:0/3212600512 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9d8806acc0 0x7f9d8806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:36.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.638+0000 7f9da3e00700 1 --2- 172.21.15.80:0/3212600512 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9d8806acc0 0x7f9d8806d1d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9d94015040 tx=0x7f9d94005000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:36.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.642+0000 7f9da3400700 1 -- 172.21.15.80:0/3212600512 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9d9c054520 con 0x7f9d90006a60 2024-05-10T04:23:36.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.849+0000 7f9db0e00700 1 -- 172.21.15.80:0/3212600512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9dac142e00 con 0x7f9d90006a60 2024-05-10T04:23:36.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.850+0000 7f9da3400700 1 -- 172.21.15.80:0/3212600512 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16286 (secure 0 0 0) 0x7f9d9c057b40 con 0x7f9d90006a60 2024-05-10T04:23:36.852 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:36.852 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:23:20.092453+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:23:36.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.853+0000 7f9db0e00700 1 -- 172.21.15.80:0/3212600512 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9d8806acc0 msgr2=0x7f9d8806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:36.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.853+0000 7f9db0e00700 1 --2- 172.21.15.80:0/3212600512 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9d8806acc0 0x7f9d8806d1d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9d94015040 tx=0x7f9d94005000 comp rx=0 tx=0).stop 2024-05-10T04:23:36.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.853+0000 7f9db0e00700 1 -- 172.21.15.80:0/3212600512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d90006a60 msgr2=0x7f9dac0a8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:36.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.853+0000 7f9db0e00700 1 --2- 172.21.15.80:0/3212600512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d90006a60 0x7f9dac0a8e60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0072f0 tx=0x7f9d9c007600 comp rx=0 tx=0).stop 2024-05-10T04:23:36.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.853+0000 7f9db0e00700 1 -- 172.21.15.80:0/3212600512 shutdown_connections 2024-05-10T04:23:36.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.853+0000 7f9db0e00700 1 --2- 172.21.15.80:0/3212600512 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f9d8806acc0 0x7f9d8806d1d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.853+0000 7f9db0e00700 1 --2- 172.21.15.80:0/3212600512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d90006a60 0x7f9dac0a8e60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.853+0000 7f9db0e00700 1 --2- 172.21.15.80:0/3212600512 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9dac15db80 0x7f9dac15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.853+0000 7f9db0e00700 1 --2- 172.21.15.80:0/3212600512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dac144720 0x7f9dac1351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:36.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.853+0000 7f9db0e00700 1 -- 172.21.15.80:0/3212600512 >> 172.21.15.80:0/3212600512 conn(0x7f9dac0b1dd0 msgr2=0x7f9dac15b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:36.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.853+0000 7f9db0e00700 1 -- 172.21.15.80:0/3212600512 shutdown_connections 2024-05-10T04:23:36.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:36.853+0000 7f9db0e00700 1 -- 172.21.15.80:0/3212600512 wait complete. 2024-05-10T04:23:36.880 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:22:26.793377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:22:35.751764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:22:36.465587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:23:36.880 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:23:37.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.143+0000 7f7dfb600700 1 Processor -- start 2024-05-10T04:23:37.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.143+0000 7f7dfb600700 1 -- start start 2024-05-10T04:23:37.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.144+0000 7f7dfb600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7df40b5d00 0x7f7df40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:37.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.145+0000 7f7dfb600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7df406c2f0 0x7f7df406c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:37.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.145+0000 7f7dfb600700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df40b6650 con 0x7f7df40b3280 2024-05-10T04:23:37.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.145+0000 7f7dfb600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df406cf70 con 0x7f7df406c2f0 2024-05-10T04:23:37.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.145+0000 7f7dfb600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df406d250 con 0x7f7df40b5d00 2024-05-10T04:23:37.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.145+0000 7f7df8c00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7df40b3280 0x7f7df40d3390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48988/0 (socket says 172.21.15.80:48988) 2024-05-10T04:23:37.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.145+0000 7f7df8c00700 1 -- 172.21.15.80:0/2764649098 learned_addr learned my addr 172.21.15.80:0/2764649098 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:37.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.145+0000 7f7df9600700 1 --2- 172.21.15.80:0/2764649098 >> v2:172.21.15.106:3300/0 conn(0x7f7df406c2f0 0x7f7df406c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:37.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.145+0000 7f7df3e00700 1 --2- 172.21.15.80:0/2764649098 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7df40b5d00 0x7f7df40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:37.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.145+0000 7f7df3400700 1 -- 172.21.15.80:0/2764649098 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1467655328 0 0) 0x7f7df40b6650 con 0x7f7df40b3280 2024-05-10T04:23:37.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.145+0000 7f7df3400700 1 -- 172.21.15.80:0/2764649098 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ddc0035b0 con 0x7f7df40b3280 2024-05-10T04:23:37.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.145+0000 7f7df9600700 1 -- 172.21.15.80:0/2764649098 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7df40b5d00 msgr2=0x7f7df40b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:37.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.146+0000 7f7df9600700 1 --2- 172.21.15.80:0/2764649098 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7df40b5d00 0x7f7df40b6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.146+0000 7f7df9600700 1 -- 172.21.15.80:0/2764649098 >> v1:172.21.15.80:6789/0 conn(0x7f7df40b3280 legacy=0x7f7df40d3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:37.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.146+0000 7f7df9600700 1 -- 172.21.15.80:0/2764649098 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df40d28b0 con 0x7f7df406c2f0 2024-05-10T04:23:37.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.146+0000 7f7df9600700 1 --2- 172.21.15.80:0/2764649098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7df406c2f0 0x7f7df406c700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009d90 tx=0x7f7dec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be13e90121ffef19 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:37.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.146+0000 7f7df3400700 1 -- 172.21.15.80:0/2764649098 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec00e070 con 0x7f7df406c2f0 2024-05-10T04:23:37.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.146+0000 7f7df3400700 1 -- 172.21.15.80:0/2764649098 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec00bb20 con 0x7f7df406c2f0 2024-05-10T04:23:37.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.146+0000 7f7df3400700 1 -- 172.21.15.80:0/2764649098 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec012430 con 0x7f7df406c2f0 2024-05-10T04:23:37.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.147+0000 7f7dfb600700 1 -- 172.21.15.80:0/2764649098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7df406c2f0 msgr2=0x7f7df406c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:37.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.147+0000 7f7dfb600700 1 --2- 172.21.15.80:0/2764649098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7df406c2f0 0x7f7df406c700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009d90 tx=0x7f7dec00b330 comp rx=0 tx=0).stop 2024-05-10T04:23:37.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.147+0000 7f7dfb600700 1 -- 172.21.15.80:0/2764649098 shutdown_connections 2024-05-10T04:23:37.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.147+0000 7f7dfb600700 1 --2- 172.21.15.80:0/2764649098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7df406c2f0 0x7f7df406c700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.147+0000 7f7dfb600700 1 --2- 172.21.15.80:0/2764649098 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7df40b5d00 0x7f7df40b6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.147+0000 7f7dfb600700 1 -- 172.21.15.80:0/2764649098 >> 172.21.15.80:0/2764649098 conn(0x7f7df40d40a0 msgr2=0x7f7df40d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:37.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.147+0000 7f7dfb600700 1 -- 172.21.15.80:0/2764649098 shutdown_connections 2024-05-10T04:23:37.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.147+0000 7f7dfb600700 1 -- 172.21.15.80:0/2764649098 wait complete. 2024-05-10T04:23:37.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.149+0000 7f7dfb600700 1 Processor -- start 2024-05-10T04:23:37.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.149+0000 7f7dfb600700 1 -- start start 2024-05-10T04:23:37.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7dfb600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7df406c2f0 0x7f7df414f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:37.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7dfb600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7df40b3280 0x7f7df415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:37.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7dfb600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df40b5d00 0x7f7df415aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:37.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7dfb600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df4150a50 con 0x7f7df40b5d00 2024-05-10T04:23:37.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7dfb600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df41598b0 con 0x7f7df406c2f0 2024-05-10T04:23:37.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7dfb600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df415c6e0 con 0x7f7df40b3280 2024-05-10T04:23:37.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7df9600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df40b5d00 0x7f7df415aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:37.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7df9600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df40b5d00 0x7f7df415aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35438/0 (socket says 172.21.15.80:35438) 2024-05-10T04:23:37.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7df9600700 1 -- 172.21.15.80:0/2493788447 learned_addr learned my addr 172.21.15.80:0/2493788447 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:37.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7df8c00700 1 --2- 172.21.15.80:0/2493788447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7df406c2f0 0x7f7df414f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:37.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7df3e00700 1 --2- 172.21.15.80:0/2493788447 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7df40b3280 0x7f7df415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:37.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7df9600700 1 -- 172.21.15.80:0/2493788447 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7df40b3280 msgr2=0x7f7df415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:37.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7df9600700 1 --2- 172.21.15.80:0/2493788447 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7df40b3280 0x7f7df415c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7df9600700 1 -- 172.21.15.80:0/2493788447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7df406c2f0 msgr2=0x7f7df414f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:37.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7df9600700 1 --2- 172.21.15.80:0/2493788447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7df406c2f0 0x7f7df414f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7df9600700 1 -- 172.21.15.80:0/2493788447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec009a70 con 0x7f7df40b5d00 2024-05-10T04:23:37.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7df9600700 1 --2- 172.21.15.80:0/2493788447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df40b5d00 0x7f7df415aba0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7dec014040 tx=0x7f7dec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:37.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7df0c00700 1 -- 172.21.15.80:0/2493788447 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec0129f0 con 0x7f7df40b5d00 2024-05-10T04:23:37.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7df0c00700 1 -- 172.21.15.80:0/2493788447 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec020070 con 0x7f7df40b5d00 2024-05-10T04:23:37.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7dfb600700 1 -- 172.21.15.80:0/2493788447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df415b0e0 con 0x7f7df40b5d00 2024-05-10T04:23:37.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.152+0000 7f7df0c00700 1 -- 172.21.15.80:0/2493788447 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec012db0 con 0x7f7df40b5d00 2024-05-10T04:23:37.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.153+0000 7f7dfb600700 1 -- 172.21.15.80:0/2493788447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df4159de0 con 0x7f7df40b5d00 2024-05-10T04:23:37.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.154+0000 7f7de6000700 1 -- 172.21.15.80:0/2493788447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc80052f0 con 0x7f7df40b5d00 2024-05-10T04:23:37.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.155+0000 7f7df0c00700 1 -- 172.21.15.80:0/2493788447 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7dec004040 con 0x7f7df40b5d00 2024-05-10T04:23:37.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.156+0000 7f7df0c00700 1 --2- 172.21.15.80:0/2493788447 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7dd406ac90 0x7f7dd406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:37.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.156+0000 7f7df0c00700 1 -- 172.21.15.80:0/2493788447 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7dec022070 con 0x7f7df40b5d00 2024-05-10T04:23:37.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.156+0000 7f7df8c00700 1 --2- 172.21.15.80:0/2493788447 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7dd406ac90 0x7f7dd406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:37.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.157+0000 7f7df8c00700 1 --2- 172.21.15.80:0/2493788447 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7dd406ac90 0x7f7dd406d1a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7de8007fd0 tx=0x7f7de8007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:37.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.161+0000 7f7df0c00700 1 -- 172.21.15.80:0/2493788447 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7dec056100 con 0x7f7df40b5d00 2024-05-10T04:23:37.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.370+0000 7f7de6000700 1 -- 172.21.15.80:0/2493788447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7dc8005b20 con 0x7f7df40b5d00 2024-05-10T04:23:37.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.370+0000 7f7df0c00700 1 -- 172.21.15.80:0/2493788447 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7dec02c0a0 con 0x7f7df40b5d00 2024-05-10T04:23:37.372 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-10T04:23:37.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.373+0000 7f7de6000700 1 -- 172.21.15.80:0/2493788447 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7dd406ac90 msgr2=0x7f7dd406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:37.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.373+0000 7f7de6000700 1 --2- 172.21.15.80:0/2493788447 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7dd406ac90 0x7f7dd406d1a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7de8007fd0 tx=0x7f7de8007dc0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.373+0000 7f7de6000700 1 -- 172.21.15.80:0/2493788447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df40b5d00 msgr2=0x7f7df415aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:37.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.373+0000 7f7de6000700 1 --2- 172.21.15.80:0/2493788447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df40b5d00 0x7f7df415aba0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7dec014040 tx=0x7f7dec004ad0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.373+0000 7f7de6000700 1 -- 172.21.15.80:0/2493788447 shutdown_connections 2024-05-10T04:23:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.373+0000 7f7de6000700 1 --2- 172.21.15.80:0/2493788447 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7dd406ac90 0x7f7dd406d1a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.373+0000 7f7de6000700 1 --2- 172.21.15.80:0/2493788447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df40b5d00 0x7f7df415aba0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.373+0000 7f7de6000700 1 --2- 172.21.15.80:0/2493788447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7df406c2f0 0x7f7df414f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.373+0000 7f7de6000700 1 --2- 172.21.15.80:0/2493788447 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7df40b3280 0x7f7df415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.373+0000 7f7de6000700 1 -- 172.21.15.80:0/2493788447 >> 172.21.15.80:0/2493788447 conn(0x7f7df40d40a0 msgr2=0x7f7df4161320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.373+0000 7f7de6000700 1 -- 172.21.15.80:0/2493788447 shutdown_connections 2024-05-10T04:23:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.373+0000 7f7de6000700 1 -- 172.21.15.80:0/2493788447 wait complete. 2024-05-10T04:23:37.400 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:23:37.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.662+0000 7f2db8e00700 1 Processor -- start 2024-05-10T04:23:37.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.662+0000 7f2db8e00700 1 -- start start 2024-05-10T04:23:37.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.664+0000 7f2db8e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2db41678a0 0x7f2db4169cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:37.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.664+0000 7f2db8e00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db406c610 con 0x7f2db40ccca0 2024-05-10T04:23:37.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.664+0000 7f2db8e00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db406c330 con 0x7f2db409b0d0 2024-05-10T04:23:37.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.664+0000 7f2db8e00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db40b7410 con 0x7f2db41678a0 2024-05-10T04:23:37.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.664+0000 7f2db1e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2db40ccca0 0x7f2db406c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49004/0 (socket says 172.21.15.80:49004) 2024-05-10T04:23:37.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.664+0000 7f2db1e00700 1 -- 172.21.15.80:0/1620495929 learned_addr learned my addr 172.21.15.80:0/1620495929 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:37.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.664+0000 7f2db2800700 1 --2- 172.21.15.80:0/1620495929 >> v2:172.21.15.80:3300/0 conn(0x7f2db41678a0 0x7f2db4169cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.665+0000 7f2db1400700 1 -- 172.21.15.80:0/1620495929 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975796630 0 0) 0x7f2db406c610 con 0x7f2db40ccca0 2024-05-10T04:23:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.665+0000 7f2db1400700 1 -- 172.21.15.80:0/1620495929 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d980035b0 con 0x7f2db40ccca0 2024-05-10T04:23:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.665+0000 7f2db2800700 1 -- 172.21.15.80:0/1620495929 >> v1:172.21.15.106:6789/0 conn(0x7f2db409b0d0 legacy=0x7f2db40d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.665+0000 7f2db2800700 1 -- 172.21.15.80:0/1620495929 >> v1:172.21.15.80:6789/0 conn(0x7f2db40ccca0 legacy=0x7f2db406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.665+0000 7f2db2800700 1 -- 172.21.15.80:0/1620495929 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db406d0d0 con 0x7f2db41678a0 2024-05-10T04:23:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.665+0000 7f2db2800700 1 --2- 172.21.15.80:0/1620495929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db41678a0 0x7f2db4169cc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009d90 tx=0x7f2dac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666613dad5ac3df0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.665+0000 7f2db1400700 1 -- 172.21.15.80:0/1620495929 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac00e070 con 0x7f2db41678a0 2024-05-10T04:23:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.665+0000 7f2db1400700 1 -- 172.21.15.80:0/1620495929 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac00bb20 con 0x7f2db41678a0 2024-05-10T04:23:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.665+0000 7f2db1400700 1 -- 172.21.15.80:0/1620495929 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac012430 con 0x7f2db41678a0 2024-05-10T04:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.666+0000 7f2db8e00700 1 -- 172.21.15.80:0/1620495929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db41678a0 msgr2=0x7f2db4169cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.666+0000 7f2db8e00700 1 --2- 172.21.15.80:0/1620495929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db41678a0 0x7f2db4169cc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009d90 tx=0x7f2dac00b330 comp rx=0 tx=0).stop 2024-05-10T04:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.666+0000 7f2db8e00700 1 -- 172.21.15.80:0/1620495929 shutdown_connections 2024-05-10T04:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.666+0000 7f2db8e00700 1 --2- 172.21.15.80:0/1620495929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db41678a0 0x7f2db4169cc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.666+0000 7f2db8e00700 1 -- 172.21.15.80:0/1620495929 >> 172.21.15.80:0/1620495929 conn(0x7f2db40ce6c0 msgr2=0x7f2db40cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.666+0000 7f2db8e00700 1 -- 172.21.15.80:0/1620495929 shutdown_connections 2024-05-10T04:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.666+0000 7f2db8e00700 1 -- 172.21.15.80:0/1620495929 wait complete. 2024-05-10T04:23:37.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.668+0000 7f2db8e00700 1 Processor -- start 2024-05-10T04:23:37.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.669+0000 7f2db8e00700 1 -- start start 2024-05-10T04:23:37.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.670+0000 7f2db8e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2db409b0d0 0x7f2db415c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:37.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.670+0000 7f2db8e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2db40ccca0 0x7f2db40c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.670+0000 7f2db8e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db41678a0 0x7f2db41598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.670+0000 7f2db8e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db40c9230 con 0x7f2db41678a0 2024-05-10T04:23:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.670+0000 7f2db8e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db40c9660 con 0x7f2db409b0d0 2024-05-10T04:23:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.670+0000 7f2db8e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db415cf30 con 0x7f2db40ccca0 2024-05-10T04:23:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.670+0000 7f2db2800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db41678a0 0x7f2db41598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.670+0000 7f2db2800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db41678a0 0x7f2db41598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35452/0 (socket says 172.21.15.80:35452) 2024-05-10T04:23:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.670+0000 7f2db2800700 1 -- 172.21.15.80:0/2876528924 learned_addr learned my addr 172.21.15.80:0/2876528924 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.670+0000 7f2db1e00700 1 --2- 172.21.15.80:0/2876528924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2db409b0d0 0x7f2db415c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.671+0000 7f2dabe00700 1 --2- 172.21.15.80:0/2876528924 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2db40ccca0 0x7f2db40c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.671+0000 7f2db2800700 1 -- 172.21.15.80:0/2876528924 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2db40ccca0 msgr2=0x7f2db40c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.671+0000 7f2db2800700 1 --2- 172.21.15.80:0/2876528924 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2db40ccca0 0x7f2db40c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.671+0000 7f2db2800700 1 -- 172.21.15.80:0/2876528924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2db409b0d0 msgr2=0x7f2db415c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.671+0000 7f2db2800700 1 --2- 172.21.15.80:0/2876528924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2db409b0d0 0x7f2db415c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.671+0000 7f2db2800700 1 -- 172.21.15.80:0/2876528924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac009a70 con 0x7f2db41678a0 2024-05-10T04:23:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.671+0000 7f2db2800700 1 --2- 172.21.15.80:0/2876528924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db41678a0 0x7f2db41598c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2db406f430 tx=0x7f2dac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.671+0000 7f2daa000700 1 -- 172.21.15.80:0/2876528924 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac012430 con 0x7f2db41678a0 2024-05-10T04:23:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.671+0000 7f2daa000700 1 -- 172.21.15.80:0/2876528924 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac020070 con 0x7f2db41678a0 2024-05-10T04:23:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.671+0000 7f2db8e00700 1 -- 172.21.15.80:0/2876528924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db409e020 con 0x7f2db41678a0 2024-05-10T04:23:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.671+0000 7f2daa000700 1 -- 172.21.15.80:0/2876528924 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac004280 con 0x7f2db41678a0 2024-05-10T04:23:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.671+0000 7f2db8e00700 1 -- 172.21.15.80:0/2876528924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db409d6f0 con 0x7f2db41678a0 2024-05-10T04:23:37.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.672+0000 7f2db8e00700 1 -- 172.21.15.80:0/2876528924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db409e1b0 con 0x7f2db41678a0 2024-05-10T04:23:37.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.673+0000 7f2daa000700 1 -- 172.21.15.80:0/2876528924 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2dac0043e0 con 0x7f2db41678a0 2024-05-10T04:23:37.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.674+0000 7f2daa000700 1 --2- 172.21.15.80:0/2876528924 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2d9006ac90 0x7f2d9006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:37.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.674+0000 7f2daa000700 1 -- 172.21.15.80:0/2876528924 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2dac022070 con 0x7f2db41678a0 2024-05-10T04:23:37.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.675+0000 7f2db1e00700 1 --2- 172.21.15.80:0/2876528924 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2d9006ac90 0x7f2d9006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:37.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.675+0000 7f2db1e00700 1 --2- 172.21.15.80:0/2876528924 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2d9006ac90 0x7f2d9006d1a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2da40010e0 tx=0x7f2da4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:37.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.679+0000 7f2daa000700 1 -- 172.21.15.80:0/2876528924 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2dac056280 con 0x7f2db41678a0 2024-05-10T04:23:37.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.884+0000 7f2db8e00700 1 -- 172.21.15.80:0/2876528924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2db4074af0 con 0x7f2db41678a0 2024-05-10T04:23:37.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.884+0000 7f2daa000700 1 -- 172.21.15.80:0/2876528924 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2dac0598a0 con 0x7f2db41678a0 2024-05-10T04:23:37.884 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-10T04:23:37.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.885+0000 7f2db8e00700 1 -- 172.21.15.80:0/2876528924 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2d9006ac90 msgr2=0x7f2d9006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:37.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.885+0000 7f2db8e00700 1 --2- 172.21.15.80:0/2876528924 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2d9006ac90 0x7f2d9006d1a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2da40010e0 tx=0x7f2da4009040 comp rx=0 tx=0).stop 2024-05-10T04:23:37.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.885+0000 7f2db8e00700 1 -- 172.21.15.80:0/2876528924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db41678a0 msgr2=0x7f2db41598c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:37.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.885+0000 7f2db8e00700 1 --2- 172.21.15.80:0/2876528924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db41678a0 0x7f2db41598c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2db406f430 tx=0x7f2dac004ad0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.887+0000 7f2db8e00700 1 -- 172.21.15.80:0/2876528924 shutdown_connections 2024-05-10T04:23:37.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.887+0000 7f2db8e00700 1 --2- 172.21.15.80:0/2876528924 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2d9006ac90 0x7f2d9006d1a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.887+0000 7f2db8e00700 1 --2- 172.21.15.80:0/2876528924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db41678a0 0x7f2db41598c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.887+0000 7f2db8e00700 1 --2- 172.21.15.80:0/2876528924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2db409b0d0 0x7f2db415c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.887+0000 7f2db8e00700 1 --2- 172.21.15.80:0/2876528924 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2db40ccca0 0x7f2db40c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:37.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.887+0000 7f2db8e00700 1 -- 172.21.15.80:0/2876528924 >> 172.21.15.80:0/2876528924 conn(0x7f2db40ce6c0 msgr2=0x7f2db4070730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:37.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.887+0000 7f2db8e00700 1 -- 172.21.15.80:0/2876528924 shutdown_connections 2024-05-10T04:23:37.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:37.887+0000 7f2db8e00700 1 -- 172.21.15.80:0/2876528924 wait complete. 2024-05-10T04:23:37.913 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:23:38.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.175+0000 7f49f5000700 1 Processor -- start 2024-05-10T04:23:38.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.175+0000 7f49f5000700 1 -- start start 2024-05-10T04:23:38.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.177+0000 7f49f5000700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f49f0071f20 0x7f49f0072330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:38.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.177+0000 7f49f5000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f49f00b2c30 0x7f49f00b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:38.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.177+0000 7f49f5000700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f00cc5f0 con 0x7f49f00cc1e0 2024-05-10T04:23:38.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.177+0000 7f49f5000700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f006e610 con 0x7f49f00b2c30 2024-05-10T04:23:38.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.177+0000 7f49f5000700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f0072870 con 0x7f49f0071f20 2024-05-10T04:23:38.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.177+0000 7f49ee800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f49f00b2c30 0x7f49f00b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:38.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.177+0000 7f49ee800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f49f00b2c30 0x7f49f00b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35466/0 (socket says 172.21.15.80:35466) 2024-05-10T04:23:38.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.177+0000 7f49ee800700 1 -- 172.21.15.80:0/2324286885 learned_addr learned my addr 172.21.15.80:0/2324286885 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:38.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.178+0000 7f49ed400700 1 --2- 172.21.15.80:0/2324286885 >> v2:172.21.15.106:3300/0 conn(0x7f49f0071f20 0x7f49f0072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:38.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.178+0000 7f49ee800700 1 -- 172.21.15.80:0/2324286885 >> v2:172.21.15.106:3300/0 conn(0x7f49f0071f20 msgr2=0x7f49f0072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:38.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.178+0000 7f49ee800700 1 --2- 172.21.15.80:0/2324286885 >> v2:172.21.15.106:3300/0 conn(0x7f49f0071f20 0x7f49f0072330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.178+0000 7f49ee800700 1 -- 172.21.15.80:0/2324286885 >> v1:172.21.15.106:6789/0 conn(0x7f49f00cc1e0 legacy=0x7f49f015b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:38.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.178+0000 7f49ee800700 1 -- 172.21.15.80:0/2324286885 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f006d6f0 con 0x7f49f00b2c30 2024-05-10T04:23:38.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.178+0000 7f49ed400700 1 --2- 172.21.15.80:0/2324286885 >> v2:172.21.15.106:3300/0 conn(0x7f49f0071f20 0x7f49f0072330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:38.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.178+0000 7f49ee800700 1 --2- 172.21.15.80:0/2324286885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49f00b2c30 0x7f49f00b3040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f49f006d560 tx=0x7f49e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd3a95edade0470 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:38.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.180+0000 7f49eca00700 1 -- 172.21.15.80:0/2324286885 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800e070 con 0x7f49f00b2c30 2024-05-10T04:23:38.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.180+0000 7f49eca00700 1 -- 172.21.15.80:0/2324286885 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e800b9c0 con 0x7f49f00b2c30 2024-05-10T04:23:38.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.180+0000 7f49eca00700 1 -- 172.21.15.80:0/2324286885 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800bd70 con 0x7f49f00b2c30 2024-05-10T04:23:38.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.180+0000 7f49f5000700 1 -- 172.21.15.80:0/2324286885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49f00b2c30 msgr2=0x7f49f00b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:38.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.180+0000 7f49f5000700 1 --2- 172.21.15.80:0/2324286885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49f00b2c30 0x7f49f00b3040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f49f006d560 tx=0x7f49e800b330 comp rx=0 tx=0).stop 2024-05-10T04:23:38.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.180+0000 7f49f5000700 1 -- 172.21.15.80:0/2324286885 shutdown_connections 2024-05-10T04:23:38.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.180+0000 7f49f5000700 1 --2- 172.21.15.80:0/2324286885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49f00b2c30 0x7f49f00b3040 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.180+0000 7f49f5000700 1 --2- 172.21.15.80:0/2324286885 >> v2:172.21.15.106:3300/0 conn(0x7f49f0071f20 0x7f49f0072330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.181+0000 7f49f5000700 1 -- 172.21.15.80:0/2324286885 >> 172.21.15.80:0/2324286885 conn(0x7f49f00b1830 msgr2=0x7f49f00b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:38.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.181+0000 7f49f5000700 1 -- 172.21.15.80:0/2324286885 shutdown_connections 2024-05-10T04:23:38.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.181+0000 7f49f5000700 1 -- 172.21.15.80:0/2324286885 wait complete. 2024-05-10T04:23:38.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.183+0000 7f49f5000700 1 Processor -- start 2024-05-10T04:23:38.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.183+0000 7f49f5000700 1 -- start start 2024-05-10T04:23:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.184+0000 7f49f5000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49f0071f20 0x7f49f01f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.184+0000 7f49f5000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49f00b2c30 0x7f49f0153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.184+0000 7f49f5000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f49f00cc1e0 0x7f49f0145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.184+0000 7f49f5000700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f0155ff0 con 0x7f49f00b2c30 2024-05-10T04:23:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.184+0000 7f49f5000700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f0152c30 con 0x7f49f0071f20 2024-05-10T04:23:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.184+0000 7f49f5000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f0152e80 con 0x7f49f00cc1e0 2024-05-10T04:23:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.185+0000 7f49ed400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49f00b2c30 0x7f49f0153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.185+0000 7f49ed400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49f00b2c30 0x7f49f0153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35474/0 (socket says 172.21.15.80:35474) 2024-05-10T04:23:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.185+0000 7f49ed400700 1 -- 172.21.15.80:0/697669963 learned_addr learned my addr 172.21.15.80:0/697669963 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.185+0000 7f49ede00700 1 --2- 172.21.15.80:0/697669963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49f0071f20 0x7f49f01f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.185+0000 7f49ee800700 1 --2- 172.21.15.80:0/697669963 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f49f00cc1e0 0x7f49f0145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.185+0000 7f49ed400700 1 -- 172.21.15.80:0/697669963 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f49f00cc1e0 msgr2=0x7f49f0145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:38.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.185+0000 7f49ed400700 1 --2- 172.21.15.80:0/697669963 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f49f00cc1e0 0x7f49f0145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.185+0000 7f49ed400700 1 -- 172.21.15.80:0/697669963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49f0071f20 msgr2=0x7f49f01f2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:38.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.185+0000 7f49ed400700 1 --2- 172.21.15.80:0/697669963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49f0071f20 0x7f49f01f2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.185+0000 7f49ed400700 1 -- 172.21.15.80:0/697669963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e8009b30 con 0x7f49f00b2c30 2024-05-10T04:23:38.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.185+0000 7f49ee800700 1 --2- 172.21.15.80:0/697669963 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f49f00cc1e0 0x7f49f0145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:38.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.185+0000 7f49ed400700 1 --2- 172.21.15.80:0/697669963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49f00b2c30 0x7f49f0153f20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00e810 tx=0x7f49dc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:38.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.186+0000 7f49e6000700 1 -- 172.21.15.80:0/697669963 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc00c020 con 0x7f49f00b2c30 2024-05-10T04:23:38.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.186+0000 7f49e6000700 1 -- 172.21.15.80:0/697669963 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc004250 con 0x7f49f00b2c30 2024-05-10T04:23:38.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.186+0000 7f49e6000700 1 -- 172.21.15.80:0/697669963 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0036a0 con 0x7f49f00b2c30 2024-05-10T04:23:38.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.186+0000 7f49f5000700 1 -- 172.21.15.80:0/697669963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f0153160 con 0x7f49f00b2c30 2024-05-10T04:23:38.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.186+0000 7f49f5000700 1 -- 172.21.15.80:0/697669963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f0153720 con 0x7f49f00b2c30 2024-05-10T04:23:38.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.187+0000 7f49f5000700 1 -- 172.21.15.80:0/697669963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f0153d70 con 0x7f49f00b2c30 2024-05-10T04:23:38.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.188+0000 7f49e6000700 1 -- 172.21.15.80:0/697669963 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f49dc003800 con 0x7f49f00b2c30 2024-05-10T04:23:38.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.189+0000 7f49e6000700 1 --2- 172.21.15.80:0/697669963 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f49d006ac90 0x7f49d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:38.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.189+0000 7f49e6000700 1 -- 172.21.15.80:0/697669963 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f49dc0891b0 con 0x7f49f00b2c30 2024-05-10T04:23:38.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.189+0000 7f49ede00700 1 --2- 172.21.15.80:0/697669963 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f49d006ac90 0x7f49d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:38.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.190+0000 7f49ede00700 1 --2- 172.21.15.80:0/697669963 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f49d006ac90 0x7f49d006d1a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f49e0001800 tx=0x7f49e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:38.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.193+0000 7f49e6000700 1 -- 172.21.15.80:0/697669963 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f49dc0541e0 con 0x7f49f00b2c30 2024-05-10T04:23:38.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.399+0000 7f49f5000700 1 -- 172.21.15.80:0/697669963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f49f0074af0 con 0x7f49f00b2c30 2024-05-10T04:23:38.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.399+0000 7f49e6000700 1 -- 172.21.15.80:0/697669963 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f49dc057800 con 0x7f49f00b2c30 2024-05-10T04:23:38.399 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-10T04:23:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.401+0000 7f49f5000700 1 -- 172.21.15.80:0/697669963 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f49d006ac90 msgr2=0x7f49d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.401+0000 7f49f5000700 1 --2- 172.21.15.80:0/697669963 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f49d006ac90 0x7f49d006d1a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f49e0001800 tx=0x7f49e0009040 comp rx=0 tx=0).stop 2024-05-10T04:23:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.401+0000 7f49f5000700 1 -- 172.21.15.80:0/697669963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49f00b2c30 msgr2=0x7f49f0153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.401+0000 7f49f5000700 1 --2- 172.21.15.80:0/697669963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49f00b2c30 0x7f49f0153f20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00e810 tx=0x7f49dc00eb20 comp rx=0 tx=0).stop 2024-05-10T04:23:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.401+0000 7f49f5000700 1 -- 172.21.15.80:0/697669963 shutdown_connections 2024-05-10T04:23:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.401+0000 7f49f5000700 1 --2- 172.21.15.80:0/697669963 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f49d006ac90 0x7f49d006d1a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.401+0000 7f49f5000700 1 --2- 172.21.15.80:0/697669963 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f49f00cc1e0 0x7f49f0145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.401+0000 7f49f5000700 1 --2- 172.21.15.80:0/697669963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49f0071f20 0x7f49f01f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.401+0000 7f49f5000700 1 --2- 172.21.15.80:0/697669963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49f00b2c30 0x7f49f0153f20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.401+0000 7f49f5000700 1 -- 172.21.15.80:0/697669963 >> 172.21.15.80:0/697669963 conn(0x7f49f00b1830 msgr2=0x7f49f00af7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:38.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.402+0000 7f49f5000700 1 -- 172.21.15.80:0/697669963 shutdown_connections 2024-05-10T04:23:38.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.402+0000 7f49f5000700 1 -- 172.21.15.80:0/697669963 wait complete. 2024-05-10T04:23:38.431 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:23:38.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.691+0000 7f3a46400700 1 Processor -- start 2024-05-10T04:23:38.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.691+0000 7f3a46400700 1 -- start start 2024-05-10T04:23:38.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.693+0000 7f3a46400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a400b2f50 0x7f3a40161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:38.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.693+0000 7f3a46400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3a400d3030 0x7f3a400d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:38.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.693+0000 7f3a46400700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a400d28c0 con 0x7f3a400d0630 2024-05-10T04:23:38.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.693+0000 7f3a46400700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a400b3360 con 0x7f3a400d3030 2024-05-10T04:23:38.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.693+0000 7f3a46400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a401624e0 con 0x7f3a400b2f50 2024-05-10T04:23:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.693+0000 7f3a3f400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a400b2f50 0x7f3a40161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.693+0000 7f3a3fe00700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3a400d0630 0x7f3a400d0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:48328/0 (socket says 172.21.15.80:48328) 2024-05-10T04:23:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.693+0000 7f3a3fe00700 1 -- 172.21.15.80:0/2337734511 learned_addr learned my addr 172.21.15.80:0/2337734511 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.693+0000 7f3a3ea00700 1 --2- 172.21.15.80:0/2337734511 >> v2:172.21.15.106:3300/0 conn(0x7f3a400d3030 0x7f3a400d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.694+0000 7f3a3e000700 1 -- 172.21.15.80:0/2337734511 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284977458 0 0) 0x7f3a400d28c0 con 0x7f3a400d0630 2024-05-10T04:23:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.694+0000 7f3a3e000700 1 -- 172.21.15.80:0/2337734511 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a240035b0 con 0x7f3a400d0630 2024-05-10T04:23:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.694+0000 7f3a3ea00700 1 -- 172.21.15.80:0/2337734511 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a400b2f50 msgr2=0x7f3a40161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.694+0000 7f3a3ea00700 1 --2- 172.21.15.80:0/2337734511 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a400b2f50 0x7f3a40161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.694+0000 7f3a3ea00700 1 -- 172.21.15.80:0/2337734511 >> v1:172.21.15.106:6789/0 conn(0x7f3a400d0630 legacy=0x7f3a400d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.694+0000 7f3a3ea00700 1 -- 172.21.15.80:0/2337734511 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a400d2ba0 con 0x7f3a400d3030 2024-05-10T04:23:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.694+0000 7f3a3ea00700 1 --2- 172.21.15.80:0/2337734511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a400d3030 0x7f3a400d3440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009840 tx=0x7f3a2c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e72e06a260b69018 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.694+0000 7f3a3e000700 1 -- 172.21.15.80:0/2337734511 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c011830 con 0x7f3a400d3030 2024-05-10T04:23:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.695+0000 7f3a3e000700 1 -- 172.21.15.80:0/2337734511 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c011990 con 0x7f3a400d3030 2024-05-10T04:23:38.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.695+0000 7f3a3e000700 1 -- 172.21.15.80:0/2337734511 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c011d20 con 0x7f3a400d3030 2024-05-10T04:23:38.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.695+0000 7f3a46400700 1 -- 172.21.15.80:0/2337734511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a400d3030 msgr2=0x7f3a400d3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:38.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.695+0000 7f3a46400700 1 --2- 172.21.15.80:0/2337734511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a400d3030 0x7f3a400d3440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009840 tx=0x7f3a2c009b50 comp rx=0 tx=0).stop 2024-05-10T04:23:38.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.695+0000 7f3a46400700 1 -- 172.21.15.80:0/2337734511 shutdown_connections 2024-05-10T04:23:38.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.695+0000 7f3a46400700 1 --2- 172.21.15.80:0/2337734511 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a400b2f50 0x7f3a40161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.695+0000 7f3a46400700 1 --2- 172.21.15.80:0/2337734511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a400d3030 0x7f3a400d3440 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.695+0000 7f3a46400700 1 -- 172.21.15.80:0/2337734511 >> 172.21.15.80:0/2337734511 conn(0x7f3a4006c3f0 msgr2=0x7f3a4006c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:38.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.695+0000 7f3a46400700 1 -- 172.21.15.80:0/2337734511 shutdown_connections 2024-05-10T04:23:38.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.695+0000 7f3a46400700 1 -- 172.21.15.80:0/2337734511 wait complete. 2024-05-10T04:23:38.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.698+0000 7f3a46400700 1 Processor -- start 2024-05-10T04:23:38.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.698+0000 7f3a46400700 1 -- start start 2024-05-10T04:23:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.700+0000 7f3a46400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a400b2f50 0x7f3a400cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.700+0000 7f3a46400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a400d0630 0x7f3a4014c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.700+0000 7f3a46400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a400d3030 0x7f3a4014efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.700+0000 7f3a46400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4014de50 con 0x7f3a400d3030 2024-05-10T04:23:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.700+0000 7f3a46400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a400cb6a0 con 0x7f3a400b2f50 2024-05-10T04:23:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.700+0000 7f3a46400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4014cf80 con 0x7f3a400d0630 2024-05-10T04:23:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.700+0000 7f3a3fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a400d3030 0x7f3a4014efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.700+0000 7f3a3fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a400d3030 0x7f3a4014efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35486/0 (socket says 172.21.15.80:35486) 2024-05-10T04:23:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.700+0000 7f3a3fe00700 1 -- 172.21.15.80:0/1888481675 learned_addr learned my addr 172.21.15.80:0/1888481675 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.701+0000 7f3a3f400700 1 --2- 172.21.15.80:0/1888481675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a400b2f50 0x7f3a400cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.701+0000 7f3a3ea00700 1 --2- 172.21.15.80:0/1888481675 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a400d0630 0x7f3a4014c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.701+0000 7f3a3fe00700 1 -- 172.21.15.80:0/1888481675 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a400d0630 msgr2=0x7f3a4014c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.701+0000 7f3a3fe00700 1 --2- 172.21.15.80:0/1888481675 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a400d0630 0x7f3a4014c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.701+0000 7f3a3fe00700 1 -- 172.21.15.80:0/1888481675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a400b2f50 msgr2=0x7f3a400cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.701+0000 7f3a3fe00700 1 --2- 172.21.15.80:0/1888481675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a400b2f50 0x7f3a400cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.701+0000 7f3a3fe00700 1 -- 172.21.15.80:0/1888481675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c0094a0 con 0x7f3a400d3030 2024-05-10T04:23:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.701+0000 7f3a3fe00700 1 --2- 172.21.15.80:0/1888481675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a400d3030 0x7f3a4014efe0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800cad0 tx=0x7f3a3800ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:38.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.701+0000 7f3a37400700 1 -- 172.21.15.80:0/1888481675 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3800aac0 con 0x7f3a400d3030 2024-05-10T04:23:38.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.701+0000 7f3a37400700 1 -- 172.21.15.80:0/1888481675 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3800ac20 con 0x7f3a400d3030 2024-05-10T04:23:38.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.701+0000 7f3a46400700 1 -- 172.21.15.80:0/1888481675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4014d1d0 con 0x7f3a400d3030 2024-05-10T04:23:38.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.701+0000 7f3a37400700 1 -- 172.21.15.80:0/1888481675 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38012400 con 0x7f3a400d3030 2024-05-10T04:23:38.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.702+0000 7f3a46400700 1 -- 172.21.15.80:0/1888481675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4014d790 con 0x7f3a400d3030 2024-05-10T04:23:38.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.703+0000 7f3a46400700 1 -- 172.21.15.80:0/1888481675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4014df90 con 0x7f3a400d3030 2024-05-10T04:23:38.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.704+0000 7f3a37400700 1 -- 172.21.15.80:0/1888481675 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3a3801b3b0 con 0x7f3a400d3030 2024-05-10T04:23:38.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.704+0000 7f3a37400700 1 --2- 172.21.15.80:0/1888481675 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3a2006ac90 0x7f3a2006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:38.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.705+0000 7f3a37400700 1 -- 172.21.15.80:0/1888481675 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3a380891a0 con 0x7f3a400d3030 2024-05-10T04:23:38.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.705+0000 7f3a3f400700 1 --2- 172.21.15.80:0/1888481675 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3a2006ac90 0x7f3a2006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:38.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.706+0000 7f3a3f400700 1 --2- 172.21.15.80:0/1888481675 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3a2006ac90 0x7f3a2006d1a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3a4008d080 tx=0x7f3a30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:38.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.709+0000 7f3a37400700 1 -- 172.21.15.80:0/1888481675 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3a4014df90 con 0x7f3a400d3030 2024-05-10T04:23:38.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.956+0000 7f3a46400700 1 -- 172.21.15.80:0/1888481675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a4014df90 con 0x7f3a400d3030 2024-05-10T04:23:38.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.957+0000 7f3a37400700 1 -- 172.21.15.80:0/1888481675 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4731 (secure 0 0 0) 0x7f3a4014df90 con 0x7f3a400d3030 2024-05-10T04:23:38.957 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:38.957 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4189316245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4189316245},{"type":"v1","addr":"172.21.15.106:6836","nonce":4189316245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/4150483341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":4150483341},{"type":"v1","addr":"172.21.15.80:6833","nonce":4150483341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1287697381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1287697381},{"type":"v1","addr":"172.21.15.80:6835","nonce":1287697381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:22:37.482943+0000","modified":"2024-05-10T04:22:40.916280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/961352916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":961352916},{"type":"v1","addr":"172.21.15.106:6837","nonce":961352916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:23:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.959+0000 7f3a46400700 1 -- 172.21.15.80:0/1888481675 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3a2006ac90 msgr2=0x7f3a2006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.959+0000 7f3a46400700 1 --2- 172.21.15.80:0/1888481675 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3a2006ac90 0x7f3a2006d1a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3a4008d080 tx=0x7f3a30008040 comp rx=0 tx=0).stop 2024-05-10T04:23:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.959+0000 7f3a46400700 1 -- 172.21.15.80:0/1888481675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a400d3030 msgr2=0x7f3a4014efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.959+0000 7f3a46400700 1 --2- 172.21.15.80:0/1888481675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a400d3030 0x7f3a4014efe0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800cad0 tx=0x7f3a3800ce90 comp rx=0 tx=0).stop 2024-05-10T04:23:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.959+0000 7f3a46400700 1 -- 172.21.15.80:0/1888481675 shutdown_connections 2024-05-10T04:23:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.959+0000 7f3a46400700 1 --2- 172.21.15.80:0/1888481675 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3a2006ac90 0x7f3a2006d1a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.959+0000 7f3a46400700 1 --2- 172.21.15.80:0/1888481675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a400d3030 0x7f3a4014efe0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.959+0000 7f3a46400700 1 --2- 172.21.15.80:0/1888481675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a400b2f50 0x7f3a400cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.959+0000 7f3a46400700 1 --2- 172.21.15.80:0/1888481675 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a400d0630 0x7f3a4014c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.960+0000 7f3a46400700 1 -- 172.21.15.80:0/1888481675 >> 172.21.15.80:0/1888481675 conn(0x7f3a4006c3f0 msgr2=0x7f3a400b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.960+0000 7f3a46400700 1 -- 172.21.15.80:0/1888481675 shutdown_connections 2024-05-10T04:23:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:38.960+0000 7f3a46400700 1 -- 172.21.15.80:0/1888481675 wait complete. 2024-05-10T04:23:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2024-05-10T04:23:38.989 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:23:39.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.250+0000 7fe4e8e00700 1 Processor -- start 2024-05-10T04:23:39.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.250+0000 7fe4e8e00700 1 -- start start 2024-05-10T04:23:39.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.252+0000 7fe4e8e00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe4e40b7120 0x7fe4e40b7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:39.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.252+0000 7fe4e8e00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e40d2850 con 0x7fe4e40b9420 2024-05-10T04:23:39.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.252+0000 7fe4e8e00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e40b7a70 con 0x7fe4e40cf360 2024-05-10T04:23:39.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.252+0000 7fe4e8e00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e40d25b0 con 0x7fe4e40b7120 2024-05-10T04:23:39.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.252+0000 7fe4dbe00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe4e40b9420 0x7fe4e40d2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49006/0 (socket says 172.21.15.80:49006) 2024-05-10T04:23:39.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.252+0000 7fe4dbe00700 1 -- 172.21.15.80:0/3716912098 learned_addr learned my addr 172.21.15.80:0/3716912098 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:39.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.253+0000 7fe4e3e00700 1 --2- 172.21.15.80:0/3716912098 >> v2:172.21.15.106:3300/0 conn(0x7fe4e40b7120 0x7fe4e40b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:39.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.253+0000 7fe4e2a00700 1 -- 172.21.15.80:0/3716912098 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248633085 0 0) 0x7fe4e40d2850 con 0x7fe4e40b9420 2024-05-10T04:23:39.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.253+0000 7fe4e2a00700 1 -- 172.21.15.80:0/3716912098 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4c80035b0 con 0x7fe4e40b9420 2024-05-10T04:23:39.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.253+0000 7fe4e2a00700 1 -- 172.21.15.80:0/3716912098 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966384104 0 0) 0x7fe4e40b7a70 con 0x7fe4e40cf360 2024-05-10T04:23:39.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.253+0000 7fe4e2a00700 1 -- 172.21.15.80:0/3716912098 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4e40d2850 con 0x7fe4e40cf360 2024-05-10T04:23:39.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.253+0000 7fe4e3e00700 1 -- 172.21.15.80:0/3716912098 >> v1:172.21.15.106:6789/0 conn(0x7fe4e40cf360 legacy=0x7fe4e4161d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:39.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.253+0000 7fe4e3e00700 1 -- 172.21.15.80:0/3716912098 >> v1:172.21.15.80:6789/0 conn(0x7fe4e40b9420 legacy=0x7fe4e40d2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:39.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.253+0000 7fe4e3e00700 1 -- 172.21.15.80:0/3716912098 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e40cf770 con 0x7fe4e40b7120 2024-05-10T04:23:39.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.254+0000 7fe4e3e00700 1 --2- 172.21.15.80:0/3716912098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4e40b7120 0x7fe4e40b7530 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009d90 tx=0x7fe4dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4231f426b2884a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:39.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.254+0000 7fe4e2a00700 1 -- 172.21.15.80:0/3716912098 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc00e070 con 0x7fe4e40b7120 2024-05-10T04:23:39.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.254+0000 7fe4e2a00700 1 -- 172.21.15.80:0/3716912098 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4dc00bb20 con 0x7fe4e40b7120 2024-05-10T04:23:39.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.254+0000 7fe4e2a00700 1 -- 172.21.15.80:0/3716912098 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc012430 con 0x7fe4e40b7120 2024-05-10T04:23:39.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.254+0000 7fe4e8e00700 1 -- 172.21.15.80:0/3716912098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4e40b7120 msgr2=0x7fe4e40b7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:39.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.255+0000 7fe4e8e00700 1 --2- 172.21.15.80:0/3716912098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4e40b7120 0x7fe4e40b7530 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009d90 tx=0x7fe4dc00b330 comp rx=0 tx=0).stop 2024-05-10T04:23:39.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.255+0000 7fe4e8e00700 1 -- 172.21.15.80:0/3716912098 shutdown_connections 2024-05-10T04:23:39.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.255+0000 7fe4e8e00700 1 --2- 172.21.15.80:0/3716912098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4e40b7120 0x7fe4e40b7530 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:39.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.255+0000 7fe4e8e00700 1 -- 172.21.15.80:0/3716912098 >> 172.21.15.80:0/3716912098 conn(0x7fe4e406c4e0 msgr2=0x7fe4e406c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:39.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.255+0000 7fe4e8e00700 1 -- 172.21.15.80:0/3716912098 shutdown_connections 2024-05-10T04:23:39.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.255+0000 7fe4e8e00700 1 -- 172.21.15.80:0/3716912098 wait complete. 2024-05-10T04:23:39.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.257+0000 7fe4e8e00700 1 Processor -- start 2024-05-10T04:23:39.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.257+0000 7fe4e8e00700 1 -- start start 2024-05-10T04:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.259+0000 7fe4e8e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4e40b7120 0x7fe4e40aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.259+0000 7fe4e8e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4e40b9420 0x7fe4e414c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.259+0000 7fe4e8e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4e40cf360 0x7fe4e414ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.259+0000 7fe4e8e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e40aba50 con 0x7fe4e40b9420 2024-05-10T04:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.259+0000 7fe4e8e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e40cae80 con 0x7fe4e40b7120 2024-05-10T04:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.259+0000 7fe4e8e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e414d790 con 0x7fe4e40cf360 2024-05-10T04:23:39.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.259+0000 7fe4dbe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4e40b9420 0x7fe4e414c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:39.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.259+0000 7fe4dbe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4e40b9420 0x7fe4e414c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35494/0 (socket says 172.21.15.80:35494) 2024-05-10T04:23:39.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.259+0000 7fe4dbe00700 1 -- 172.21.15.80:0/3924864855 learned_addr learned my addr 172.21.15.80:0/3924864855 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:39.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.259+0000 7fe4e3400700 1 --2- 172.21.15.80:0/3924864855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4e40b7120 0x7fe4e40aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:39.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.259+0000 7fe4e3e00700 1 --2- 172.21.15.80:0/3924864855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4e40cf360 0x7fe4e414ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:39.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.259+0000 7fe4dbe00700 1 -- 172.21.15.80:0/3924864855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4e40cf360 msgr2=0x7fe4e414ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:39.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.259+0000 7fe4dbe00700 1 --2- 172.21.15.80:0/3924864855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4e40cf360 0x7fe4e414ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:39.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.259+0000 7fe4dbe00700 1 -- 172.21.15.80:0/3924864855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4e40b7120 msgr2=0x7fe4e40aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:39.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.259+0000 7fe4dbe00700 1 --2- 172.21.15.80:0/3924864855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4e40b7120 0x7fe4e40aa610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:39.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.259+0000 7fe4dbe00700 1 -- 172.21.15.80:0/3924864855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc009a70 con 0x7fe4e40b9420 2024-05-10T04:23:39.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.260+0000 7fe4dbe00700 1 --2- 172.21.15.80:0/3924864855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4e40b9420 0x7fe4e414c3c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc001eb0 tx=0x7fe4cc00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:39.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.260+0000 7fe4db400700 1 -- 172.21.15.80:0/3924864855 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc005d70 con 0x7fe4e40b9420 2024-05-10T04:23:39.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.260+0000 7fe4db400700 1 -- 172.21.15.80:0/3924864855 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc0070d0 con 0x7fe4e40b9420 2024-05-10T04:23:39.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.260+0000 7fe4db400700 1 -- 172.21.15.80:0/3924864855 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc007480 con 0x7fe4e40b9420 2024-05-10T04:23:39.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.260+0000 7fe4e8e00700 1 -- 172.21.15.80:0/3924864855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e40cabd0 con 0x7fe4e40b9420 2024-05-10T04:23:39.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.260+0000 7fe4e8e00700 1 -- 172.21.15.80:0/3924864855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e414ce60 con 0x7fe4e40b9420 2024-05-10T04:23:39.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.261+0000 7fe4e8e00700 1 -- 172.21.15.80:0/3924864855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e414d920 con 0x7fe4e40b9420 2024-05-10T04:23:39.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.262+0000 7fe4db400700 1 -- 172.21.15.80:0/3924864855 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe4cc0075e0 con 0x7fe4e40b9420 2024-05-10T04:23:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.263+0000 7fe4db400700 1 --2- 172.21.15.80:0/3924864855 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe4c006ac90 0x7fe4c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.263+0000 7fe4db400700 1 -- 172.21.15.80:0/3924864855 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe4cc0888f0 con 0x7fe4e40b9420 2024-05-10T04:23:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.263+0000 7fe4e3400700 1 --2- 172.21.15.80:0/3924864855 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe4c006ac90 0x7fe4c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:39.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.264+0000 7fe4e3400700 1 --2- 172.21.15.80:0/3924864855 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe4c006ac90 0x7fe4c006d1a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe4d40011e0 tx=0x7fe4d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:39.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.268+0000 7fe4db400700 1 -- 172.21.15.80:0/3924864855 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe4cc0539b0 con 0x7fe4e40b9420 2024-05-10T04:23:39.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.474+0000 7fe4e8e00700 1 -- 172.21.15.80:0/3924864855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4e40d3210 con 0x7fe4e40b9420 2024-05-10T04:23:39.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.475+0000 7fe4db400700 1 -- 172.21.15.80:0/3924864855 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16286 (secure 0 0 0) 0x7fe4cc017090 con 0x7fe4e40b9420 2024-05-10T04:23:39.476 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:39.476 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:23:20.092453+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:23:39.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.477+0000 7fe4e8e00700 1 -- 172.21.15.80:0/3924864855 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe4c006ac90 msgr2=0x7fe4c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:39.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.477+0000 7fe4e8e00700 1 --2- 172.21.15.80:0/3924864855 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe4c006ac90 0x7fe4c006d1a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe4d40011e0 tx=0x7fe4d4009040 comp rx=0 tx=0).stop 2024-05-10T04:23:39.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.477+0000 7fe4e8e00700 1 -- 172.21.15.80:0/3924864855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4e40b9420 msgr2=0x7fe4e414c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:39.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.477+0000 7fe4e8e00700 1 --2- 172.21.15.80:0/3924864855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4e40b9420 0x7fe4e414c3c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc001eb0 tx=0x7fe4cc00c7b0 comp rx=0 tx=0).stop 2024-05-10T04:23:39.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.477+0000 7fe4e8e00700 1 -- 172.21.15.80:0/3924864855 shutdown_connections 2024-05-10T04:23:39.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.477+0000 7fe4e8e00700 1 --2- 172.21.15.80:0/3924864855 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe4c006ac90 0x7fe4c006d1a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:39.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.477+0000 7fe4e8e00700 1 --2- 172.21.15.80:0/3924864855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4e40cf360 0x7fe4e414ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:39.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.477+0000 7fe4e8e00700 1 --2- 172.21.15.80:0/3924864855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4e40b7120 0x7fe4e40aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:39.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.477+0000 7fe4e8e00700 1 --2- 172.21.15.80:0/3924864855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4e40b9420 0x7fe4e414c3c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:39.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.477+0000 7fe4e8e00700 1 -- 172.21.15.80:0/3924864855 >> 172.21.15.80:0/3924864855 conn(0x7fe4e406c4e0 msgr2=0x7fe4e40b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:39.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.477+0000 7fe4e8e00700 1 -- 172.21.15.80:0/3924864855 shutdown_connections 2024-05-10T04:23:39.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.477+0000 7fe4e8e00700 1 -- 172.21.15.80:0/3924864855 wait complete. 2024-05-10T04:23:39.504 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T04:23:39.504 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:23:39.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.763+0000 7f0d5f200700 1 Processor -- start 2024-05-10T04:23:39.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.763+0000 7f0d5f200700 1 -- start start 2024-05-10T04:23:39.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.765+0000 7f0d5f200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d600cf220 0x7f0d600cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:39.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.765+0000 7f0d5f200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0d600d2580 0x7f0d600d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:39.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.765+0000 7f0d5f200700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d600d21b0 con 0x7f0d600d09d0 2024-05-10T04:23:39.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.765+0000 7f0d5f200700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d600ce840 con 0x7f0d600d2580 2024-05-10T04:23:39.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.765+0000 7f0d5f200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600d2ed0 con 0x7f0d600cf220 2024-05-10T04:23:39.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.765+0000 7f0d57e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0d600d09d0 0x7f0d600d0de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49012/0 (socket says 172.21.15.80:49012) 2024-05-10T04:23:39.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.765+0000 7f0d57e00700 1 -- 172.21.15.80:0/847249190 learned_addr learned my addr 172.21.15.80:0/847249190 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:39.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.765+0000 7f0d5e800700 1 --2- 172.21.15.80:0/847249190 >> v2:172.21.15.80:3300/0 conn(0x7f0d600d2580 0x7f0d600d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:39.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.766+0000 7f0d5de00700 1 --2- 172.21.15.80:0/847249190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d600cf220 0x7f0d600cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:39.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.766+0000 7f0d5e800700 1 -- 172.21.15.80:0/847249190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d600cf220 msgr2=0x7f0d600cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:39.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.766+0000 7f0d5e800700 1 --2- 172.21.15.80:0/847249190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d600cf220 0x7f0d600cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:39.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.766+0000 7f0d5e800700 1 -- 172.21.15.80:0/847249190 >> v1:172.21.15.80:6789/0 conn(0x7f0d600d09d0 legacy=0x7f0d600d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:39.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.766+0000 7f0d5e800700 1 -- 172.21.15.80:0/847249190 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d600d3160 con 0x7f0d600d2580 2024-05-10T04:23:39.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.766+0000 7f0d5d400700 1 -- 172.21.15.80:0/847249190 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273792759 0 0) 0x7f0d600d21b0 con 0x7f0d600d09d0 2024-05-10T04:23:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.766+0000 7f0d5e800700 1 --2- 172.21.15.80:0/847249190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d600d2580 0x7f0d600d2990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009d90 tx=0x7f0d5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa5833c3800fba3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.766+0000 7f0d5d400700 1 -- 172.21.15.80:0/847249190 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800e070 con 0x7f0d600d2580 2024-05-10T04:23:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.766+0000 7f0d5d400700 1 -- 172.21.15.80:0/847249190 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5800bb20 con 0x7f0d600d2580 2024-05-10T04:23:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.766+0000 7f0d5d400700 1 -- 172.21.15.80:0/847249190 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58012430 con 0x7f0d600d2580 2024-05-10T04:23:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.767+0000 7f0d5f200700 1 -- 172.21.15.80:0/847249190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d600d2580 msgr2=0x7f0d600d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.767+0000 7f0d5f200700 1 --2- 172.21.15.80:0/847249190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d600d2580 0x7f0d600d2990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009d90 tx=0x7f0d5800b330 comp rx=0 tx=0).stop 2024-05-10T04:23:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.767+0000 7f0d5f200700 1 -- 172.21.15.80:0/847249190 shutdown_connections 2024-05-10T04:23:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.767+0000 7f0d5f200700 1 --2- 172.21.15.80:0/847249190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d600d2580 0x7f0d600d2990 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.767+0000 7f0d5f200700 1 --2- 172.21.15.80:0/847249190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d600cf220 0x7f0d600cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.767+0000 7f0d5f200700 1 -- 172.21.15.80:0/847249190 >> 172.21.15.80:0/847249190 conn(0x7f0d6006c580 msgr2=0x7f0d6006c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:39.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.767+0000 7f0d5f200700 1 -- 172.21.15.80:0/847249190 shutdown_connections 2024-05-10T04:23:39.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.767+0000 7f0d5f200700 1 -- 172.21.15.80:0/847249190 wait complete. 2024-05-10T04:23:39.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.770+0000 7f0d5f200700 1 Processor -- start 2024-05-10T04:23:39.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.770+0000 7f0d5f200700 1 -- start start 2024-05-10T04:23:39.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.771+0000 7f0d5f200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d600cf220 0x7f0d6014aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:39.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.771+0000 7f0d5f200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d600d09d0 0x7f0d60149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:39.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.771+0000 7f0d5f200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d600d2580 0x7f0d600b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:39.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.771+0000 7f0d5f200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6014b370 con 0x7f0d600cf220 2024-05-10T04:23:39.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.771+0000 7f0d5f200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600b5560 con 0x7f0d600d2580 2024-05-10T04:23:39.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.771+0000 7f0d5f200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600b4950 con 0x7f0d600d09d0 2024-05-10T04:23:39.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.771+0000 7f0d5de00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d600cf220 0x7f0d6014aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:39.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.771+0000 7f0d5de00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d600cf220 0x7f0d6014aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35518/0 (socket says 172.21.15.80:35518) 2024-05-10T04:23:39.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.771+0000 7f0d5de00700 1 -- 172.21.15.80:0/3603950621 learned_addr learned my addr 172.21.15.80:0/3603950621 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:39.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.772+0000 7f0d5e800700 1 --2- 172.21.15.80:0/3603950621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d600d2580 0x7f0d600b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:39.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.772+0000 7f0d57e00700 1 --2- 172.21.15.80:0/3603950621 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d600d09d0 0x7f0d60149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:39.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.772+0000 7f0d5de00700 1 -- 172.21.15.80:0/3603950621 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d600d09d0 msgr2=0x7f0d60149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:39.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.772+0000 7f0d5de00700 1 --2- 172.21.15.80:0/3603950621 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d600d09d0 0x7f0d60149f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:39.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.772+0000 7f0d5de00700 1 -- 172.21.15.80:0/3603950621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d600d2580 msgr2=0x7f0d600b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:39.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.772+0000 7f0d5de00700 1 --2- 172.21.15.80:0/3603950621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d600d2580 0x7f0d600b59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:39.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.772+0000 7f0d5de00700 1 -- 172.21.15.80:0/3603950621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d58009a70 con 0x7f0d600cf220 2024-05-10T04:23:39.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.772+0000 7f0d5e800700 1 --2- 172.21.15.80:0/3603950621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d600d2580 0x7f0d600b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:39.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.772+0000 7f0d5de00700 1 --2- 172.21.15.80:0/3603950621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d600cf220 0x7f0d6014aa70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000e870 tx=0x7f0d5000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:39.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.772+0000 7f0d56000700 1 -- 172.21.15.80:0/3603950621 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5000c640 con 0x7f0d600cf220 2024-05-10T04:23:39.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.772+0000 7f0d56000700 1 -- 172.21.15.80:0/3603950621 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5000c7a0 con 0x7f0d600cf220 2024-05-10T04:23:39.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.772+0000 7f0d56000700 1 -- 172.21.15.80:0/3603950621 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5000cb10 con 0x7f0d600cf220 2024-05-10T04:23:39.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.772+0000 7f0d5f200700 1 -- 172.21.15.80:0/3603950621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d600b4c30 con 0x7f0d600cf220 2024-05-10T04:23:39.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.773+0000 7f0d5f200700 1 -- 172.21.15.80:0/3603950621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d600b51f0 con 0x7f0d600cf220 2024-05-10T04:23:39.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.774+0000 7f0d5f200700 1 -- 172.21.15.80:0/3603950621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d60074af0 con 0x7f0d600cf220 2024-05-10T04:23:39.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.774+0000 7f0d56000700 1 -- 172.21.15.80:0/3603950621 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0d5000cc70 con 0x7f0d600cf220 2024-05-10T04:23:39.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.775+0000 7f0d56000700 1 --2- 172.21.15.80:0/3603950621 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0d3c06ac90 0x7f0d3c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:39.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.775+0000 7f0d56000700 1 -- 172.21.15.80:0/3603950621 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0d500893b0 con 0x7f0d600cf220 2024-05-10T04:23:39.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.776+0000 7f0d57e00700 1 --2- 172.21.15.80:0/3603950621 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0d3c06ac90 0x7f0d3c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:39.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.776+0000 7f0d57e00700 1 --2- 172.21.15.80:0/3603950621 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0d3c06ac90 0x7f0d3c06d1a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0d601e87b0 tx=0x7f0d48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:39.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:39.780+0000 7f0d56000700 1 -- 172.21.15.80:0/3603950621 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0d50054470 con 0x7f0d600cf220 2024-05-10T04:23:40.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.032+0000 7f0d5f200700 1 -- 172.21.15.80:0/3603950621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d600b9990 con 0x7f0d600cf220 2024-05-10T04:23:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.033+0000 7f0d56000700 1 -- 172.21.15.80:0/3603950621 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4731 (secure 0 0 0) 0x7f0d50057a90 con 0x7f0d600cf220 2024-05-10T04:23:40.034 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:40.034 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4189316245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4189316245},{"type":"v1","addr":"172.21.15.106:6836","nonce":4189316245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/4150483341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":4150483341},{"type":"v1","addr":"172.21.15.80:6833","nonce":4150483341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1287697381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1287697381},{"type":"v1","addr":"172.21.15.80:6835","nonce":1287697381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:22:37.482943+0000","modified":"2024-05-10T04:22:40.916280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/961352916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":961352916},{"type":"v1","addr":"172.21.15.106:6837","nonce":961352916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:23:40.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.035+0000 7f0d5f200700 1 -- 172.21.15.80:0/3603950621 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0d3c06ac90 msgr2=0x7f0d3c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:40.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.035+0000 7f0d5f200700 1 --2- 172.21.15.80:0/3603950621 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0d3c06ac90 0x7f0d3c06d1a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0d601e87b0 tx=0x7f0d48009040 comp rx=0 tx=0).stop 2024-05-10T04:23:40.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.035+0000 7f0d5f200700 1 -- 172.21.15.80:0/3603950621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d600cf220 msgr2=0x7f0d6014aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:40.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.035+0000 7f0d5f200700 1 --2- 172.21.15.80:0/3603950621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d600cf220 0x7f0d6014aa70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000e870 tx=0x7f0d5000ec30 comp rx=0 tx=0).stop 2024-05-10T04:23:40.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.035+0000 7f0d5f200700 1 -- 172.21.15.80:0/3603950621 shutdown_connections 2024-05-10T04:23:40.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.035+0000 7f0d5f200700 1 --2- 172.21.15.80:0/3603950621 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0d3c06ac90 0x7f0d3c06d1a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.035+0000 7f0d5f200700 1 --2- 172.21.15.80:0/3603950621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d600cf220 0x7f0d6014aa70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.035+0000 7f0d5f200700 1 --2- 172.21.15.80:0/3603950621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d600d2580 0x7f0d600b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.035+0000 7f0d5f200700 1 --2- 172.21.15.80:0/3603950621 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d600d09d0 0x7f0d60149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.035+0000 7f0d5f200700 1 -- 172.21.15.80:0/3603950621 >> 172.21.15.80:0/3603950621 conn(0x7f0d6006c580 msgr2=0x7f0d600c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:40.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.035+0000 7f0d5f200700 1 -- 172.21.15.80:0/3603950621 shutdown_connections 2024-05-10T04:23:40.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.035+0000 7f0d5f200700 1 -- 172.21.15.80:0/3603950621 wait complete. 2024-05-10T04:23:40.038 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2024-05-10T04:23:40.063 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:23:40.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.322+0000 7f5a0e800700 1 Processor -- start 2024-05-10T04:23:40.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.322+0000 7f5a0e800700 1 -- start start 2024-05-10T04:23:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.324+0000 7f5a0e800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a080d3460 0x7f5a080b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.324+0000 7f5a0e800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a080b58b0 0x7f5a080b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.324+0000 7f5a0e800700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5a081620e0 0x7f5a081624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.324+0000 7f5a0e800700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a080b3720 con 0x7f5a080b58b0 2024-05-10T04:23:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.324+0000 7f5a0e800700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a080d2730 con 0x7f5a081620e0 2024-05-10T04:23:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.324+0000 7f5a0e800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a080d2fd0 con 0x7f5a080d3460 2024-05-10T04:23:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.324+0000 7f5a06a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a080b58b0 0x7f5a080b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.324+0000 7f5a06a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a080b58b0 0x7f5a080b5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35520/0 (socket says 172.21.15.80:35520) 2024-05-10T04:23:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.324+0000 7f5a06a00700 1 -- 172.21.15.80:0/2814905440 learned_addr learned my addr 172.21.15.80:0/2814905440 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.324+0000 7f5a07e00700 1 --2- 172.21.15.80:0/2814905440 >> v2:172.21.15.106:3300/0 conn(0x7f5a081620e0 0x7f5a081624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.324+0000 7f5a07400700 1 --2- 172.21.15.80:0/2814905440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a080d3460 0x7f5a080b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.324+0000 7f5a06a00700 1 -- 172.21.15.80:0/2814905440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a080d3460 msgr2=0x7f5a080b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.324+0000 7f5a06a00700 1 --2- 172.21.15.80:0/2814905440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a080d3460 0x7f5a080b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.324+0000 7f5a06a00700 1 -- 172.21.15.80:0/2814905440 >> v2:172.21.15.106:3300/0 conn(0x7f5a081620e0 msgr2=0x7f5a081624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.324+0000 7f5a06a00700 1 --2- 172.21.15.80:0/2814905440 >> v2:172.21.15.106:3300/0 conn(0x7f5a081620e0 0x7f5a081624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.324+0000 7f5a06a00700 1 -- 172.21.15.80:0/2814905440 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a080b6200 con 0x7f5a080b58b0 2024-05-10T04:23:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.324+0000 7f5a07400700 1 --2- 172.21.15.80:0/2814905440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a080d3460 0x7f5a080b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.325+0000 7f5a06a00700 1 --2- 172.21.15.80:0/2814905440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a080b58b0 0x7f5a080b5cc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5a0808d320 tx=0x7f59f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845b485df86d587b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.325+0000 7f5a06000700 1 -- 172.21.15.80:0/2814905440 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f400b870 con 0x7f5a080b58b0 2024-05-10T04:23:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.325+0000 7f5a06000700 1 -- 172.21.15.80:0/2814905440 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f400b9d0 con 0x7f5a080b58b0 2024-05-10T04:23:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.325+0000 7f5a06000700 1 -- 172.21.15.80:0/2814905440 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f400bd60 con 0x7f5a080b58b0 2024-05-10T04:23:40.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.326+0000 7f5a0e800700 1 -- 172.21.15.80:0/2814905440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a080b58b0 msgr2=0x7f5a080b5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:40.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.326+0000 7f5a0e800700 1 --2- 172.21.15.80:0/2814905440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a080b58b0 0x7f5a080b5cc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5a0808d320 tx=0x7f59f4009bd0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.326+0000 7f5a0e800700 1 -- 172.21.15.80:0/2814905440 shutdown_connections 2024-05-10T04:23:40.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.326+0000 7f5a0e800700 1 --2- 172.21.15.80:0/2814905440 >> v2:172.21.15.106:3300/0 conn(0x7f5a081620e0 0x7f5a081624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.326+0000 7f5a0e800700 1 --2- 172.21.15.80:0/2814905440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a080d3460 0x7f5a080b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.326+0000 7f5a0e800700 1 --2- 172.21.15.80:0/2814905440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a080b58b0 0x7f5a080b5cc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.326+0000 7f5a0e800700 1 -- 172.21.15.80:0/2814905440 >> 172.21.15.80:0/2814905440 conn(0x7f5a080d0a90 msgr2=0x7f5a080d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:40.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.326+0000 7f5a0e800700 1 -- 172.21.15.80:0/2814905440 shutdown_connections 2024-05-10T04:23:40.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.326+0000 7f5a0e800700 1 -- 172.21.15.80:0/2814905440 wait complete. 2024-05-10T04:23:40.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.328+0000 7f5a0e800700 1 Processor -- start 2024-05-10T04:23:40.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.328+0000 7f5a0e800700 1 -- start start 2024-05-10T04:23:40.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.329+0000 7f5a0e800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a080b58b0 0x7f5a081f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:40.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.329+0000 7f5a0e800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a080d3460 0x7f5a0815a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:40.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.330+0000 7f5a0e800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a081620e0 0x7f5a08160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:40.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.330+0000 7f5a0e800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a081f4990 con 0x7f5a080d3460 2024-05-10T04:23:40.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.330+0000 7f5a0e800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a081f6410 con 0x7f5a080b58b0 2024-05-10T04:23:40.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.330+0000 7f5a0e800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a080aad20 con 0x7f5a081620e0 2024-05-10T04:23:40.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.330+0000 7f5a06a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a080d3460 0x7f5a0815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:40.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.330+0000 7f5a06a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a080d3460 0x7f5a0815a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35534/0 (socket says 172.21.15.80:35534) 2024-05-10T04:23:40.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.330+0000 7f5a06a00700 1 -- 172.21.15.80:0/1300670587 learned_addr learned my addr 172.21.15.80:0/1300670587 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:40.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.330+0000 7f5a07400700 1 --2- 172.21.15.80:0/1300670587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a080b58b0 0x7f5a081f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:40.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.330+0000 7f5a07e00700 1 --2- 172.21.15.80:0/1300670587 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a081620e0 0x7f5a08160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:40.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.330+0000 7f5a06a00700 1 -- 172.21.15.80:0/1300670587 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a081620e0 msgr2=0x7f5a08160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:40.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.330+0000 7f5a06a00700 1 --2- 172.21.15.80:0/1300670587 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a081620e0 0x7f5a08160fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.330+0000 7f5a06a00700 1 -- 172.21.15.80:0/1300670587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a080b58b0 msgr2=0x7f5a081f4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:40.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.330+0000 7f5a06a00700 1 --2- 172.21.15.80:0/1300670587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a080b58b0 0x7f5a081f4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.330+0000 7f5a06a00700 1 -- 172.21.15.80:0/1300670587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f4009550 con 0x7f5a080d3460 2024-05-10T04:23:40.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.330+0000 7f5a06a00700 1 --2- 172.21.15.80:0/1300670587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a080d3460 0x7f5a0815a290 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f59f4000c00 tx=0x7f59f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:40.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.331+0000 7f59ff400700 1 -- 172.21.15.80:0/1300670587 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4004520 con 0x7f5a080d3460 2024-05-10T04:23:40.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.331+0000 7f59ff400700 1 -- 172.21.15.80:0/1300670587 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f401e070 con 0x7f5a080d3460 2024-05-10T04:23:40.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.331+0000 7f5a0e800700 1 -- 172.21.15.80:0/1300670587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0815a7d0 con 0x7f5a080d3460 2024-05-10T04:23:40.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.331+0000 7f59ff400700 1 -- 172.21.15.80:0/1300670587 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f40038c0 con 0x7f5a080d3460 2024-05-10T04:23:40.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.331+0000 7f5a0e800700 1 -- 172.21.15.80:0/1300670587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a080ab250 con 0x7f5a080d3460 2024-05-10T04:23:40.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.332+0000 7f5a0e800700 1 -- 172.21.15.80:0/1300670587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a080732b0 con 0x7f5a080d3460 2024-05-10T04:23:40.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.333+0000 7f59ff400700 1 -- 172.21.15.80:0/1300670587 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f59f4003a20 con 0x7f5a080d3460 2024-05-10T04:23:40.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.334+0000 7f59ff400700 1 --2- 172.21.15.80:0/1300670587 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f59e806ac90 0x7f59e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:40.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.334+0000 7f59ff400700 1 -- 172.21.15.80:0/1300670587 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f59f4020070 con 0x7f5a080d3460 2024-05-10T04:23:40.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.334+0000 7f5a07400700 1 --2- 172.21.15.80:0/1300670587 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f59e806ac90 0x7f59e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:40.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.335+0000 7f5a07400700 1 --2- 172.21.15.80:0/1300670587 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f59e806ac90 0x7f59e806d1a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f59f8006fd0 tx=0x7f59f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:40.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.338+0000 7f59ff400700 1 -- 172.21.15.80:0/1300670587 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f59f40559b0 con 0x7f5a080d3460 2024-05-10T04:23:40.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.589+0000 7f5a0e800700 1 -- 172.21.15.80:0/1300670587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a08074af0 con 0x7f5a080d3460 2024-05-10T04:23:40.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.590+0000 7f59ff400700 1 -- 172.21.15.80:0/1300670587 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4731 (secure 0 0 0) 0x7f59f4015090 con 0x7f5a080d3460 2024-05-10T04:23:40.591 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:40.591 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4189316245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4189316245},{"type":"v1","addr":"172.21.15.106:6836","nonce":4189316245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/4150483341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":4150483341},{"type":"v1","addr":"172.21.15.80:6833","nonce":4150483341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1287697381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1287697381},{"type":"v1","addr":"172.21.15.80:6835","nonce":1287697381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:22:37.482943+0000","modified":"2024-05-10T04:22:40.916280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/961352916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":961352916},{"type":"v1","addr":"172.21.15.106:6837","nonce":961352916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:23:40.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.593+0000 7f5a0e800700 1 -- 172.21.15.80:0/1300670587 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f59e806ac90 msgr2=0x7f59e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:40.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.593+0000 7f5a0e800700 1 --2- 172.21.15.80:0/1300670587 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f59e806ac90 0x7f59e806d1a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f59f8006fd0 tx=0x7f59f8008040 comp rx=0 tx=0).stop 2024-05-10T04:23:40.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.593+0000 7f5a0e800700 1 -- 172.21.15.80:0/1300670587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a080d3460 msgr2=0x7f5a0815a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:40.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.593+0000 7f5a0e800700 1 --2- 172.21.15.80:0/1300670587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a080d3460 0x7f5a0815a290 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f59f4000c00 tx=0x7f59f4004750 comp rx=0 tx=0).stop 2024-05-10T04:23:40.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.593+0000 7f5a0e800700 1 -- 172.21.15.80:0/1300670587 shutdown_connections 2024-05-10T04:23:40.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.593+0000 7f5a0e800700 1 --2- 172.21.15.80:0/1300670587 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f59e806ac90 0x7f59e806d1a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.593+0000 7f5a0e800700 1 --2- 172.21.15.80:0/1300670587 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a081620e0 0x7f5a08160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.593+0000 7f5a0e800700 1 --2- 172.21.15.80:0/1300670587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a080b58b0 0x7f5a081f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.593+0000 7f5a0e800700 1 --2- 172.21.15.80:0/1300670587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a080d3460 0x7f5a0815a290 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.593+0000 7f5a0e800700 1 -- 172.21.15.80:0/1300670587 >> 172.21.15.80:0/1300670587 conn(0x7f5a080d0a90 msgr2=0x7f5a0815e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:40.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.593+0000 7f5a0e800700 1 -- 172.21.15.80:0/1300670587 shutdown_connections 2024-05-10T04:23:40.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.593+0000 7f5a0e800700 1 -- 172.21.15.80:0/1300670587 wait complete. 2024-05-10T04:23:40.595 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2024-05-10T04:23:40.620 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:23:40.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.880+0000 7f1673600700 1 Processor -- start 2024-05-10T04:23:40.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.880+0000 7f1673600700 1 -- start start 2024-05-10T04:23:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.882+0000 7f1673600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f166c162bc0 0x7f166c0b3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.882+0000 7f1673600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f166c0d2710 0x7f166c0d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.882+0000 7f1673600700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166c15f960 con 0x7f166c0b5bf0 2024-05-10T04:23:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.882+0000 7f1673600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f166c15f680 con 0x7f166c0d2710 2024-05-10T04:23:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.882+0000 7f1673600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166c1620e0 con 0x7f166c162bc0 2024-05-10T04:23:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.882+0000 7f1671600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f166c0d2710 0x7f166c0d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:40.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.882+0000 7f166be00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f166c0b5bf0 0x7f166c0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49024/0 (socket says 172.21.15.80:49024) 2024-05-10T04:23:40.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.882+0000 7f166be00700 1 -- 172.21.15.80:0/1492098112 learned_addr learned my addr 172.21.15.80:0/1492098112 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.882+0000 7f1670c00700 1 --2- 172.21.15.80:0/1492098112 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f166c162bc0 0x7f166c0b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.883+0000 7f1671600700 1 -- 172.21.15.80:0/1492098112 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f166c162bc0 msgr2=0x7f166c0b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.883+0000 7f1671600700 1 --2- 172.21.15.80:0/1492098112 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f166c162bc0 0x7f166c0b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.883+0000 7f1671600700 1 -- 172.21.15.80:0/1492098112 >> v1:172.21.15.80:6789/0 conn(0x7f166c0b5bf0 legacy=0x7f166c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.883+0000 7f1671600700 1 -- 172.21.15.80:0/1492098112 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c1623c0 con 0x7f166c0d2710 2024-05-10T04:23:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.883+0000 7f1671600700 1 --2- 172.21.15.80:0/1492098112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f166c0d2710 0x7f166c0d2b20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1664009d90 tx=0x7f166400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29b117e7ac98e76 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.883+0000 7f166b400700 1 -- 172.21.15.80:0/1492098112 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166400e070 con 0x7f166c0d2710 2024-05-10T04:23:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.883+0000 7f166b400700 1 -- 172.21.15.80:0/1492098112 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166400bbd0 con 0x7f166c0d2710 2024-05-10T04:23:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.883+0000 7f166b400700 1 -- 172.21.15.80:0/1492098112 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1664012430 con 0x7f166c0d2710 2024-05-10T04:23:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.884+0000 7f1673600700 1 -- 172.21.15.80:0/1492098112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f166c0d2710 msgr2=0x7f166c0d2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.884+0000 7f1673600700 1 --2- 172.21.15.80:0/1492098112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f166c0d2710 0x7f166c0d2b20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1664009d90 tx=0x7f166400b330 comp rx=0 tx=0).stop 2024-05-10T04:23:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.884+0000 7f1673600700 1 -- 172.21.15.80:0/1492098112 shutdown_connections 2024-05-10T04:23:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.884+0000 7f1673600700 1 --2- 172.21.15.80:0/1492098112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f166c0d2710 0x7f166c0d2b20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.884+0000 7f1673600700 1 --2- 172.21.15.80:0/1492098112 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f166c162bc0 0x7f166c0b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.884+0000 7f1673600700 1 -- 172.21.15.80:0/1492098112 >> 172.21.15.80:0/1492098112 conn(0x7f166c0d0c30 msgr2=0x7f166c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.884+0000 7f1673600700 1 -- 172.21.15.80:0/1492098112 shutdown_connections 2024-05-10T04:23:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.884+0000 7f1673600700 1 -- 172.21.15.80:0/1492098112 wait complete. 2024-05-10T04:23:40.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.886+0000 7f1673600700 1 Processor -- start 2024-05-10T04:23:40.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.886+0000 7f1673600700 1 -- start start 2024-05-10T04:23:40.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.888+0000 7f1673600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f166c0b5bf0 0x7f166c0c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:40.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.888+0000 7f1673600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f166c0d2710 0x7f166c15a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:40.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.888+0000 7f1673600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f166c162bc0 0x7f166c15a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:40.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.888+0000 7f1673600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c159ed0 con 0x7f166c0d2710 2024-05-10T04:23:40.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.888+0000 7f1673600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c15b630 con 0x7f166c0b5bf0 2024-05-10T04:23:40.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.888+0000 7f1673600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166c0c7d40 con 0x7f166c162bc0 2024-05-10T04:23:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.888+0000 7f166be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f166c0d2710 0x7f166c15a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.888+0000 7f166be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f166c0d2710 0x7f166c15a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35546/0 (socket says 172.21.15.80:35546) 2024-05-10T04:23:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.888+0000 7f166be00700 1 -- 172.21.15.80:0/2428221709 learned_addr learned my addr 172.21.15.80:0/2428221709 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.888+0000 7f1671600700 1 --2- 172.21.15.80:0/2428221709 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f166c162bc0 0x7f166c15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.888+0000 7f1670c00700 1 --2- 172.21.15.80:0/2428221709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f166c0b5bf0 0x7f166c0c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.889+0000 7f166be00700 1 -- 172.21.15.80:0/2428221709 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f166c162bc0 msgr2=0x7f166c15a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.889+0000 7f166be00700 1 --2- 172.21.15.80:0/2428221709 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f166c162bc0 0x7f166c15a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.889+0000 7f166be00700 1 -- 172.21.15.80:0/2428221709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f166c0b5bf0 msgr2=0x7f166c0c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.889+0000 7f166be00700 1 --2- 172.21.15.80:0/2428221709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f166c0b5bf0 0x7f166c0c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.889+0000 7f166be00700 1 -- 172.21.15.80:0/2428221709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1664009a70 con 0x7f166c0d2710 2024-05-10T04:23:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.889+0000 7f166be00700 1 --2- 172.21.15.80:0/2428221709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f166c0d2710 0x7f166c15a2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f165800c500 tx=0x7f165800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.889+0000 7f1668c00700 1 -- 172.21.15.80:0/2428221709 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16580074e0 con 0x7f166c0d2710 2024-05-10T04:23:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.889+0000 7f1668c00700 1 -- 172.21.15.80:0/2428221709 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1658007640 con 0x7f166c0d2710 2024-05-10T04:23:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.889+0000 7f1673600700 1 -- 172.21.15.80:0/2428221709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166c0c7a80 con 0x7f166c0d2710 2024-05-10T04:23:40.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.889+0000 7f1668c00700 1 -- 172.21.15.80:0/2428221709 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1658005a30 con 0x7f166c0d2710 2024-05-10T04:23:40.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.889+0000 7f1673600700 1 -- 172.21.15.80:0/2428221709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166c0c7f90 con 0x7f166c0d2710 2024-05-10T04:23:40.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.890+0000 7f1673600700 1 -- 172.21.15.80:0/2428221709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166c074af0 con 0x7f166c0d2710 2024-05-10T04:23:40.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.891+0000 7f1668c00700 1 -- 172.21.15.80:0/2428221709 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1658005b90 con 0x7f166c0d2710 2024-05-10T04:23:40.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.892+0000 7f1668c00700 1 --2- 172.21.15.80:0/2428221709 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f164c06acc0 0x7f164c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:40.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.892+0000 7f1668c00700 1 -- 172.21.15.80:0/2428221709 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f16580885c0 con 0x7f166c0d2710 2024-05-10T04:23:40.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.893+0000 7f1670c00700 1 --2- 172.21.15.80:0/2428221709 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f164c06acc0 0x7f164c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:40.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.893+0000 7f1670c00700 1 --2- 172.21.15.80:0/2428221709 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f164c06acc0 0x7f164c06d1d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1660006b20 tx=0x7f1660008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:40.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:40.897+0000 7f1668c00700 1 -- 172.21.15.80:0/2428221709 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f16580537b0 con 0x7f166c0d2710 2024-05-10T04:23:41.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.105+0000 7f1673600700 1 -- 172.21.15.80:0/2428221709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f166c0d21a0 con 0x7f166c0d2710 2024-05-10T04:23:41.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.106+0000 7f1668c00700 1 -- 172.21.15.80:0/2428221709 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16286 (secure 0 0 0) 0x7f16580011c0 con 0x7f166c0d2710 2024-05-10T04:23:41.108 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:41.108 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:23:20.092453+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:22:35.751764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:22:36.465587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:23:41.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.109+0000 7f1673600700 1 -- 172.21.15.80:0/2428221709 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f164c06acc0 msgr2=0x7f164c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:41.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.109+0000 7f1673600700 1 --2- 172.21.15.80:0/2428221709 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f164c06acc0 0x7f164c06d1d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1660006b20 tx=0x7f1660008040 comp rx=0 tx=0).stop 2024-05-10T04:23:41.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.109+0000 7f1673600700 1 -- 172.21.15.80:0/2428221709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f166c0d2710 msgr2=0x7f166c15a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:41.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.109+0000 7f1673600700 1 --2- 172.21.15.80:0/2428221709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f166c0d2710 0x7f166c15a2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f165800c500 tx=0x7f165800c810 comp rx=0 tx=0).stop 2024-05-10T04:23:41.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.109+0000 7f1673600700 1 -- 172.21.15.80:0/2428221709 shutdown_connections 2024-05-10T04:23:41.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.109+0000 7f1673600700 1 --2- 172.21.15.80:0/2428221709 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f164c06acc0 0x7f164c06d1d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:41.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.109+0000 7f1673600700 1 --2- 172.21.15.80:0/2428221709 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f166c162bc0 0x7f166c15a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:41.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.109+0000 7f1673600700 1 --2- 172.21.15.80:0/2428221709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f166c0b5bf0 0x7f166c0c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:41.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.109+0000 7f1673600700 1 --2- 172.21.15.80:0/2428221709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f166c0d2710 0x7f166c15a2f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:41.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.109+0000 7f1673600700 1 -- 172.21.15.80:0/2428221709 >> 172.21.15.80:0/2428221709 conn(0x7f166c0d0c30 msgr2=0x7f166c15eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:41.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.109+0000 7f1673600700 1 -- 172.21.15.80:0/2428221709 shutdown_connections 2024-05-10T04:23:41.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.109+0000 7f1673600700 1 -- 172.21.15.80:0/2428221709 wait complete. 2024-05-10T04:23:41.138 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T04:23:41.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.399+0000 7f4500600700 1 Processor -- start 2024-05-10T04:23:41.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.400+0000 7f4500600700 1 -- start start 2024-05-10T04:23:41.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.401+0000 7f4500600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f44f815e610 0x7f44f80b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:41.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.401+0000 7f4500600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f44f80b7910 0x7f44f806c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:41.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.401+0000 7f4500600700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f80d2c00 con 0x7f44f8162150 2024-05-10T04:23:41.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.401+0000 7f4500600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f815ea20 con 0x7f44f815e610 2024-05-10T04:23:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.401+0000 7f4500600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f8162630 con 0x7f44f80b7910 2024-05-10T04:23:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.402+0000 7f44fdc00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f44f8162150 0x7f44f80cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49034/0 (socket says 172.21.15.80:49034) 2024-05-10T04:23:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.402+0000 7f44fdc00700 1 -- 172.21.15.80:0/376597548 learned_addr learned my addr 172.21.15.80:0/376597548 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.402+0000 7f44fd200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f44f815e610 0x7f44f80b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.402+0000 7f44fe600700 1 --2- 172.21.15.80:0/376597548 >> v2:172.21.15.106:3300/0 conn(0x7f44f80b7910 0x7f44f806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.402+0000 7f44fd200700 1 -- 172.21.15.80:0/376597548 >> v2:172.21.15.106:3300/0 conn(0x7f44f80b7910 msgr2=0x7f44f806c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.402+0000 7f44fd200700 1 --2- 172.21.15.80:0/376597548 >> v2:172.21.15.106:3300/0 conn(0x7f44f80b7910 0x7f44f806c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.402+0000 7f44fd200700 1 -- 172.21.15.80:0/376597548 >> v1:172.21.15.80:6789/0 conn(0x7f44f8162150 legacy=0x7f44f80cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.402+0000 7f44fd200700 1 -- 172.21.15.80:0/376597548 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f8162910 con 0x7f44f815e610 2024-05-10T04:23:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.402+0000 7f44f7e00700 1 -- 172.21.15.80:0/376597548 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203715361 0 0) 0x7f44f80d2c00 con 0x7f44f8162150 2024-05-10T04:23:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.402+0000 7f44fd200700 1 --2- 172.21.15.80:0/376597548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44f815e610 0x7f44f80b73d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f44f80d0120 tx=0x7f44e4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6279ba9741ace1e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:41.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.403+0000 7f44f7e00700 1 -- 172.21.15.80:0/376597548 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4011830 con 0x7f44f815e610 2024-05-10T04:23:41.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.403+0000 7f44f7e00700 1 -- 172.21.15.80:0/376597548 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e4011990 con 0x7f44f815e610 2024-05-10T04:23:41.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.403+0000 7f44f7e00700 1 -- 172.21.15.80:0/376597548 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4011d20 con 0x7f44f815e610 2024-05-10T04:23:41.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.403+0000 7f4500600700 1 -- 172.21.15.80:0/376597548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44f815e610 msgr2=0x7f44f80b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.403+0000 7f4500600700 1 --2- 172.21.15.80:0/376597548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44f815e610 0x7f44f80b73d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f44f80d0120 tx=0x7f44e4009b20 comp rx=0 tx=0).stop 2024-05-10T04:23:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.404+0000 7f4500600700 1 -- 172.21.15.80:0/376597548 shutdown_connections 2024-05-10T04:23:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.404+0000 7f4500600700 1 --2- 172.21.15.80:0/376597548 >> v2:172.21.15.106:3300/0 conn(0x7f44f80b7910 0x7f44f806c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.404+0000 7f4500600700 1 --2- 172.21.15.80:0/376597548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44f815e610 0x7f44f80b73d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.404+0000 7f4500600700 1 -- 172.21.15.80:0/376597548 >> 172.21.15.80:0/376597548 conn(0x7f44f80d3e10 msgr2=0x7f44f80d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.404+0000 7f4500600700 1 -- 172.21.15.80:0/376597548 shutdown_connections 2024-05-10T04:23:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.404+0000 7f4500600700 1 -- 172.21.15.80:0/376597548 wait complete. 2024-05-10T04:23:41.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.406+0000 7f4500600700 1 Processor -- start 2024-05-10T04:23:41.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.406+0000 7f4500600700 1 -- start start 2024-05-10T04:23:41.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.407+0000 7f4500600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44f80b7910 0x7f44f80ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:41.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.407+0000 7f4500600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f815e610 0x7f44f814e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:41.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.407+0000 7f4500600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44f8162150 0x7f44f815a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:41.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.408+0000 7f4500600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f80c8830 con 0x7f44f8162150 2024-05-10T04:23:41.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.408+0000 7f4500600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f80cd280 con 0x7f44f80b7910 2024-05-10T04:23:41.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.408+0000 7f4500600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f80ccfd0 con 0x7f44f815e610 2024-05-10T04:23:41.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.408+0000 7f44fe600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44f8162150 0x7f44f815a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:41.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.408+0000 7f44fe600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44f8162150 0x7f44f815a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35564/0 (socket says 172.21.15.80:35564) 2024-05-10T04:23:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.408+0000 7f44fe600700 1 -- 172.21.15.80:0/3804332367 learned_addr learned my addr 172.21.15.80:0/3804332367 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.408+0000 7f44fdc00700 1 --2- 172.21.15.80:0/3804332367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44f80b7910 0x7f44f80ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.408+0000 7f44fd200700 1 --2- 172.21.15.80:0/3804332367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f815e610 0x7f44f814e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.408+0000 7f44fe600700 1 -- 172.21.15.80:0/3804332367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f815e610 msgr2=0x7f44f814e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.408+0000 7f44fe600700 1 --2- 172.21.15.80:0/3804332367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f815e610 0x7f44f814e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.408+0000 7f44fe600700 1 -- 172.21.15.80:0/3804332367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44f80b7910 msgr2=0x7f44f80ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.408+0000 7f44fe600700 1 --2- 172.21.15.80:0/3804332367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44f80b7910 0x7f44f80ca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.408+0000 7f44fe600700 1 -- 172.21.15.80:0/3804332367 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e40094a0 con 0x7f44f8162150 2024-05-10T04:23:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.408+0000 7f44fd200700 1 --2- 172.21.15.80:0/3804332367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f815e610 0x7f44f814e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.409+0000 7f44fe600700 1 --2- 172.21.15.80:0/3804332367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44f8162150 0x7f44f815a450 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f44f000efc0 tx=0x7f44f000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.409+0000 7f44f5600700 1 -- 172.21.15.80:0/3804332367 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f000cb80 con 0x7f44f8162150 2024-05-10T04:23:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.409+0000 7f44f5600700 1 -- 172.21.15.80:0/3804332367 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f000f040 con 0x7f44f8162150 2024-05-10T04:23:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.409+0000 7f4500600700 1 -- 172.21.15.80:0/3804332367 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f80ce050 con 0x7f44f8162150 2024-05-10T04:23:41.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.409+0000 7f44f5600700 1 -- 172.21.15.80:0/3804332367 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0014480 con 0x7f44f8162150 2024-05-10T04:23:41.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.409+0000 7f4500600700 1 -- 172.21.15.80:0/3804332367 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f80cd7b0 con 0x7f44f8162150 2024-05-10T04:23:41.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.410+0000 7f4500600700 1 -- 172.21.15.80:0/3804332367 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f8074af0 con 0x7f44f8162150 2024-05-10T04:23:41.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.411+0000 7f44f5600700 1 -- 172.21.15.80:0/3804332367 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f44f00145e0 con 0x7f44f8162150 2024-05-10T04:23:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.412+0000 7f44f5600700 1 --2- 172.21.15.80:0/3804332367 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44d806ac90 0x7f44d806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.412+0000 7f44f5600700 1 -- 172.21.15.80:0/3804332367 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f44f0089d50 con 0x7f44f8162150 2024-05-10T04:23:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.412+0000 7f44fdc00700 1 --2- 172.21.15.80:0/3804332367 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44d806ac90 0x7f44d806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.413+0000 7f44fdc00700 1 --2- 172.21.15.80:0/3804332367 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44d806ac90 0x7f44d806d1a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f44ec000f60 tx=0x7f44ec007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:41.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.417+0000 7f44f5600700 1 -- 172.21.15.80:0/3804332367 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f44f0054d80 con 0x7f44f8162150 2024-05-10T04:23:41.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.670+0000 7f4500600700 1 -- 172.21.15.80:0/3804332367 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f44f8161ec0 con 0x7f44f8162150 2024-05-10T04:23:41.672 INFO:tasks.ceph.mon.a.smithi080.stderr:2024-05-10T04:23:41.672+0000 7f9332200700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T04:23:41.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.680+0000 7f44f5600700 1 -- 172.21.15.80:0/3804332367 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f44f0018020 con 0x7f44f8162150 2024-05-10T04:23:41.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.683+0000 7f4500600700 1 -- 172.21.15.80:0/3804332367 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44d806ac90 msgr2=0x7f44d806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:41.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.683+0000 7f4500600700 1 --2- 172.21.15.80:0/3804332367 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44d806ac90 0x7f44d806d1a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f44ec000f60 tx=0x7f44ec007e70 comp rx=0 tx=0).stop 2024-05-10T04:23:41.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.683+0000 7f4500600700 1 -- 172.21.15.80:0/3804332367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44f8162150 msgr2=0x7f44f815a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:41.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.683+0000 7f4500600700 1 --2- 172.21.15.80:0/3804332367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44f8162150 0x7f44f815a450 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f44f000efc0 tx=0x7f44f000c0c0 comp rx=0 tx=0).stop 2024-05-10T04:23:41.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.683+0000 7f4500600700 1 -- 172.21.15.80:0/3804332367 shutdown_connections 2024-05-10T04:23:41.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.683+0000 7f4500600700 1 --2- 172.21.15.80:0/3804332367 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f44d806ac90 0x7f44d806d1a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:41.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.683+0000 7f4500600700 1 --2- 172.21.15.80:0/3804332367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44f8162150 0x7f44f815a450 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:41.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.683+0000 7f4500600700 1 --2- 172.21.15.80:0/3804332367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44f80b7910 0x7f44f80ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:41.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.683+0000 7f4500600700 1 --2- 172.21.15.80:0/3804332367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f815e610 0x7f44f814e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:41.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.683+0000 7f4500600700 1 -- 172.21.15.80:0/3804332367 >> 172.21.15.80:0/3804332367 conn(0x7f44f80d3e10 msgr2=0x7f44f815d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:41.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.683+0000 7f4500600700 1 -- 172.21.15.80:0/3804332367 shutdown_connections 2024-05-10T04:23:41.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.683+0000 7f4500600700 1 -- 172.21.15.80:0/3804332367 wait complete. 2024-05-10T04:23:41.685 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T04:23:41.709 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T04:23:41.828 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2024-05-10T04:23:41.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.973+0000 7f0701800700 1 Processor -- start 2024-05-10T04:23:41.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.973+0000 7f0701800700 1 -- start start 2024-05-10T04:23:41.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.975+0000 7f0701800700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f06fc0b47e0 0x7f06fc0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:41.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.975+0000 7f0701800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06fc15c4e0 con 0x7f06fc06e800 2024-05-10T04:23:41.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.975+0000 7f0701800700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06fc0ce3a0 con 0x7f06fc15b9c0 2024-05-10T04:23:41.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.975+0000 7f0701800700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06fc15c710 con 0x7f06fc0b47e0 2024-05-10T04:23:41.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.975+0000 7f06fa000700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f06fc06e800 0x7f06fc06ec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49050/0 (socket says 172.21.15.80:49050) 2024-05-10T04:23:41.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.975+0000 7f06fa000700 1 -- 172.21.15.80:0/431914975 learned_addr learned my addr 172.21.15.80:0/431914975 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:41.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.975+0000 7f06faa00700 1 --2- 172.21.15.80:0/431914975 >> v2:172.21.15.106:3300/0 conn(0x7f06fc0b47e0 0x7f06fc0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:41.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.976+0000 7f06f9600700 1 -- 172.21.15.80:0/431914975 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706871045 0 0) 0x7f06fc15c4e0 con 0x7f06fc06e800 2024-05-10T04:23:41.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.976+0000 7f06f9600700 1 -- 172.21.15.80:0/431914975 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06e00057c0 con 0x7f06fc06e800 2024-05-10T04:23:41.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.976+0000 7f06f9600700 1 -- 172.21.15.80:0/431914975 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683019630 0 0) 0x7f06fc0ce3a0 con 0x7f06fc15b9c0 2024-05-10T04:23:41.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.976+0000 7f06f9600700 1 -- 172.21.15.80:0/431914975 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06fc15c4e0 con 0x7f06fc15b9c0 2024-05-10T04:23:41.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.976+0000 7f06f9600700 1 -- 172.21.15.80:0/431914975 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1302597288 0 0) 0x7f06e00057c0 con 0x7f06fc06e800 2024-05-10T04:23:41.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.976+0000 7f06faa00700 1 -- 172.21.15.80:0/431914975 >> v1:172.21.15.106:6789/0 conn(0x7f06fc15b9c0 legacy=0x7f06fc15bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:41.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.976+0000 7f06faa00700 1 -- 172.21.15.80:0/431914975 >> v1:172.21.15.80:6789/0 conn(0x7f06fc06e800 legacy=0x7f06fc06ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:41.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.976+0000 7f06faa00700 1 -- 172.21.15.80:0/431914975 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc0b4bf0 con 0x7f06fc0b47e0 2024-05-10T04:23:41.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.976+0000 7f06faa00700 1 --2- 172.21.15.80:0/431914975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06fc0b47e0 0x7f06fc0cf400 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009840 tx=0x7f06ec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=824ca909e4ab0a71 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:41.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.976+0000 7f06f9600700 1 -- 172.21.15.80:0/431914975 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e8001670 con 0x7f06fc0b47e0 2024-05-10T04:23:41.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.977+0000 7f06f9600700 1 -- 172.21.15.80:0/431914975 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec004030 con 0x7f06fc0b47e0 2024-05-10T04:23:41.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.977+0000 7f06f9600700 1 -- 172.21.15.80:0/431914975 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0043c0 con 0x7f06fc0b47e0 2024-05-10T04:23:41.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.977+0000 7f0701800700 1 -- 172.21.15.80:0/431914975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06fc0b47e0 msgr2=0x7f06fc0cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:41.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.977+0000 7f0701800700 1 --2- 172.21.15.80:0/431914975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06fc0b47e0 0x7f06fc0cf400 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009840 tx=0x7f06ec009b50 comp rx=0 tx=0).stop 2024-05-10T04:23:41.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.977+0000 7f0701800700 1 -- 172.21.15.80:0/431914975 shutdown_connections 2024-05-10T04:23:41.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.977+0000 7f0701800700 1 --2- 172.21.15.80:0/431914975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06fc0b47e0 0x7f06fc0cf400 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:41.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.977+0000 7f0701800700 1 -- 172.21.15.80:0/431914975 >> 172.21.15.80:0/431914975 conn(0x7f06fc0b1830 msgr2=0x7f06fc0b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:41.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.977+0000 7f0701800700 1 -- 172.21.15.80:0/431914975 shutdown_connections 2024-05-10T04:23:41.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.977+0000 7f0701800700 1 -- 172.21.15.80:0/431914975 wait complete. 2024-05-10T04:23:41.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.980+0000 7f0701800700 1 Processor -- start 2024-05-10T04:23:41.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.980+0000 7f0701800700 1 -- start start 2024-05-10T04:23:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.981+0000 7f0701800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06fc06e800 0x7f06fc14dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.981+0000 7f0701800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06fc0b47e0 0x7f06fc13f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.981+0000 7f0701800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06fc15b9c0 0x7f06fc14e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.981+0000 7f0701800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc14b8e0 con 0x7f06fc15b9c0 2024-05-10T04:23:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.981+0000 7f0701800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc152c10 con 0x7f06fc06e800 2024-05-10T04:23:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.981+0000 7f0701800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc1f7f60 con 0x7f06fc0b47e0 2024-05-10T04:23:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.981+0000 7f06fb400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06fc15b9c0 0x7f06fc14e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.982+0000 7f06fb400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06fc15b9c0 0x7f06fc14e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35580/0 (socket says 172.21.15.80:35580) 2024-05-10T04:23:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.982+0000 7f06fb400700 1 -- 172.21.15.80:0/718384992 learned_addr learned my addr 172.21.15.80:0/718384992 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.982+0000 7f06faa00700 1 --2- 172.21.15.80:0/718384992 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06fc06e800 0x7f06fc14dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.982+0000 7f06fa000700 1 --2- 172.21.15.80:0/718384992 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06fc0b47e0 0x7f06fc13f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.982+0000 7f06fb400700 1 -- 172.21.15.80:0/718384992 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06fc0b47e0 msgr2=0x7f06fc13f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.982+0000 7f06fb400700 1 --2- 172.21.15.80:0/718384992 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06fc0b47e0 0x7f06fc13f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.982+0000 7f06fb400700 1 -- 172.21.15.80:0/718384992 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06fc06e800 msgr2=0x7f06fc14dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.982+0000 7f06fb400700 1 --2- 172.21.15.80:0/718384992 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06fc06e800 0x7f06fc14dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.982+0000 7f06fb400700 1 -- 172.21.15.80:0/718384992 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec0094a0 con 0x7f06fc15b9c0 2024-05-10T04:23:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.982+0000 7f06fa000700 1 --2- 172.21.15.80:0/718384992 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06fc0b47e0 0x7f06fc13f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.982+0000 7f06fb400700 1 --2- 172.21.15.80:0/718384992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06fc15b9c0 0x7f06fc14e670 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f06f400cb80 tx=0x7f06f400ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.982+0000 7f06f2a00700 1 -- 172.21.15.80:0/718384992 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f4003c00 con 0x7f06fc15b9c0 2024-05-10T04:23:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.982+0000 7f06f2a00700 1 -- 172.21.15.80:0/718384992 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f4003d60 con 0x7f06fc15b9c0 2024-05-10T04:23:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.982+0000 7f0701800700 1 -- 172.21.15.80:0/718384992 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06fc14e270 con 0x7f06fc15b9c0 2024-05-10T04:23:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.983+0000 7f06f2a00700 1 -- 172.21.15.80:0/718384992 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f400ab00 con 0x7f06fc15b9c0 2024-05-10T04:23:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.983+0000 7f0701800700 1 -- 172.21.15.80:0/718384992 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06fc1f8490 con 0x7f06fc15b9c0 2024-05-10T04:23:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.984+0000 7f0701800700 1 -- 172.21.15.80:0/718384992 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06fc074af0 con 0x7f06fc15b9c0 2024-05-10T04:23:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.985+0000 7f06f2a00700 1 -- 172.21.15.80:0/718384992 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f06f400ac60 con 0x7f06fc15b9c0 2024-05-10T04:23:41.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.985+0000 7f06f2a00700 1 --2- 172.21.15.80:0/718384992 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f06dc06ac90 0x7f06dc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:41.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.986+0000 7f06f2a00700 1 -- 172.21.15.80:0/718384992 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f06f4089250 con 0x7f06fc15b9c0 2024-05-10T04:23:41.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.986+0000 7f06faa00700 1 --2- 172.21.15.80:0/718384992 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f06dc06ac90 0x7f06dc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:41.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.986+0000 7f06faa00700 1 --2- 172.21.15.80:0/718384992 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f06dc06ac90 0x7f06dc06d1a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0090b0 tx=0x7f06ec008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:41.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:41.990+0000 7f06f2a00700 1 -- 172.21.15.80:0/718384992 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f06f4054350 con 0x7f06fc15b9c0 2024-05-10T04:23:42.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.245+0000 7f0701800700 1 -- 172.21.15.80:0/718384992 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f06fc14e270 con 0x7f06fc15b9c0 2024-05-10T04:23:42.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.683+0000 7f06f2a00700 1 -- 172.21.15.80:0/718384992 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f06fc14e270 con 0x7f06fc15b9c0 2024-05-10T04:23:42.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.685+0000 7f0701800700 1 -- 172.21.15.80:0/718384992 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f06dc06ac90 msgr2=0x7f06dc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:42.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.685+0000 7f0701800700 1 --2- 172.21.15.80:0/718384992 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f06dc06ac90 0x7f06dc06d1a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0090b0 tx=0x7f06ec008030 comp rx=0 tx=0).stop 2024-05-10T04:23:42.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.685+0000 7f0701800700 1 -- 172.21.15.80:0/718384992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06fc15b9c0 msgr2=0x7f06fc14e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:42.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.685+0000 7f0701800700 1 --2- 172.21.15.80:0/718384992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06fc15b9c0 0x7f06fc14e670 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f06f400cb80 tx=0x7f06f400ce90 comp rx=0 tx=0).stop 2024-05-10T04:23:42.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.686+0000 7f0701800700 1 -- 172.21.15.80:0/718384992 shutdown_connections 2024-05-10T04:23:42.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.686+0000 7f0701800700 1 --2- 172.21.15.80:0/718384992 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f06dc06ac90 0x7f06dc06d1a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:42.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.686+0000 7f0701800700 1 --2- 172.21.15.80:0/718384992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06fc15b9c0 0x7f06fc14e670 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:42.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.686+0000 7f0701800700 1 --2- 172.21.15.80:0/718384992 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06fc06e800 0x7f06fc14dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:42.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.686+0000 7f0701800700 1 --2- 172.21.15.80:0/718384992 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06fc0b47e0 0x7f06fc13f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:42.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.686+0000 7f0701800700 1 -- 172.21.15.80:0/718384992 >> 172.21.15.80:0/718384992 conn(0x7f06fc0b1830 msgr2=0x7f06fc15a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:42.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.686+0000 7f0701800700 1 -- 172.21.15.80:0/718384992 shutdown_connections 2024-05-10T04:23:42.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.686+0000 7f0701800700 1 -- 172.21.15.80:0/718384992 wait complete. 2024-05-10T04:23:42.713 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T04:23:42.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.976+0000 7f1def200700 1 Processor -- start 2024-05-10T04:23:42.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.976+0000 7f1def200700 1 -- start start 2024-05-10T04:23:42.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.978+0000 7f1def200700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1de815e6e0 0x7f1de806c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:42.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.978+0000 7f1def200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1de80b2b90 0x7f1de806c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:42.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.978+0000 7f1def200700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de80d34c0 con 0x7f1de80b3050 2024-05-10T04:23:42.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.978+0000 7f1def200700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de806d340 con 0x7f1de80b2b90 2024-05-10T04:23:42.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.978+0000 7f1def200700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de80d2b90 con 0x7f1de815e6e0 2024-05-10T04:23:42.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.978+0000 7f1ddfe00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1de80b2b90 0x7f1de806c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:42.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.979+0000 7f1ddfe00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1de80b2b90 0x7f1de806c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55466/0 (socket says 172.21.15.80:55466) 2024-05-10T04:23:42.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.979+0000 7f1ddfe00700 1 -- 172.21.15.80:0/1376258173 learned_addr learned my addr 172.21.15.80:0/1376258173 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:42.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.979+0000 7f1de7e00700 1 --2- 172.21.15.80:0/1376258173 >> v2:172.21.15.106:3300/0 conn(0x7f1de815e6e0 0x7f1de806c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:42.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.979+0000 7f1ddfe00700 1 -- 172.21.15.80:0/1376258173 >> v2:172.21.15.106:3300/0 conn(0x7f1de815e6e0 msgr2=0x7f1de806c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:42.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.979+0000 7f1ddfe00700 1 --2- 172.21.15.80:0/1376258173 >> v2:172.21.15.106:3300/0 conn(0x7f1de815e6e0 0x7f1de806c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:42.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.979+0000 7f1ddfe00700 1 -- 172.21.15.80:0/1376258173 >> v1:172.21.15.106:6789/0 conn(0x7f1de80b3050 legacy=0x7f1de80d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:42.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.979+0000 7f1ddfe00700 1 -- 172.21.15.80:0/1376258173 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de80d2e70 con 0x7f1de80b2b90 2024-05-10T04:23:42.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.979+0000 7f1ddfe00700 1 --2- 172.21.15.80:0/1376258173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1de80b2b90 0x7f1de806c730 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1de80d1680 tx=0x7f1dd0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fae65dc669c202 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:42.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.979+0000 7f1de7400700 1 -- 172.21.15.80:0/1376258173 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0011830 con 0x7f1de80b2b90 2024-05-10T04:23:42.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.980+0000 7f1de7400700 1 -- 172.21.15.80:0/1376258173 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd0011990 con 0x7f1de80b2b90 2024-05-10T04:23:42.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.980+0000 7f1de7400700 1 -- 172.21.15.80:0/1376258173 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0011d20 con 0x7f1de80b2b90 2024-05-10T04:23:42.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.980+0000 7f1def200700 1 -- 172.21.15.80:0/1376258173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1de80b2b90 msgr2=0x7f1de806c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:42.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.980+0000 7f1def200700 1 --2- 172.21.15.80:0/1376258173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1de80b2b90 0x7f1de806c730 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1de80d1680 tx=0x7f1dd0009bd0 comp rx=0 tx=0).stop 2024-05-10T04:23:42.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.980+0000 7f1def200700 1 -- 172.21.15.80:0/1376258173 shutdown_connections 2024-05-10T04:23:42.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.980+0000 7f1def200700 1 --2- 172.21.15.80:0/1376258173 >> v2:172.21.15.106:3300/0 conn(0x7f1de815e6e0 0x7f1de806c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:42.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.980+0000 7f1def200700 1 --2- 172.21.15.80:0/1376258173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1de80b2b90 0x7f1de806c730 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.980+0000 7f1def200700 1 -- 172.21.15.80:0/1376258173 >> 172.21.15.80:0/1376258173 conn(0x7f1de80b5db0 msgr2=0x7f1de80b61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.980+0000 7f1def200700 1 -- 172.21.15.80:0/1376258173 shutdown_connections 2024-05-10T04:23:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.980+0000 7f1def200700 1 -- 172.21.15.80:0/1376258173 wait complete. 2024-05-10T04:23:42.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.983+0000 7f1def200700 1 Processor -- start 2024-05-10T04:23:42.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.983+0000 7f1def200700 1 -- start start 2024-05-10T04:23:42.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.985+0000 7f1def200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1de80b2b90 0x7f1de81f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:42.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.985+0000 7f1def200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1de80b3050 0x7f1de8152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:42.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.985+0000 7f1def200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1de815e6e0 0x7f1de8145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:42.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.985+0000 7f1def200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de81465f0 con 0x7f1de80b3050 2024-05-10T04:23:42.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.985+0000 7f1def200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de81610c0 con 0x7f1de815e6e0 2024-05-10T04:23:42.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.985+0000 7f1def200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de81613a0 con 0x7f1de80b2b90 2024-05-10T04:23:42.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.985+0000 7f1ddfe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1de80b3050 0x7f1de8152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:42.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.985+0000 7f1ddfe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1de80b3050 0x7f1de8152940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55468/0 (socket says 172.21.15.80:55468) 2024-05-10T04:23:42.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.986+0000 7f1ddfe00700 1 -- 172.21.15.80:0/4126506300 learned_addr learned my addr 172.21.15.80:0/4126506300 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:42.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.986+0000 7f1de7e00700 1 --2- 172.21.15.80:0/4126506300 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1de80b2b90 0x7f1de81f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:42.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.986+0000 7f1ded200700 1 --2- 172.21.15.80:0/4126506300 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1de815e6e0 0x7f1de8145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:42.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.986+0000 7f1ddfe00700 1 -- 172.21.15.80:0/4126506300 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1de80b2b90 msgr2=0x7f1de81f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:42.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.986+0000 7f1ddfe00700 1 --2- 172.21.15.80:0/4126506300 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1de80b2b90 0x7f1de81f3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:42.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.986+0000 7f1ddfe00700 1 -- 172.21.15.80:0/4126506300 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1de815e6e0 msgr2=0x7f1de8145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:42.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.986+0000 7f1ddfe00700 1 --2- 172.21.15.80:0/4126506300 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1de815e6e0 0x7f1de8145a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:42.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.986+0000 7f1ddfe00700 1 -- 172.21.15.80:0/4126506300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd0009550 con 0x7f1de80b3050 2024-05-10T04:23:42.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.986+0000 7f1ddfe00700 1 --2- 172.21.15.80:0/4126506300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1de80b3050 0x7f1de8152940 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009c10 tx=0x7f1dd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:42.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.987+0000 7f1de4c00700 1 -- 172.21.15.80:0/4126506300 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0004510 con 0x7f1de80b3050 2024-05-10T04:23:42.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.987+0000 7f1de4c00700 1 -- 172.21.15.80:0/4126506300 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd001e070 con 0x7f1de80b3050 2024-05-10T04:23:42.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.987+0000 7f1def200700 1 -- 172.21.15.80:0/4126506300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de8151e60 con 0x7f1de80b3050 2024-05-10T04:23:42.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.987+0000 7f1de4c00700 1 -- 172.21.15.80:0/4126506300 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd00038e0 con 0x7f1de80b3050 2024-05-10T04:23:42.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.987+0000 7f1def200700 1 -- 172.21.15.80:0/4126506300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de8152420 con 0x7f1de80b3050 2024-05-10T04:23:42.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.988+0000 7f1def200700 1 -- 172.21.15.80:0/4126506300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de8152790 con 0x7f1de80b3050 2024-05-10T04:23:42.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.989+0000 7f1de4c00700 1 -- 172.21.15.80:0/4126506300 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1dd0003a40 con 0x7f1de80b3050 2024-05-10T04:23:42.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.990+0000 7f1de4c00700 1 --2- 172.21.15.80:0/4126506300 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1dc406ac90 0x7f1dc406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:42.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.990+0000 7f1de4c00700 1 -- 172.21.15.80:0/4126506300 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f1dd008a250 con 0x7f1de80b3050 2024-05-10T04:23:42.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.990+0000 7f1de7e00700 1 --2- 172.21.15.80:0/4126506300 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1dc406ac90 0x7f1dc406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:42.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.991+0000 7f1de7e00700 1 --2- 172.21.15.80:0/4126506300 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1dc406ac90 0x7f1dc406d1a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8009b40 tx=0x7f1dd8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:42.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:42.994+0000 7f1de4c00700 1 -- 172.21.15.80:0/4126506300 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1dd0055350 con 0x7f1de80b3050 2024-05-10T04:23:43.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:43.201+0000 7f1def200700 1 -- 172.21.15.80:0/4126506300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1de80732b0 con 0x7f1de80b3050 2024-05-10T04:23:44.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.203+0000 7f1de4c00700 1 -- 172.21.15.80:0/4126506300 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1dd0058970 con 0x7f1de80b3050 2024-05-10T04:23:44.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.208+0000 7f1def200700 1 -- 172.21.15.80:0/4126506300 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1dc406ac90 msgr2=0x7f1dc406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:44.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.208+0000 7f1def200700 1 --2- 172.21.15.80:0/4126506300 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1dc406ac90 0x7f1dc406d1a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8009b40 tx=0x7f1dd8009210 comp rx=0 tx=0).stop 2024-05-10T04:23:44.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.208+0000 7f1def200700 1 -- 172.21.15.80:0/4126506300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1de80b3050 msgr2=0x7f1de8152940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:44.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.208+0000 7f1def200700 1 --2- 172.21.15.80:0/4126506300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1de80b3050 0x7f1de8152940 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009c10 tx=0x7f1dd0004750 comp rx=0 tx=0).stop 2024-05-10T04:23:44.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.208+0000 7f1def200700 1 -- 172.21.15.80:0/4126506300 shutdown_connections 2024-05-10T04:23:44.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.208+0000 7f1def200700 1 --2- 172.21.15.80:0/4126506300 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1dc406ac90 0x7f1dc406d1a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:44.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.208+0000 7f1def200700 1 --2- 172.21.15.80:0/4126506300 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1de815e6e0 0x7f1de8145a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:44.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.208+0000 7f1def200700 1 --2- 172.21.15.80:0/4126506300 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1de80b2b90 0x7f1de81f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:44.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.208+0000 7f1def200700 1 --2- 172.21.15.80:0/4126506300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1de80b3050 0x7f1de8152940 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:44.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.208+0000 7f1def200700 1 -- 172.21.15.80:0/4126506300 >> 172.21.15.80:0/4126506300 conn(0x7f1de80b5db0 msgr2=0x7f1de80d1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:44.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.208+0000 7f1def200700 1 -- 172.21.15.80:0/4126506300 shutdown_connections 2024-05-10T04:23:44.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.208+0000 7f1def200700 1 -- 172.21.15.80:0/4126506300 wait complete. 2024-05-10T04:23:44.211 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2024-05-10T04:23:44.238 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T04:23:44.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.504+0000 7fbc81c00700 1 Processor -- start 2024-05-10T04:23:44.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.504+0000 7fbc81c00700 1 -- start start 2024-05-10T04:23:44.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.505+0000 7fbc81c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbc7c0b33e0 0x7fbc7c0d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:44.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.506+0000 7fbc81c00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbc7c162090 0x7fbc7c1624a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:44.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.506+0000 7fbc81c00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7c162d80 con 0x7fbc7c0b5970 2024-05-10T04:23:44.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.506+0000 7fbc81c00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7c0b37f0 con 0x7fbc7c162090 2024-05-10T04:23:44.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.506+0000 7fbc81c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0d2970 con 0x7fbc7c0b33e0 2024-05-10T04:23:44.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.506+0000 7fbc7b400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbc7c162090 0x7fbc7c1624a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:44.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.506+0000 7fbc7b400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbc7c162090 0x7fbc7c1624a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55476/0 (socket says 172.21.15.80:55476) 2024-05-10T04:23:44.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.506+0000 7fbc7b400700 1 -- 172.21.15.80:0/2957387756 learned_addr learned my addr 172.21.15.80:0/2957387756 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:44.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.506+0000 7fbc7aa00700 1 --2- 172.21.15.80:0/2957387756 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbc7c0b33e0 0x7fbc7c0d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:44.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.506+0000 7fbc7b400700 1 -- 172.21.15.80:0/2957387756 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbc7c0b33e0 msgr2=0x7fbc7c0d3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:44.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.506+0000 7fbc7b400700 1 --2- 172.21.15.80:0/2957387756 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbc7c0b33e0 0x7fbc7c0d3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:44.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.506+0000 7fbc7b400700 1 -- 172.21.15.80:0/2957387756 >> v1:172.21.15.106:6789/0 conn(0x7fbc7c0b5970 legacy=0x7fbc7c0b5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:44.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.506+0000 7fbc7b400700 1 -- 172.21.15.80:0/2957387756 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c0d2c50 con 0x7fbc7c162090 2024-05-10T04:23:44.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.507+0000 7fbc7b400700 1 --2- 172.21.15.80:0/2957387756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc7c162090 0x7fbc7c1624a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009e50 tx=0x7fbc7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89047a7565f7de8e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:44.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.507+0000 7fbc79600700 1 -- 172.21.15.80:0/2957387756 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400e070 con 0x7fbc7c162090 2024-05-10T04:23:44.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.507+0000 7fbc79600700 1 -- 172.21.15.80:0/2957387756 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7400b910 con 0x7fbc7c162090 2024-05-10T04:23:44.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.507+0000 7fbc79600700 1 -- 172.21.15.80:0/2957387756 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400bcc0 con 0x7fbc7c162090 2024-05-10T04:23:44.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.508+0000 7fbc81c00700 1 -- 172.21.15.80:0/2957387756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc7c162090 msgr2=0x7fbc7c1624a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:44.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.508+0000 7fbc81c00700 1 --2- 172.21.15.80:0/2957387756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc7c162090 0x7fbc7c1624a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009e50 tx=0x7fbc7400b330 comp rx=0 tx=0).stop 2024-05-10T04:23:44.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.508+0000 7fbc81c00700 1 -- 172.21.15.80:0/2957387756 shutdown_connections 2024-05-10T04:23:44.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.508+0000 7fbc81c00700 1 --2- 172.21.15.80:0/2957387756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc7c162090 0x7fbc7c1624a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:44.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.508+0000 7fbc81c00700 1 --2- 172.21.15.80:0/2957387756 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbc7c0b33e0 0x7fbc7c0d3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:44.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.508+0000 7fbc81c00700 1 -- 172.21.15.80:0/2957387756 >> 172.21.15.80:0/2957387756 conn(0x7fbc7c0d0b50 msgr2=0x7fbc7c0d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:44.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.508+0000 7fbc81c00700 1 -- 172.21.15.80:0/2957387756 shutdown_connections 2024-05-10T04:23:44.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.508+0000 7fbc81c00700 1 -- 172.21.15.80:0/2957387756 wait complete. 2024-05-10T04:23:44.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.510+0000 7fbc81c00700 1 Processor -- start 2024-05-10T04:23:44.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.510+0000 7fbc81c00700 1 -- start start 2024-05-10T04:23:44.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.512+0000 7fbc81c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc7c0b33e0 0x7fbc7c0aa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:44.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.512+0000 7fbc81c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbc7c0b5970 0x7fbc7c1f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:44.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.512+0000 7fbc81c00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc7c162090 0x7fbc7c15d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:44.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.512+0000 7fbc81c00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c159be0 con 0x7fbc7c0b33e0 2024-05-10T04:23:44.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.512+0000 7fbc81c00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0aae20 con 0x7fbc7c162090 2024-05-10T04:23:44.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.512+0000 7fbc81c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c158f60 con 0x7fbc7c0b5970 2024-05-10T04:23:44.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.512+0000 7fbc7aa00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc7c0b33e0 0x7fbc7c0aa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:44.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.512+0000 7fbc7aa00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc7c0b33e0 0x7fbc7c0aa8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55488/0 (socket says 172.21.15.80:55488) 2024-05-10T04:23:44.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.512+0000 7fbc7aa00700 1 -- 172.21.15.80:0/1967884798 learned_addr learned my addr 172.21.15.80:0/1967884798 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:44.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.512+0000 7fbc7aa00700 1 -- 172.21.15.80:0/1967884798 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbc7c0b5970 msgr2=0x7fbc7c1f7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:44.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.512+0000 7fbc7aa00700 1 --2- 172.21.15.80:0/1967884798 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbc7c0b5970 0x7fbc7c1f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:44.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.512+0000 7fbc7aa00700 1 -- 172.21.15.80:0/1967884798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc7c162090 msgr2=0x7fbc7c15d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:44.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.512+0000 7fbc7aa00700 1 --2- 172.21.15.80:0/1967884798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc7c162090 0x7fbc7c15d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:44.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.512+0000 7fbc7aa00700 1 -- 172.21.15.80:0/1967884798 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc74009b30 con 0x7fbc7c0b33e0 2024-05-10T04:23:44.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.513+0000 7fbc7aa00700 1 --2- 172.21.15.80:0/1967884798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc7c0b33e0 0x7fbc7c0aa8e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00e8a0 tx=0x7fbc6c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:44.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.513+0000 7fbc72a00700 1 -- 172.21.15.80:0/1967884798 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00ee40 con 0x7fbc7c0b33e0 2024-05-10T04:23:44.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.513+0000 7fbc72a00700 1 -- 172.21.15.80:0/1967884798 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c00c7f0 con 0x7fbc7c0b33e0 2024-05-10T04:23:44.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.513+0000 7fbc72a00700 1 -- 172.21.15.80:0/1967884798 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00cb60 con 0x7fbc7c0b33e0 2024-05-10T04:23:44.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.513+0000 7fbc81c00700 1 -- 172.21.15.80:0/1967884798 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7c159240 con 0x7fbc7c0b33e0 2024-05-10T04:23:44.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.513+0000 7fbc81c00700 1 -- 172.21.15.80:0/1967884798 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7c159800 con 0x7fbc7c0b33e0 2024-05-10T04:23:44.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.514+0000 7fbc81c00700 1 -- 172.21.15.80:0/1967884798 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7c0732b0 con 0x7fbc7c0b33e0 2024-05-10T04:23:44.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.515+0000 7fbc72a00700 1 -- 172.21.15.80:0/1967884798 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbc6c00ccc0 con 0x7fbc7c0b33e0 2024-05-10T04:23:44.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.516+0000 7fbc72a00700 1 --2- 172.21.15.80:0/1967884798 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fbc5c06ac90 0x7fbc5c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:44.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.516+0000 7fbc72a00700 1 -- 172.21.15.80:0/1967884798 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5473+0+0 (secure 0 0 0) 0x7fbc6c089180 con 0x7fbc7c0b33e0 2024-05-10T04:23:44.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.516+0000 7fbc7a000700 1 --2- 172.21.15.80:0/1967884798 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fbc5c06ac90 0x7fbc5c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:44.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.517+0000 7fbc7a000700 1 --2- 172.21.15.80:0/1967884798 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fbc5c06ac90 0x7fbc5c06d1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c146350 tx=0x7fbc680079e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:44.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.521+0000 7fbc72a00700 1 -- 172.21.15.80:0/1967884798 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbc6c054430 con 0x7fbc7c0b33e0 2024-05-10T04:23:44.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:44.722+0000 7fbc81c00700 1 -- 172.21.15.80:0/1967884798 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbc7c159d20 con 0x7fbc7c0b33e0 2024-05-10T04:23:45.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.218+0000 7fbc72a00700 1 -- 172.21.15.80:0/1967884798 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbc7c159d20 con 0x7fbc7c0b33e0 2024-05-10T04:23:45.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.222+0000 7fbc81c00700 1 -- 172.21.15.80:0/1967884798 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fbc5c06ac90 msgr2=0x7fbc5c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:45.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.222+0000 7fbc81c00700 1 --2- 172.21.15.80:0/1967884798 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fbc5c06ac90 0x7fbc5c06d1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c146350 tx=0x7fbc680079e0 comp rx=0 tx=0).stop 2024-05-10T04:23:45.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.222+0000 7fbc81c00700 1 -- 172.21.15.80:0/1967884798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc7c0b33e0 msgr2=0x7fbc7c0aa8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:45.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.222+0000 7fbc81c00700 1 --2- 172.21.15.80:0/1967884798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc7c0b33e0 0x7fbc7c0aa8e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00e8a0 tx=0x7fbc6c00ec60 comp rx=0 tx=0).stop 2024-05-10T04:23:45.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.223+0000 7fbc81c00700 1 -- 172.21.15.80:0/1967884798 shutdown_connections 2024-05-10T04:23:45.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.223+0000 7fbc81c00700 1 --2- 172.21.15.80:0/1967884798 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fbc5c06ac90 0x7fbc5c06d1a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:45.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.223+0000 7fbc81c00700 1 --2- 172.21.15.80:0/1967884798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc7c0b33e0 0x7fbc7c0aa8e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:45.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.223+0000 7fbc81c00700 1 --2- 172.21.15.80:0/1967884798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc7c162090 0x7fbc7c15d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:45.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.223+0000 7fbc81c00700 1 --2- 172.21.15.80:0/1967884798 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbc7c0b5970 0x7fbc7c1f7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:45.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.223+0000 7fbc81c00700 1 -- 172.21.15.80:0/1967884798 >> 172.21.15.80:0/1967884798 conn(0x7fbc7c0d0b50 msgr2=0x7fbc7c0b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:45.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.223+0000 7fbc81c00700 1 -- 172.21.15.80:0/1967884798 shutdown_connections 2024-05-10T04:23:45.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.223+0000 7fbc81c00700 1 -- 172.21.15.80:0/1967884798 wait complete. 2024-05-10T04:23:45.226 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2024-05-10T04:23:45.256 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T04:23:45.256 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-10T04:23:45.257 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T04:23:45.257 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:23:45.257 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T04:23:45.257 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-10T04:23:45.257 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T04:23:45.257 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:23:45.257 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T04:23:45.257 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-10T04:23:45.258 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T04:23:45.258 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:23:45.258 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T04:23:45.258 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-10T04:23:45.258 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T04:23:45.258 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:23:45.283 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T04:23:45.283 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T04:23:45.284 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T04:23:45.284 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T04:23:45.285 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T04:23:45.285 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T04:23:45.286 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T04:23:45.286 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T04:23:45.328 INFO:tasks.ceph.mds.a:Started 2024-05-10T04:23:45.328 DEBUG:teuthology.parallel:result is None 2024-05-10T04:23:45.331 INFO:tasks.ceph.mds.c:Started 2024-05-10T04:23:45.331 DEBUG:teuthology.parallel:result is None 2024-05-10T04:23:45.332 INFO:tasks.ceph.mds.d:Started 2024-05-10T04:23:45.332 DEBUG:teuthology.parallel:result is None 2024-05-10T04:23:45.334 INFO:tasks.ceph.mds.b:Started 2024-05-10T04:23:45.334 DEBUG:teuthology.parallel:result is None 2024-05-10T04:23:45.335 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-10T04:23:45.542 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2024-05-10T04:23:45.543 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-05-10T04:23:45.547 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2024-05-10T04:23:45.548 INFO:tasks.ceph.mds.d.smithi106.stdout:starting mds.d at 2024-05-10T04:23:45.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.614+0000 7f74f1600700 1 Processor -- start 2024-05-10T04:23:45.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.614+0000 7f74f1600700 1 -- start start 2024-05-10T04:23:45.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.616+0000 7f74f1600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74ec15a760 0x7f74ec071c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:45.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.616+0000 7f74f1600700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ec15eea0 con 0x7f74ec0aedc0 2024-05-10T04:23:45.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.616+0000 7f74f1600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ec15f180 con 0x7f74ec0ae870 2024-05-10T04:23:45.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.616+0000 7f74f1600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0cf600 con 0x7f74ec15a760 2024-05-10T04:23:45.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.616+0000 7f74eb400700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f74ec0aedc0 0x7f74ec0ce1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34320/0 (socket says 172.21.15.80:34320) 2024-05-10T04:23:45.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.616+0000 7f74eb400700 1 -- 172.21.15.80:0/2471825355 learned_addr learned my addr 172.21.15.80:0/2471825355 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:45.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.617+0000 7f74f0c00700 1 --2- 172.21.15.80:0/2471825355 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74ec15a760 0x7f74ec071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:45.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.617+0000 7f74eaa00700 1 -- 172.21.15.80:0/2471825355 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627264993 0 0) 0x7f74ec15eea0 con 0x7f74ec0aedc0 2024-05-10T04:23:45.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.617+0000 7f74eaa00700 1 -- 172.21.15.80:0/2471825355 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74d00034d0 con 0x7f74ec0aedc0 2024-05-10T04:23:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.617+0000 7f74eaa00700 1 -- 172.21.15.80:0/2471825355 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558243398 0 0) 0x7f74ec15f180 con 0x7f74ec0ae870 2024-05-10T04:23:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.617+0000 7f74eaa00700 1 -- 172.21.15.80:0/2471825355 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74ec15eea0 con 0x7f74ec0ae870 2024-05-10T04:23:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.617+0000 7f74f0c00700 1 -- 172.21.15.80:0/2471825355 >> v1:172.21.15.106:6789/0 conn(0x7f74ec0ae870 legacy=0x7f74ec0b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.617+0000 7f74f0c00700 1 -- 172.21.15.80:0/2471825355 >> v1:172.21.15.80:6789/0 conn(0x7f74ec0aedc0 legacy=0x7f74ec0ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.617+0000 7f74f0c00700 1 -- 172.21.15.80:0/2471825355 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec0cd9f0 con 0x7f74ec15a760 2024-05-10T04:23:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.617+0000 7f74f0c00700 1 --2- 172.21.15.80:0/2471825355 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74ec15a760 0x7f74ec071c70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009dc0 tx=0x7f74e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14a0ab11adfc0004 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.618+0000 7f74eaa00700 1 -- 172.21.15.80:0/2471825355 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e400e070 con 0x7f74ec15a760 2024-05-10T04:23:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.618+0000 7f74eaa00700 1 -- 172.21.15.80:0/2471825355 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e400bb20 con 0x7f74ec15a760 2024-05-10T04:23:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.618+0000 7f74eaa00700 1 -- 172.21.15.80:0/2471825355 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4012430 con 0x7f74ec15a760 2024-05-10T04:23:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.618+0000 7f74f1600700 1 -- 172.21.15.80:0/2471825355 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74ec15a760 msgr2=0x7f74ec071c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.618+0000 7f74f1600700 1 --2- 172.21.15.80:0/2471825355 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74ec15a760 0x7f74ec071c70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009dc0 tx=0x7f74e400b330 comp rx=0 tx=0).stop 2024-05-10T04:23:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.618+0000 7f74f1600700 1 -- 172.21.15.80:0/2471825355 shutdown_connections 2024-05-10T04:23:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.618+0000 7f74f1600700 1 --2- 172.21.15.80:0/2471825355 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74ec15a760 0x7f74ec071c70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.618+0000 7f74f1600700 1 -- 172.21.15.80:0/2471825355 >> 172.21.15.80:0/2471825355 conn(0x7f74ec0cf800 msgr2=0x7f74ec0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:45.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.618+0000 7f74f1600700 1 -- 172.21.15.80:0/2471825355 shutdown_connections 2024-05-10T04:23:45.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.619+0000 7f74f1600700 1 -- 172.21.15.80:0/2471825355 wait complete. 2024-05-10T04:23:45.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.621+0000 7f74f1600700 1 Processor -- start 2024-05-10T04:23:45.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.621+0000 7f74f1600700 1 -- start start 2024-05-10T04:23:45.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.622+0000 7f74f1600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74ec0ae870 0x7f74ec1f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:45.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.622+0000 7f74f1600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74ec0aedc0 0x7f74ec1f38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:45.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.622+0000 7f74f1600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec15a760 0x7f74ec06d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:45.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.622+0000 7f74f1600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec149b30 con 0x7f74ec15a760 2024-05-10T04:23:45.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.622+0000 7f74f1600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec146e00 con 0x7f74ec0aedc0 2024-05-10T04:23:45.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.622+0000 7f74f1600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec148cd0 con 0x7f74ec0ae870 2024-05-10T04:23:45.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.623+0000 7f74f0c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec15a760 0x7f74ec06d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:45.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.623+0000 7f74ebe00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74ec0ae870 0x7f74ec1f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:45.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.623+0000 7f74f0c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec15a760 0x7f74ec06d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55542/0 (socket says 172.21.15.80:55542) 2024-05-10T04:23:45.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.623+0000 7f74f0c00700 1 -- 172.21.15.80:0/565683150 learned_addr learned my addr 172.21.15.80:0/565683150 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:45.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.623+0000 7f74eb400700 1 --2- 172.21.15.80:0/565683150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74ec0aedc0 0x7f74ec1f38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:45.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.623+0000 7f74f0c00700 1 -- 172.21.15.80:0/565683150 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74ec0ae870 msgr2=0x7f74ec1f7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:45.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.623+0000 7f74f0c00700 1 --2- 172.21.15.80:0/565683150 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74ec0ae870 0x7f74ec1f7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:45.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.623+0000 7f74f0c00700 1 -- 172.21.15.80:0/565683150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74ec0aedc0 msgr2=0x7f74ec1f38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:45.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.623+0000 7f74f0c00700 1 --2- 172.21.15.80:0/565683150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74ec0aedc0 0x7f74ec1f38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:45.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.623+0000 7f74f0c00700 1 -- 172.21.15.80:0/565683150 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e4009a70 con 0x7f74ec15a760 2024-05-10T04:23:45.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.623+0000 7f74ebe00700 1 --2- 172.21.15.80:0/565683150 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74ec0ae870 0x7f74ec1f7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:23:45.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.623+0000 7f74f0c00700 1 --2- 172.21.15.80:0/565683150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec15a760 0x7f74ec06d500 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f74e4014040 tx=0x7f74e4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:45.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.624+0000 7f74e3e00700 1 -- 172.21.15.80:0/565683150 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4012430 con 0x7f74ec15a760 2024-05-10T04:23:45.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.624+0000 7f74e3e00700 1 -- 172.21.15.80:0/565683150 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e4020070 con 0x7f74ec15a760 2024-05-10T04:23:45.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.624+0000 7f74f1600700 1 -- 172.21.15.80:0/565683150 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec1f8530 con 0x7f74ec15a760 2024-05-10T04:23:45.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.624+0000 7f74e3e00700 1 -- 172.21.15.80:0/565683150 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e401ca50 con 0x7f74ec15a760 2024-05-10T04:23:45.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.624+0000 7f74f1600700 1 -- 172.21.15.80:0/565683150 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ec149200 con 0x7f74ec15a760 2024-05-10T04:23:45.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.625+0000 7f74f1600700 1 -- 172.21.15.80:0/565683150 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ec148b40 con 0x7f74ec15a760 2024-05-10T04:23:45.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.626+0000 7f74e3e00700 1 -- 172.21.15.80:0/565683150 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f74e401cbb0 con 0x7f74ec15a760 2024-05-10T04:23:45.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.627+0000 7f74e3e00700 1 --2- 172.21.15.80:0/565683150 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f74cc06acc0 0x7f74cc06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:45.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.627+0000 7f74e3e00700 1 -- 172.21.15.80:0/565683150 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f74e4022070 con 0x7f74ec15a760 2024-05-10T04:23:45.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.627+0000 7f74ebe00700 1 --2- 172.21.15.80:0/565683150 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f74cc06acc0 0x7f74cc06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:45.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.628+0000 7f74ebe00700 1 --2- 172.21.15.80:0/565683150 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f74cc06acc0 0x7f74cc06d1d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f74dc001220 tx=0x7f74dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:45.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.631+0000 7f74e3e00700 1 -- 172.21.15.80:0/565683150 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f74e4056810 con 0x7f74ec15a760 2024-05-10T04:23:45.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:45.850+0000 7f74f1600700 1 -- 172.21.15.80:0/565683150 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f74ec074af0 con 0x7f74ec15a760 2024-05-10T04:23:46.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.586+0000 7f74e3e00700 1 -- 172.21.15.80:0/565683150 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f74e401ce60 con 0x7f74ec15a760 2024-05-10T04:23:46.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.589+0000 7f74f1600700 1 -- 172.21.15.80:0/565683150 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f74cc06acc0 msgr2=0x7f74cc06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:46.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.589+0000 7f74f1600700 1 --2- 172.21.15.80:0/565683150 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f74cc06acc0 0x7f74cc06d1d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f74dc001220 tx=0x7f74dc009040 comp rx=0 tx=0).stop 2024-05-10T04:23:46.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.589+0000 7f74f1600700 1 -- 172.21.15.80:0/565683150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec15a760 msgr2=0x7f74ec06d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:46.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.589+0000 7f74f1600700 1 --2- 172.21.15.80:0/565683150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec15a760 0x7f74ec06d500 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f74e4014040 tx=0x7f74e4004ad0 comp rx=0 tx=0).stop 2024-05-10T04:23:46.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.589+0000 7f74f1600700 1 -- 172.21.15.80:0/565683150 shutdown_connections 2024-05-10T04:23:46.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.589+0000 7f74f1600700 1 --2- 172.21.15.80:0/565683150 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f74cc06acc0 0x7f74cc06d1d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:46.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.589+0000 7f74f1600700 1 --2- 172.21.15.80:0/565683150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec15a760 0x7f74ec06d500 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:46.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.589+0000 7f74f1600700 1 --2- 172.21.15.80:0/565683150 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74ec0ae870 0x7f74ec1f7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:46.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.589+0000 7f74f1600700 1 --2- 172.21.15.80:0/565683150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74ec0aedc0 0x7f74ec1f38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:46.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.589+0000 7f74f1600700 1 -- 172.21.15.80:0/565683150 >> 172.21.15.80:0/565683150 conn(0x7f74ec0cf800 msgr2=0x7f74ec153c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:46.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.589+0000 7f74f1600700 1 -- 172.21.15.80:0/565683150 shutdown_connections 2024-05-10T04:23:46.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.589+0000 7f74f1600700 1 -- 172.21.15.80:0/565683150 wait complete. 2024-05-10T04:23:46.592 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blocklist entries 2024-05-10T04:23:46.617 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-10T04:23:46.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.881+0000 7ffbdbc00700 1 Processor -- start 2024-05-10T04:23:46.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.881+0000 7ffbdbc00700 1 -- start start 2024-05-10T04:23:46.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.883+0000 7ffbdbc00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffbd40d3460 0x7ffbd40b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:46.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.883+0000 7ffbdbc00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffbd40b58b0 0x7ffbd40b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:46.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.883+0000 7ffbdbc00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd40d2730 con 0x7ffbd41620e0 2024-05-10T04:23:46.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.883+0000 7ffbdbc00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd40b3720 con 0x7ffbd40d3460 2024-05-10T04:23:46.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.883+0000 7ffbdbc00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd4162c00 con 0x7ffbd40b58b0 2024-05-10T04:23:46.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.883+0000 7ffbd9c00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ffbd41620e0 0x7ffbd41624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34332/0 (socket says 172.21.15.80:34332) 2024-05-10T04:23:46.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.883+0000 7ffbd9c00700 1 -- 172.21.15.80:0/4005166104 learned_addr learned my addr 172.21.15.80:0/4005166104 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:46.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.883+0000 7ffbd9200700 1 --2- 172.21.15.80:0/4005166104 >> v2:172.21.15.80:3300/0 conn(0x7ffbd40d3460 0x7ffbd40b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:46.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.883+0000 7ffbd3400700 1 -- 172.21.15.80:0/4005166104 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405272939 0 0) 0x7ffbd40d2730 con 0x7ffbd41620e0 2024-05-10T04:23:46.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.883+0000 7ffbd3e00700 1 --2- 172.21.15.80:0/4005166104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffbd40b58b0 0x7ffbd40b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:46.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.883+0000 7ffbd3400700 1 -- 172.21.15.80:0/4005166104 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbbc0035b0 con 0x7ffbd41620e0 2024-05-10T04:23:46.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.883+0000 7ffbd9200700 1 -- 172.21.15.80:0/4005166104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffbd40b58b0 msgr2=0x7ffbd40b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:46.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.884+0000 7ffbd9200700 1 --2- 172.21.15.80:0/4005166104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffbd40b58b0 0x7ffbd40b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:46.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.884+0000 7ffbd9200700 1 -- 172.21.15.80:0/4005166104 >> v1:172.21.15.80:6789/0 conn(0x7ffbd41620e0 legacy=0x7ffbd41624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:46.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.884+0000 7ffbd9200700 1 -- 172.21.15.80:0/4005166104 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd40d2fd0 con 0x7ffbd40d3460 2024-05-10T04:23:46.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.884+0000 7ffbd9200700 1 --2- 172.21.15.80:0/4005166104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbd40d3460 0x7ffbd40b31e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009870 tx=0x7ffbc8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4149c273a03522 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:46.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.884+0000 7ffbd3400700 1 -- 172.21.15.80:0/4005166104 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8011830 con 0x7ffbd40d3460 2024-05-10T04:23:46.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.884+0000 7ffbd3400700 1 -- 172.21.15.80:0/4005166104 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc8011990 con 0x7ffbd40d3460 2024-05-10T04:23:46.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.884+0000 7ffbd3400700 1 -- 172.21.15.80:0/4005166104 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8011d20 con 0x7ffbd40d3460 2024-05-10T04:23:46.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.885+0000 7ffbdbc00700 1 -- 172.21.15.80:0/4005166104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbd40d3460 msgr2=0x7ffbd40b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:46.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.885+0000 7ffbdbc00700 1 --2- 172.21.15.80:0/4005166104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbd40d3460 0x7ffbd40b31e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009870 tx=0x7ffbc8009b80 comp rx=0 tx=0).stop 2024-05-10T04:23:46.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.885+0000 7ffbdbc00700 1 -- 172.21.15.80:0/4005166104 shutdown_connections 2024-05-10T04:23:46.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.885+0000 7ffbdbc00700 1 --2- 172.21.15.80:0/4005166104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbd40d3460 0x7ffbd40b31e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:46.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.885+0000 7ffbdbc00700 1 --2- 172.21.15.80:0/4005166104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffbd40b58b0 0x7ffbd40b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:46.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.885+0000 7ffbdbc00700 1 -- 172.21.15.80:0/4005166104 >> 172.21.15.80:0/4005166104 conn(0x7ffbd40d0a90 msgr2=0x7ffbd40d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:46.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.885+0000 7ffbdbc00700 1 -- 172.21.15.80:0/4005166104 shutdown_connections 2024-05-10T04:23:46.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.885+0000 7ffbdbc00700 1 -- 172.21.15.80:0/4005166104 wait complete. 2024-05-10T04:23:46.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.887+0000 7ffbdbc00700 1 Processor -- start 2024-05-10T04:23:46.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.887+0000 7ffbdbc00700 1 -- start start 2024-05-10T04:23:46.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.889+0000 7ffbdbc00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbd40b58b0 0x7ffbd40c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:46.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.889+0000 7ffbdbc00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbd40d3460 0x7ffbd40cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:46.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.889+0000 7ffbdbc00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffbd41620e0 0x7ffbd4151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:46.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.889+0000 7ffbdbc00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40c9410 con 0x7ffbd40d3460 2024-05-10T04:23:46.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.889+0000 7ffbdbc00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd41f4360 con 0x7ffbd40b58b0 2024-05-10T04:23:46.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.889+0000 7ffbdbc00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40cde80 con 0x7ffbd41620e0 2024-05-10T04:23:46.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.889+0000 7ffbd3e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbd40d3460 0x7ffbd40cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.889+0000 7ffbd3e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbd40d3460 0x7ffbd40cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55556/0 (socket says 172.21.15.80:55556) 2024-05-10T04:23:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.889+0000 7ffbd3e00700 1 -- 172.21.15.80:0/313290843 learned_addr learned my addr 172.21.15.80:0/313290843 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.889+0000 7ffbd9200700 1 --2- 172.21.15.80:0/313290843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbd40b58b0 0x7ffbd40c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.889+0000 7ffbd9c00700 1 --2- 172.21.15.80:0/313290843 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffbd41620e0 0x7ffbd4151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.889+0000 7ffbd3e00700 1 -- 172.21.15.80:0/313290843 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffbd41620e0 msgr2=0x7ffbd4151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.889+0000 7ffbd3e00700 1 --2- 172.21.15.80:0/313290843 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffbd41620e0 0x7ffbd4151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.889+0000 7ffbd3e00700 1 -- 172.21.15.80:0/313290843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbd40b58b0 msgr2=0x7ffbd40c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.889+0000 7ffbd3e00700 1 --2- 172.21.15.80:0/313290843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbd40b58b0 0x7ffbd40c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.889+0000 7ffbd3e00700 1 -- 172.21.15.80:0/313290843 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc80094a0 con 0x7ffbd40d3460 2024-05-10T04:23:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.890+0000 7ffbd3e00700 1 --2- 172.21.15.80:0/313290843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbd40d3460 0x7ffbd40cd940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffbc000d830 tx=0x7ffbc000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.890+0000 7ffbd0c00700 1 -- 172.21.15.80:0/313290843 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc00125f0 con 0x7ffbd40d3460 2024-05-10T04:23:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.890+0000 7ffbd0c00700 1 -- 172.21.15.80:0/313290843 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc0012750 con 0x7ffbd40d3460 2024-05-10T04:23:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.890+0000 7ffbd0c00700 1 -- 172.21.15.80:0/313290843 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0012b00 con 0x7ffbd40d3460 2024-05-10T04:23:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.890+0000 7ffbdbc00700 1 -- 172.21.15.80:0/313290843 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd41f4e50 con 0x7ffbd40d3460 2024-05-10T04:23:46.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.890+0000 7ffbdbc00700 1 -- 172.21.15.80:0/313290843 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd41f4890 con 0x7ffbd40d3460 2024-05-10T04:23:46.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.891+0000 7ffbdbc00700 1 -- 172.21.15.80:0/313290843 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd40c7d50 con 0x7ffbd40d3460 2024-05-10T04:23:46.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.892+0000 7ffbd0c00700 1 -- 172.21.15.80:0/313290843 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffbc0012c60 con 0x7ffbd40d3460 2024-05-10T04:23:46.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.893+0000 7ffbd0c00700 1 --2- 172.21.15.80:0/313290843 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ffbb406ac90 0x7ffbb406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:46.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.893+0000 7ffbd0c00700 1 -- 172.21.15.80:0/313290843 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffbc00894e0 con 0x7ffbd40d3460 2024-05-10T04:23:46.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.893+0000 7ffbd9200700 1 --2- 172.21.15.80:0/313290843 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ffbb406ac90 0x7ffbb406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:46.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.894+0000 7ffbd9200700 1 --2- 172.21.15.80:0/313290843 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ffbb406ac90 0x7ffbb406d1a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80090b0 tx=0x7ffbc801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:46.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:46.898+0000 7ffbd0c00700 1 -- 172.21.15.80:0/313290843 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ffbc00548e0 con 0x7ffbd40d3460 2024-05-10T04:23:47.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.181+0000 7ffbdbc00700 1 -- 172.21.15.80:0/313290843 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ffbd40732b0 con 0x7ffbd40d3460 2024-05-10T04:23:47.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.182+0000 7ffbd0c00700 1 -- 172.21.15.80:0/313290843 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7ffbc0057f00 con 0x7ffbd40d3460 2024-05-10T04:23:47.183 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:47.183 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-10T04:23:47.183 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2024-05-10T04:23:47.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.184 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2024-05-10T04:23:47.184 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDGoD1m34zmKxAAUCHW2XaT2Q45OSlRqUCxDg==", 2024-05-10T04:23:47.184 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.184 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-05-10T04:23:47.184 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-05-10T04:23:47.184 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-05-10T04:23:47.184 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-05-10T04:23:47.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.184 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2024-05-10T04:23:47.184 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDHoD1mcwHnDxAAENHJrQ6P8FLrtp/ubn2LdQ==", 2024-05-10T04:23:47.184 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.184 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-05-10T04:23:47.185 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-05-10T04:23:47.185 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-05-10T04:23:47.185 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-05-10T04:23:47.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.185 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2024-05-10T04:23:47.185 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDGoD1mEYCPOxAAVc7+qVTvMPc+qABqLNr8hw==", 2024-05-10T04:23:47.185 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.185 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-05-10T04:23:47.185 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-05-10T04:23:47.185 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-05-10T04:23:47.185 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-05-10T04:23:47.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.186 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.d", 2024-05-10T04:23:47.186 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDHoD1mcR+BHxAArW9grhTXRDMy1J+CCqnsUw==", 2024-05-10T04:23:47.186 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.186 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-05-10T04:23:47.186 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-05-10T04:23:47.186 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-05-10T04:23:47.186 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-05-10T04:23:47.186 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.186 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2024-05-10T04:23:47.186 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDLoD1mVLw5HBAAUsnruzjDsMY+cuW/HW6IsQ==", 2024-05-10T04:23:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-05-10T04:23:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-05-10T04:23:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-05-10T04:23:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2024-05-10T04:23:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDOoD1m4zcqKRAAacm/DDheLNuiFbVxcZE2LQ==", 2024-05-10T04:23:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-05-10T04:23:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-05-10T04:23:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-05-10T04:23:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.188 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2024-05-10T04:23:47.188 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDRoD1m6JMeMxAA4k8/i/r4mfD40NqwPymaEw==", 2024-05-10T04:23:47.188 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.188 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-05-10T04:23:47.188 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-05-10T04:23:47.188 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-05-10T04:23:47.188 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.188 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2024-05-10T04:23:47.188 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDVoD1mGoqjARAA/g68PExdsrPSGDOtiNGIRg==", 2024-05-10T04:23:47.188 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.188 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-05-10T04:23:47.188 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-05-10T04:23:47.188 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-05-10T04:23:47.189 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.189 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2024-05-10T04:23:47.189 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDboD1mWGXzBxAAsLr9tqCb7XjCIO+hI+Y0iA==", 2024-05-10T04:23:47.189 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.189 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-05-10T04:23:47.189 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-05-10T04:23:47.189 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-05-10T04:23:47.189 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.189 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2024-05-10T04:23:47.189 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDeoD1mjJ7hEhAA+nZTvDCVnoD7hWJjnGQNeg==", 2024-05-10T04:23:47.190 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.190 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-05-10T04:23:47.190 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-05-10T04:23:47.190 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-05-10T04:23:47.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.190 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2024-05-10T04:23:47.190 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDhoD1mLXmNHBAAJ1sJMT7TT1WxOiPJg3RxBw==", 2024-05-10T04:23:47.190 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.190 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-05-10T04:23:47.191 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-05-10T04:23:47.191 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-05-10T04:23:47.191 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.191 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2024-05-10T04:23:47.191 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDkoD1mOmu8JxAANe+x9Ys3s/tee2qYi7nOyg==", 2024-05-10T04:23:47.191 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.191 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-05-10T04:23:47.191 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-05-10T04:23:47.191 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-05-10T04:23:47.191 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.192 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2024-05-10T04:23:47.192 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDHoD1mwGm7LRAAkiB5+STAX0Cl6GvpfB97Qw==", 2024-05-10T04:23:47.192 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.192 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-05-10T04:23:47.192 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-05-10T04:23:47.192 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-05-10T04:23:47.192 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-05-10T04:23:47.192 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.192 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2024-05-10T04:23:47.192 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDIoD1mmkWXCRAAMRsK/7+gcsQcSF6tQAu/Jw==", 2024-05-10T04:23:47.192 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.192 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-05-10T04:23:47.193 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-05-10T04:23:47.193 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-05-10T04:23:47.193 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-05-10T04:23:47.193 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.193 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2024-05-10T04:23:47.193 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDHoD1mzPVTORAAymg1tI2s217pkyyzNefajg==", 2024-05-10T04:23:47.193 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.193 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-05-10T04:23:47.193 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-05-10T04:23:47.193 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-05-10T04:23:47.193 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-05-10T04:23:47.193 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.194 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2024-05-10T04:23:47.194 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDIoD1m+mlIFRAAhjrkUf30qqb3N5nyV6Gsnw==", 2024-05-10T04:23:47.194 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.194 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-05-10T04:23:47.194 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-05-10T04:23:47.194 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-05-10T04:23:47.194 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-05-10T04:23:47.194 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.194 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2024-05-10T04:23:47.194 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDFoD1mdOoYJRAACeUopudzFqH/0fbbz4jU0w==", 2024-05-10T04:23:47.194 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.195 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-05-10T04:23:47.195 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-05-10T04:23:47.195 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-05-10T04:23:47.195 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-05-10T04:23:47.195 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.195 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-mds", 2024-05-10T04:23:47.195 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDzoD1mC0FjFRAAYo5oT7mQ+Ug64opAv5TByA==", 2024-05-10T04:23:47.195 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.195 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-mds" 2024-05-10T04:23:47.195 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.196 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-mgr", 2024-05-10T04:23:47.196 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDzoD1mCktjFRAAB4sOOrvjFP9k7Gs/3MC9ug==", 2024-05-10T04:23:47.196 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.196 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-10T04:23:47.196 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.196 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-osd", 2024-05-10T04:23:47.196 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDzoD1md1NjFRAA7FdWShjN2zybk7uIWc71Qw==", 2024-05-10T04:23:47.196 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.196 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-osd" 2024-05-10T04:23:47.196 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.196 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-rbd", 2024-05-10T04:23:47.196 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDzoD1m/FtjFRAAEqhE50ot2QKUfHth/OabfA==", 2024-05-10T04:23:47.197 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.197 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-10T04:23:47.197 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.197 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-10T04:23:47.197 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDzoD1m0WRjFRAACxqsusbUgbUyHmxJM3KuPg==", 2024-05-10T04:23:47.197 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.197 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-10T04:23:47.197 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.197 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-rgw", 2024-05-10T04:23:47.197 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDzoD1mMHNjFRAAdUjyaL0w3W7cxpZr9912Lw==", 2024-05-10T04:23:47.198 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.198 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-10T04:23:47.198 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.198 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2024-05-10T04:23:47.198 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDGoD1mwXL4HxAAKhdbtPVg4ChNdKenYaVA5A==", 2024-05-10T04:23:47.198 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.198 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-05-10T04:23:47.198 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2024-05-10T04:23:47.198 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-05-10T04:23:47.198 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-10T04:23:47.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:47.199 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2024-05-10T04:23:47.199 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDGoD1m1cZmExAACGbS5fhje6yneHUUPhMZuA==", 2024-05-10T04:23:47.199 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-05-10T04:23:47.199 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-05-10T04:23:47.199 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2024-05-10T04:23:47.199 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-05-10T04:23:47.199 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.199 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:47.199 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-10T04:23:47.199 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-10T04:23:47.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.184+0000 7ffbdbc00700 1 -- 172.21.15.80:0/313290843 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ffbb406ac90 msgr2=0x7ffbb406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:47.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.185+0000 7ffbdbc00700 1 --2- 172.21.15.80:0/313290843 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ffbb406ac90 0x7ffbb406d1a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80090b0 tx=0x7ffbc801c040 comp rx=0 tx=0).stop 2024-05-10T04:23:47.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.185+0000 7ffbdbc00700 1 -- 172.21.15.80:0/313290843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbd40d3460 msgr2=0x7ffbd40cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:47.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.185+0000 7ffbdbc00700 1 --2- 172.21.15.80:0/313290843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbd40d3460 0x7ffbd40cd940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffbc000d830 tx=0x7ffbc000dbf0 comp rx=0 tx=0).stop 2024-05-10T04:23:47.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.185+0000 7ffbdbc00700 1 -- 172.21.15.80:0/313290843 shutdown_connections 2024-05-10T04:23:47.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.185+0000 7ffbdbc00700 1 --2- 172.21.15.80:0/313290843 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ffbb406ac90 0x7ffbb406d1a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:47.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.185+0000 7ffbdbc00700 1 --2- 172.21.15.80:0/313290843 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffbd41620e0 0x7ffbd4151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:47.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.185+0000 7ffbdbc00700 1 --2- 172.21.15.80:0/313290843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbd40b58b0 0x7ffbd40c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:47.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.185+0000 7ffbdbc00700 1 --2- 172.21.15.80:0/313290843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbd40d3460 0x7ffbd40cd940 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:47.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.185+0000 7ffbdbc00700 1 -- 172.21.15.80:0/313290843 >> 172.21.15.80:0/313290843 conn(0x7ffbd40d0a90 msgr2=0x7ffbd41624f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:47.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.185+0000 7ffbdbc00700 1 -- 172.21.15.80:0/313290843 shutdown_connections 2024-05-10T04:23:47.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.185+0000 7ffbdbc00700 1 -- 172.21.15.80:0/313290843 wait complete. 2024-05-10T04:23:47.211 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-10T04:23:47.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.472+0000 7f437ec00700 1 Processor -- start 2024-05-10T04:23:47.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.472+0000 7f437ec00700 1 -- start start 2024-05-10T04:23:47.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.473+0000 7f437ec00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f437815ea10 0x7f437806ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:47.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.473+0000 7f437ec00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f43780b5c90 0x7f43780b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:47.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.473+0000 7f437ec00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f437806c5f0 con 0x7f4378158c70 2024-05-10T04:23:47.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.473+0000 7f437ec00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437815ee20 con 0x7f437815ea10 2024-05-10T04:23:47.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.473+0000 7f437ec00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43780b65e0 con 0x7f43780b5c90 2024-05-10T04:23:47.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.474+0000 7f4377400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f437815ea10 0x7f437806ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:47.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.474+0000 7f4377400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f437815ea10 0x7f437806ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55572/0 (socket says 172.21.15.80:55572) 2024-05-10T04:23:47.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.474+0000 7f4377400700 1 -- 172.21.15.80:0/3736907959 learned_addr learned my addr 172.21.15.80:0/3736907959 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:47.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.474+0000 7f437cc00700 1 --2- 172.21.15.80:0/3736907959 >> v2:172.21.15.106:3300/0 conn(0x7f43780b5c90 0x7f43780b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:47.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.474+0000 7f4377400700 1 -- 172.21.15.80:0/3736907959 >> v2:172.21.15.106:3300/0 conn(0x7f43780b5c90 msgr2=0x7f43780b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:47.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.474+0000 7f4377400700 1 --2- 172.21.15.80:0/3736907959 >> v2:172.21.15.106:3300/0 conn(0x7f43780b5c90 0x7f43780b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:47.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.474+0000 7f4377400700 1 -- 172.21.15.80:0/3736907959 >> v1:172.21.15.106:6789/0 conn(0x7f4378158c70 legacy=0x7f4378162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:47.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.474+0000 7f4377400700 1 -- 172.21.15.80:0/3736907959 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4378162850 con 0x7f437815ea10 2024-05-10T04:23:47.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.474+0000 7f437cc00700 1 --2- 172.21.15.80:0/3736907959 >> v2:172.21.15.106:3300/0 conn(0x7f43780b5c90 0x7f43780b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:47.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.474+0000 7f4377400700 1 --2- 172.21.15.80:0/3736907959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f437815ea10 0x7f437806ca80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f43780ce790 tx=0x7f4364009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b0bf7a8b15d285 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:47.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.475+0000 7f4376a00700 1 -- 172.21.15.80:0/3736907959 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364004230 con 0x7f437815ea10 2024-05-10T04:23:47.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.475+0000 7f4376a00700 1 -- 172.21.15.80:0/3736907959 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4364004390 con 0x7f437815ea10 2024-05-10T04:23:47.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.475+0000 7f4376a00700 1 -- 172.21.15.80:0/3736907959 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43640036a0 con 0x7f437815ea10 2024-05-10T04:23:47.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.475+0000 7f437ec00700 1 -- 172.21.15.80:0/3736907959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f437815ea10 msgr2=0x7f437806ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:47.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.475+0000 7f437ec00700 1 --2- 172.21.15.80:0/3736907959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f437815ea10 0x7f437806ca80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f43780ce790 tx=0x7f4364009bd0 comp rx=0 tx=0).stop 2024-05-10T04:23:47.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.476+0000 7f437ec00700 1 -- 172.21.15.80:0/3736907959 shutdown_connections 2024-05-10T04:23:47.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.476+0000 7f437ec00700 1 --2- 172.21.15.80:0/3736907959 >> v2:172.21.15.106:3300/0 conn(0x7f43780b5c90 0x7f43780b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:47.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.476+0000 7f437ec00700 1 --2- 172.21.15.80:0/3736907959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f437815ea10 0x7f437806ca80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:47.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.476+0000 7f437ec00700 1 -- 172.21.15.80:0/3736907959 >> 172.21.15.80:0/3736907959 conn(0x7f43780d0d30 msgr2=0x7f43780d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:47.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.476+0000 7f437ec00700 1 -- 172.21.15.80:0/3736907959 shutdown_connections 2024-05-10T04:23:47.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.476+0000 7f437ec00700 1 -- 172.21.15.80:0/3736907959 wait complete. 2024-05-10T04:23:47.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.478+0000 7f437ec00700 1 Processor -- start 2024-05-10T04:23:47.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.478+0000 7f437ec00700 1 -- start start 2024-05-10T04:23:47.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.479+0000 7f437ec00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43780b5c90 0x7f43781e8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:47.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.479+0000 7f437ec00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4378158c70 0x7f43780c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:47.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.479+0000 7f437ec00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f437815ea10 0x7f43780ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:47.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.479+0000 7f437ec00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43780cddb0 con 0x7f43780b5c90 2024-05-10T04:23:47.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.479+0000 7f437ec00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43781f4bc0 con 0x7f4378158c70 2024-05-10T04:23:47.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.479+0000 7f437ec00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43780cdf20 con 0x7f437815ea10 2024-05-10T04:23:47.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.480+0000 7f4377e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43780b5c90 0x7f43781e8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:47.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.480+0000 7f4377e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43780b5c90 0x7f43781e8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55580/0 (socket says 172.21.15.80:55580) 2024-05-10T04:23:47.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.480+0000 7f4377e00700 1 -- 172.21.15.80:0/609227938 learned_addr learned my addr 172.21.15.80:0/609227938 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:47.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.480+0000 7f4377400700 1 --2- 172.21.15.80:0/609227938 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4378158c70 0x7f43780c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:47.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.480+0000 7f437cc00700 1 --2- 172.21.15.80:0/609227938 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f437815ea10 0x7f43780ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:47.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.480+0000 7f4377e00700 1 -- 172.21.15.80:0/609227938 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f437815ea10 msgr2=0x7f43780ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:47.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.480+0000 7f4377e00700 1 --2- 172.21.15.80:0/609227938 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f437815ea10 0x7f43780ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:47.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.480+0000 7f4377e00700 1 -- 172.21.15.80:0/609227938 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4378158c70 msgr2=0x7f43780c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:47.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.480+0000 7f4377e00700 1 --2- 172.21.15.80:0/609227938 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4378158c70 0x7f43780c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:47.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.480+0000 7f4377e00700 1 -- 172.21.15.80:0/609227938 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4364009550 con 0x7f43780b5c90 2024-05-10T04:23:47.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.480+0000 7f437cc00700 1 --2- 172.21.15.80:0/609227938 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f437815ea10 0x7f43780ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:47.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.480+0000 7f4377e00700 1 --2- 172.21.15.80:0/609227938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43780b5c90 0x7f43781e8810 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f436800b450 tx=0x7f436800b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:47.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.481+0000 7f436fe00700 1 -- 172.21.15.80:0/609227938 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368004020 con 0x7f43780b5c90 2024-05-10T04:23:47.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.481+0000 7f436fe00700 1 -- 172.21.15.80:0/609227938 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4368004180 con 0x7f43780b5c90 2024-05-10T04:23:47.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.481+0000 7f436fe00700 1 -- 172.21.15.80:0/609227938 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368004510 con 0x7f43780b5c90 2024-05-10T04:23:47.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.481+0000 7f437ec00700 1 -- 172.21.15.80:0/609227938 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43780cb630 con 0x7f43780b5c90 2024-05-10T04:23:47.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.481+0000 7f437ec00700 1 -- 172.21.15.80:0/609227938 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43781f79b0 con 0x7f43780b5c90 2024-05-10T04:23:47.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.482+0000 7f437ec00700 1 -- 172.21.15.80:0/609227938 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43780732b0 con 0x7f43780b5c90 2024-05-10T04:23:47.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.483+0000 7f436fe00700 1 -- 172.21.15.80:0/609227938 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4368003680 con 0x7f43780b5c90 2024-05-10T04:23:47.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.484+0000 7f436fe00700 1 --2- 172.21.15.80:0/609227938 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f435806acc0 0x7f435806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:47.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.484+0000 7f436fe00700 1 -- 172.21.15.80:0/609227938 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4368088b80 con 0x7f43780b5c90 2024-05-10T04:23:47.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.485+0000 7f4377400700 1 --2- 172.21.15.80:0/609227938 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f435806acc0 0x7f435806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:47.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.486+0000 7f4377400700 1 --2- 172.21.15.80:0/609227938 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f435806acc0 0x7f435806d1d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4364009130 tx=0x7f4364008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:47.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.489+0000 7f436fe00700 1 -- 172.21.15.80:0/609227938 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4368054010 con 0x7f43780b5c90 2024-05-10T04:23:47.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.778+0000 7f437ec00700 1 -- 172.21.15.80:0/609227938 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f43780b3660 con 0x7f43780b5c90 2024-05-10T04:23:47.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.783+0000 7f436fe00700 1 -- 172.21.15.80:0/609227938 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f43680150a0 con 0x7f43780b5c90 2024-05-10T04:23:47.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.786+0000 7f437ec00700 1 -- 172.21.15.80:0/609227938 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f435806acc0 msgr2=0x7f435806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:47.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.786+0000 7f437ec00700 1 --2- 172.21.15.80:0/609227938 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f435806acc0 0x7f435806d1d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4364009130 tx=0x7f4364008030 comp rx=0 tx=0).stop 2024-05-10T04:23:47.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.786+0000 7f437ec00700 1 -- 172.21.15.80:0/609227938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43780b5c90 msgr2=0x7f43781e8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:47.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.786+0000 7f437ec00700 1 --2- 172.21.15.80:0/609227938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43780b5c90 0x7f43781e8810 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f436800b450 tx=0x7f436800b760 comp rx=0 tx=0).stop 2024-05-10T04:23:47.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.786+0000 7f437ec00700 1 -- 172.21.15.80:0/609227938 shutdown_connections 2024-05-10T04:23:47.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.786+0000 7f437ec00700 1 --2- 172.21.15.80:0/609227938 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f435806acc0 0x7f435806d1d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:47.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.786+0000 7f437ec00700 1 --2- 172.21.15.80:0/609227938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43780b5c90 0x7f43781e8810 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:47.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.786+0000 7f437ec00700 1 --2- 172.21.15.80:0/609227938 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f437815ea10 0x7f43780ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:47.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.786+0000 7f437ec00700 1 --2- 172.21.15.80:0/609227938 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4378158c70 0x7f43780c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:47.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.786+0000 7f437ec00700 1 -- 172.21.15.80:0/609227938 >> 172.21.15.80:0/609227938 conn(0x7f43780d0d30 msgr2=0x7f43780b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:47.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.786+0000 7f437ec00700 1 -- 172.21.15.80:0/609227938 shutdown_connections 2024-05-10T04:23:47.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:47.786+0000 7f437ec00700 1 -- 172.21.15.80:0/609227938 wait complete. 2024-05-10T04:23:47.811 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-10T04:23:48.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.072+0000 7efe89600700 1 Processor -- start 2024-05-10T04:23:48.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.072+0000 7efe89600700 1 -- start start 2024-05-10T04:23:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.074+0000 7efe89600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe840b6230 0x7efe840d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.074+0000 7efe89600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe840d0ac0 0x7efe8415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.074+0000 7efe89600700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe840d0ed0 con 0x7efe840b98e0 2024-05-10T04:23:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.074+0000 7efe89600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe840d2c30 con 0x7efe840d0ac0 2024-05-10T04:23:48.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.074+0000 7efe89600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe840d2e50 con 0x7efe840b6230 2024-05-10T04:23:48.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.075+0000 7efe83e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efe840b98e0 0x7efe840d2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34344/0 (socket says 172.21.15.80:34344) 2024-05-10T04:23:48.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.075+0000 7efe83e00700 1 -- 172.21.15.80:0/569278408 learned_addr learned my addr 172.21.15.80:0/569278408 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:48.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.075+0000 7efe88c00700 1 --2- 172.21.15.80:0/569278408 >> v2:172.21.15.80:3300/0 conn(0x7efe840d0ac0 0x7efe8415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:48.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.075+0000 7efe7be00700 1 --2- 172.21.15.80:0/569278408 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe840b6230 0x7efe840d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:48.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.075+0000 7efe83400700 1 -- 172.21.15.80:0/569278408 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517359310 0 0) 0x7efe840d0ed0 con 0x7efe840b98e0 2024-05-10T04:23:48.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.075+0000 7efe83400700 1 -- 172.21.15.80:0/569278408 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe680035b0 con 0x7efe840b98e0 2024-05-10T04:23:48.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.075+0000 7efe88c00700 1 -- 172.21.15.80:0/569278408 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe840b6230 msgr2=0x7efe840d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:48.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.075+0000 7efe88c00700 1 --2- 172.21.15.80:0/569278408 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe840b6230 0x7efe840d0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.075+0000 7efe88c00700 1 -- 172.21.15.80:0/569278408 >> v1:172.21.15.80:6789/0 conn(0x7efe840b98e0 legacy=0x7efe840d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:48.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.075+0000 7efe88c00700 1 -- 172.21.15.80:0/569278408 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe840d3130 con 0x7efe840d0ac0 2024-05-10T04:23:48.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.075+0000 7efe7be00700 1 --2- 172.21.15.80:0/569278408 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe840b6230 0x7efe840d0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:48.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.075+0000 7efe88c00700 1 --2- 172.21.15.80:0/569278408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe840d0ac0 0x7efe8415d7f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efe7c009d90 tx=0x7efe7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65afb6ea4f664e30 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.076+0000 7efe83400700 1 -- 172.21.15.80:0/569278408 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c00e070 con 0x7efe840d0ac0 2024-05-10T04:23:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.076+0000 7efe83400700 1 -- 172.21.15.80:0/569278408 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c00bb20 con 0x7efe840d0ac0 2024-05-10T04:23:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.076+0000 7efe83400700 1 -- 172.21.15.80:0/569278408 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c012430 con 0x7efe840d0ac0 2024-05-10T04:23:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.076+0000 7efe89600700 1 -- 172.21.15.80:0/569278408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe840d0ac0 msgr2=0x7efe8415d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.076+0000 7efe89600700 1 --2- 172.21.15.80:0/569278408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe840d0ac0 0x7efe8415d7f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efe7c009d90 tx=0x7efe7c00b330 comp rx=0 tx=0).stop 2024-05-10T04:23:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.076+0000 7efe89600700 1 -- 172.21.15.80:0/569278408 shutdown_connections 2024-05-10T04:23:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.076+0000 7efe89600700 1 --2- 172.21.15.80:0/569278408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe840d0ac0 0x7efe8415d7f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.076+0000 7efe89600700 1 --2- 172.21.15.80:0/569278408 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe840b6230 0x7efe840d0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.076+0000 7efe89600700 1 -- 172.21.15.80:0/569278408 >> 172.21.15.80:0/569278408 conn(0x7efe840676c0 msgr2=0x7efe8406c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.076+0000 7efe89600700 1 -- 172.21.15.80:0/569278408 shutdown_connections 2024-05-10T04:23:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.076+0000 7efe89600700 1 -- 172.21.15.80:0/569278408 wait complete. 2024-05-10T04:23:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.079+0000 7efe89600700 1 Processor -- start 2024-05-10T04:23:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.079+0000 7efe89600700 1 -- start start 2024-05-10T04:23:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.080+0000 7efe89600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe840b6230 0x7efe840c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.080+0000 7efe89600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe840b98e0 0x7efe8414bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.080+0000 7efe89600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe840d0ac0 0x7efe8414c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.080+0000 7efe89600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe840cace0 con 0x7efe840b98e0 2024-05-10T04:23:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.080+0000 7efe89600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe841e9d40 con 0x7efe840b6230 2024-05-10T04:23:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.080+0000 7efe89600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe84149ae0 con 0x7efe840d0ac0 2024-05-10T04:23:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.081+0000 7efe7be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe840b98e0 0x7efe8414bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.081+0000 7efe7be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe840b98e0 0x7efe8414bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55598/0 (socket says 172.21.15.80:55598) 2024-05-10T04:23:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.081+0000 7efe7be00700 1 -- 172.21.15.80:0/2876473519 learned_addr learned my addr 172.21.15.80:0/2876473519 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.081+0000 7efe83e00700 1 --2- 172.21.15.80:0/2876473519 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe840b6230 0x7efe840c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.081+0000 7efe88c00700 1 --2- 172.21.15.80:0/2876473519 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe840d0ac0 0x7efe8414c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.081+0000 7efe7be00700 1 -- 172.21.15.80:0/2876473519 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe840d0ac0 msgr2=0x7efe8414c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.081+0000 7efe7be00700 1 --2- 172.21.15.80:0/2876473519 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe840d0ac0 0x7efe8414c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.081+0000 7efe7be00700 1 -- 172.21.15.80:0/2876473519 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe840b6230 msgr2=0x7efe840c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.081+0000 7efe7be00700 1 --2- 172.21.15.80:0/2876473519 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe840b6230 0x7efe840c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.081+0000 7efe7be00700 1 -- 172.21.15.80:0/2876473519 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c009a70 con 0x7efe840b98e0 2024-05-10T04:23:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.081+0000 7efe7be00700 1 --2- 172.21.15.80:0/2876473519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe840b98e0 0x7efe8414bb70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00e790 tx=0x7efe6c00eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.082+0000 7efe80c00700 1 -- 172.21.15.80:0/2876473519 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00c070 con 0x7efe840b98e0 2024-05-10T04:23:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.082+0000 7efe80c00700 1 -- 172.21.15.80:0/2876473519 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c013610 con 0x7efe840b98e0 2024-05-10T04:23:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.082+0000 7efe89600700 1 -- 172.21.15.80:0/2876473519 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe840c9d40 con 0x7efe840b98e0 2024-05-10T04:23:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.082+0000 7efe80c00700 1 -- 172.21.15.80:0/2876473519 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c0139c0 con 0x7efe840b98e0 2024-05-10T04:23:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.082+0000 7efe89600700 1 -- 172.21.15.80:0/2876473519 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe84149d30 con 0x7efe840b98e0 2024-05-10T04:23:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.083+0000 7efe89600700 1 -- 172.21.15.80:0/2876473519 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8414a660 con 0x7efe840b98e0 2024-05-10T04:23:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.084+0000 7efe80c00700 1 -- 172.21.15.80:0/2876473519 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efe6c013b20 con 0x7efe840b98e0 2024-05-10T04:23:48.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.085+0000 7efe80c00700 1 --2- 172.21.15.80:0/2876473519 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efe6006ac90 0x7efe6006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:48.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.085+0000 7efe80c00700 1 -- 172.21.15.80:0/2876473519 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efe6c088bd0 con 0x7efe840b98e0 2024-05-10T04:23:48.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.085+0000 7efe83e00700 1 --2- 172.21.15.80:0/2876473519 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efe6006ac90 0x7efe6006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:48.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.086+0000 7efe83e00700 1 --2- 172.21.15.80:0/2876473519 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efe6006ac90 0x7efe6006d1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efe74007fd0 tx=0x7efe74007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:48.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.089+0000 7efe80c00700 1 -- 172.21.15.80:0/2876473519 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7efe6c054190 con 0x7efe840b98e0 2024-05-10T04:23:48.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.377+0000 7efe89600700 1 -- 172.21.15.80:0/2876473519 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7efe84074af0 con 0x7efe840b98e0 2024-05-10T04:23:48.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.382+0000 7efe80c00700 1 -- 172.21.15.80:0/2876473519 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7efe6c0577b0 con 0x7efe840b98e0 2024-05-10T04:23:48.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.384+0000 7efe89600700 1 -- 172.21.15.80:0/2876473519 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efe6006ac90 msgr2=0x7efe6006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:48.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.384+0000 7efe89600700 1 --2- 172.21.15.80:0/2876473519 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efe6006ac90 0x7efe6006d1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efe74007fd0 tx=0x7efe74007dc0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.384+0000 7efe89600700 1 -- 172.21.15.80:0/2876473519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe840b98e0 msgr2=0x7efe8414bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:48.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.384+0000 7efe89600700 1 --2- 172.21.15.80:0/2876473519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe840b98e0 0x7efe8414bb70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00e790 tx=0x7efe6c00eaa0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.384+0000 7efe89600700 1 -- 172.21.15.80:0/2876473519 shutdown_connections 2024-05-10T04:23:48.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.384+0000 7efe89600700 1 --2- 172.21.15.80:0/2876473519 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7efe6006ac90 0x7efe6006d1a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.384+0000 7efe89600700 1 --2- 172.21.15.80:0/2876473519 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe840d0ac0 0x7efe8414c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.384+0000 7efe89600700 1 --2- 172.21.15.80:0/2876473519 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe840b6230 0x7efe840c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.384+0000 7efe89600700 1 --2- 172.21.15.80:0/2876473519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe840b98e0 0x7efe8414bb70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.384+0000 7efe89600700 1 -- 172.21.15.80:0/2876473519 >> 172.21.15.80:0/2876473519 conn(0x7efe840676c0 msgr2=0x7efe84160030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:48.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.384+0000 7efe89600700 1 -- 172.21.15.80:0/2876473519 shutdown_connections 2024-05-10T04:23:48.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.384+0000 7efe89600700 1 -- 172.21.15.80:0/2876473519 wait complete. 2024-05-10T04:23:48.411 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-10T04:23:48.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.669+0000 7fd074a00700 1 Processor -- start 2024-05-10T04:23:48.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.669+0000 7fd074a00700 1 -- start start 2024-05-10T04:23:48.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.671+0000 7fd074a00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd0700cdeb0 0x7fd0700ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:48.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.671+0000 7fd074a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd070071f20 0x7fd070072330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:48.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.671+0000 7fd074a00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd070072870 con 0x7fd07015ee80 2024-05-10T04:23:48.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.671+0000 7fd074a00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0700cd6f0 con 0x7fd070071f20 2024-05-10T04:23:48.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.671+0000 7fd074a00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0700cbbf0 con 0x7fd0700cdeb0 2024-05-10T04:23:48.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.671+0000 7fd06e800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd070071f20 0x7fd070072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:48.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.671+0000 7fd06e800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd070071f20 0x7fd070072330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55610/0 (socket says 172.21.15.80:55610) 2024-05-10T04:23:48.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.671+0000 7fd06e800700 1 -- 172.21.15.80:0/3649563705 learned_addr learned my addr 172.21.15.80:0/3649563705 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:48.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.672+0000 7fd06d400700 1 --2- 172.21.15.80:0/3649563705 >> v2:172.21.15.106:3300/0 conn(0x7fd0700cdeb0 0x7fd0700ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:48.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.672+0000 7fd06e800700 1 -- 172.21.15.80:0/3649563705 >> v2:172.21.15.106:3300/0 conn(0x7fd0700cdeb0 msgr2=0x7fd0700ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:48.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.672+0000 7fd06e800700 1 --2- 172.21.15.80:0/3649563705 >> v2:172.21.15.106:3300/0 conn(0x7fd0700cdeb0 0x7fd0700ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.672+0000 7fd06e800700 1 -- 172.21.15.80:0/3649563705 >> v1:172.21.15.106:6789/0 conn(0x7fd07015ee80 legacy=0x7fd07015a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:48.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.672+0000 7fd06e800700 1 -- 172.21.15.80:0/3649563705 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0700cbed0 con 0x7fd070071f20 2024-05-10T04:23:48.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.672+0000 7fd06e800700 1 --2- 172.21.15.80:0/3649563705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd070071f20 0x7fd070072330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd070071620 tx=0x7fd06800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55af10bcda2cec1f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:48.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.672+0000 7fd06ca00700 1 -- 172.21.15.80:0/3649563705 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068010070 con 0x7fd070071f20 2024-05-10T04:23:48.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.672+0000 7fd06ca00700 1 -- 172.21.15.80:0/3649563705 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06800dad0 con 0x7fd070071f20 2024-05-10T04:23:48.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.673+0000 7fd06ca00700 1 -- 172.21.15.80:0/3649563705 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06800de80 con 0x7fd070071f20 2024-05-10T04:23:48.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.673+0000 7fd074a00700 1 -- 172.21.15.80:0/3649563705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd070071f20 msgr2=0x7fd070072330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:48.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.673+0000 7fd074a00700 1 --2- 172.21.15.80:0/3649563705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd070071f20 0x7fd070072330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd070071620 tx=0x7fd06800d430 comp rx=0 tx=0).stop 2024-05-10T04:23:48.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.673+0000 7fd074a00700 1 -- 172.21.15.80:0/3649563705 shutdown_connections 2024-05-10T04:23:48.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.673+0000 7fd074a00700 1 --2- 172.21.15.80:0/3649563705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd070071f20 0x7fd070072330 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.673+0000 7fd074a00700 1 --2- 172.21.15.80:0/3649563705 >> v2:172.21.15.106:3300/0 conn(0x7fd0700cdeb0 0x7fd0700ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.673+0000 7fd074a00700 1 -- 172.21.15.80:0/3649563705 >> 172.21.15.80:0/3649563705 conn(0x7fd0700cfa80 msgr2=0x7fd0700cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:48.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.673+0000 7fd074a00700 1 -- 172.21.15.80:0/3649563705 shutdown_connections 2024-05-10T04:23:48.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.673+0000 7fd074a00700 1 -- 172.21.15.80:0/3649563705 wait complete. 2024-05-10T04:23:48.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.675+0000 7fd074a00700 1 Processor -- start 2024-05-10T04:23:48.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.676+0000 7fd074a00700 1 -- start start 2024-05-10T04:23:48.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.677+0000 7fd074a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd070071f20 0x7fd070152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:48.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.677+0000 7fd074a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0700cdeb0 0x7fd070148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:48.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.677+0000 7fd074a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd07015ee80 0x7fd0701e4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:48.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.677+0000 7fd074a00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07015bbb0 con 0x7fd07015ee80 2024-05-10T04:23:48.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.677+0000 7fd074a00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07015d900 con 0x7fd070071f20 2024-05-10T04:23:48.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.677+0000 7fd074a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd07015c130 con 0x7fd0700cdeb0 2024-05-10T04:23:48.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.677+0000 7fd06e800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd07015ee80 0x7fd0701e4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:48.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.677+0000 7fd06e800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd07015ee80 0x7fd0701e4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55618/0 (socket says 172.21.15.80:55618) 2024-05-10T04:23:48.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.677+0000 7fd06e800700 1 -- 172.21.15.80:0/3980885711 learned_addr learned my addr 172.21.15.80:0/3980885711 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:48.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.678+0000 7fd06de00700 1 --2- 172.21.15.80:0/3980885711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd070071f20 0x7fd070152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:48.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.678+0000 7fd06d400700 1 --2- 172.21.15.80:0/3980885711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0700cdeb0 0x7fd070148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:48.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.678+0000 7fd06e800700 1 -- 172.21.15.80:0/3980885711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0700cdeb0 msgr2=0x7fd070148740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:48.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.678+0000 7fd06e800700 1 --2- 172.21.15.80:0/3980885711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0700cdeb0 0x7fd070148740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.678+0000 7fd06e800700 1 -- 172.21.15.80:0/3980885711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd070071f20 msgr2=0x7fd070152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:48.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.678+0000 7fd06e800700 1 --2- 172.21.15.80:0/3980885711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd070071f20 0x7fd070152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.678+0000 7fd06e800700 1 -- 172.21.15.80:0/3980885711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06800bd40 con 0x7fd07015ee80 2024-05-10T04:23:48.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.678+0000 7fd06e800700 1 --2- 172.21.15.80:0/3980885711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd07015ee80 0x7fd0701e4560 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd068016000 tx=0x7fd068004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:48.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.678+0000 7fd066000700 1 -- 172.21.15.80:0/3980885711 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0680042c0 con 0x7fd07015ee80 2024-05-10T04:23:48.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.678+0000 7fd066000700 1 -- 172.21.15.80:0/3980885711 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd068004460 con 0x7fd07015ee80 2024-05-10T04:23:48.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.678+0000 7fd066000700 1 -- 172.21.15.80:0/3980885711 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068004810 con 0x7fd07015ee80 2024-05-10T04:23:48.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.678+0000 7fd074a00700 1 -- 172.21.15.80:0/3980885711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0701500f0 con 0x7fd07015ee80 2024-05-10T04:23:48.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.679+0000 7fd074a00700 1 -- 172.21.15.80:0/3980885711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07015bdc0 con 0x7fd07015ee80 2024-05-10T04:23:48.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.680+0000 7fd074a00700 1 -- 172.21.15.80:0/3980885711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07015c2e0 con 0x7fd07015ee80 2024-05-10T04:23:48.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.681+0000 7fd066000700 1 -- 172.21.15.80:0/3980885711 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd068028460 con 0x7fd07015ee80 2024-05-10T04:23:48.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.681+0000 7fd066000700 1 --2- 172.21.15.80:0/3980885711 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd05006ac90 0x7fd05006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:48.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.682+0000 7fd066000700 1 -- 172.21.15.80:0/3980885711 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd06808a300 con 0x7fd07015ee80 2024-05-10T04:23:48.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.682+0000 7fd06de00700 1 --2- 172.21.15.80:0/3980885711 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd05006ac90 0x7fd05006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:48.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.683+0000 7fd06de00700 1 --2- 172.21.15.80:0/3980885711 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd05006ac90 0x7fd05006d1a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd0700b27a0 tx=0x7fd060009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:48.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.686+0000 7fd066000700 1 -- 172.21.15.80:0/3980885711 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd07015c2e0 con 0x7fd07015ee80 2024-05-10T04:23:48.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.974+0000 7fd074a00700 1 -- 172.21.15.80:0/3980885711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd07015d740 con 0x7fd07015ee80 2024-05-10T04:23:48.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.979+0000 7fd066000700 1 -- 172.21.15.80:0/3980885711 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd07015d740 con 0x7fd07015ee80 2024-05-10T04:23:48.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.981+0000 7fd074a00700 1 -- 172.21.15.80:0/3980885711 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd05006ac90 msgr2=0x7fd05006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:48.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.981+0000 7fd074a00700 1 --2- 172.21.15.80:0/3980885711 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd05006ac90 0x7fd05006d1a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd0700b27a0 tx=0x7fd060009040 comp rx=0 tx=0).stop 2024-05-10T04:23:48.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.981+0000 7fd074a00700 1 -- 172.21.15.80:0/3980885711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd07015ee80 msgr2=0x7fd0701e4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:48.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.981+0000 7fd074a00700 1 --2- 172.21.15.80:0/3980885711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd07015ee80 0x7fd0701e4560 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd068016000 tx=0x7fd068004ad0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.981+0000 7fd074a00700 1 -- 172.21.15.80:0/3980885711 shutdown_connections 2024-05-10T04:23:48.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.981+0000 7fd074a00700 1 --2- 172.21.15.80:0/3980885711 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd05006ac90 0x7fd05006d1a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.981+0000 7fd074a00700 1 --2- 172.21.15.80:0/3980885711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd07015ee80 0x7fd0701e4560 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.981+0000 7fd074a00700 1 --2- 172.21.15.80:0/3980885711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd070071f20 0x7fd070152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.981+0000 7fd074a00700 1 --2- 172.21.15.80:0/3980885711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0700cdeb0 0x7fd070148740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:48.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.981+0000 7fd074a00700 1 -- 172.21.15.80:0/3980885711 >> 172.21.15.80:0/3980885711 conn(0x7fd0700cfa80 msgr2=0x7fd0700b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:48.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.981+0000 7fd074a00700 1 -- 172.21.15.80:0/3980885711 shutdown_connections 2024-05-10T04:23:48.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:48.981+0000 7fd074a00700 1 -- 172.21.15.80:0/3980885711 wait complete. 2024-05-10T04:23:49.007 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-10T04:23:49.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.270+0000 7f0bd8a00700 1 Processor -- start 2024-05-10T04:23:49.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.270+0000 7f0bd8a00700 1 -- start start 2024-05-10T04:23:49.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.271+0000 7f0bd8a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0bd40d04e0 0x7f0bd40cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:49.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.272+0000 7f0bd8a00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0bd406b640 0x7f0bd406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:49.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.272+0000 7f0bd8a00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd40ce9a0 con 0x7f0bd40b31c0 2024-05-10T04:23:49.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.272+0000 7f0bd8a00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd4070950 con 0x7f0bd40d04e0 2024-05-10T04:23:49.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.272+0000 7f0bd8a00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd40b02e0 con 0x7f0bd406b640 2024-05-10T04:23:49.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.272+0000 7f0bcbe00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0bd40d04e0 0x7f0bd40cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:49.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.272+0000 7f0bd1e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0bd40b31c0 0x7f0bd40cfdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34358/0 (socket says 172.21.15.80:34358) 2024-05-10T04:23:49.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.272+0000 7f0bd1e00700 1 -- 172.21.15.80:0/1808741013 learned_addr learned my addr 172.21.15.80:0/1808741013 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:49.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.272+0000 7f0bd2800700 1 --2- 172.21.15.80:0/1808741013 >> v2:172.21.15.106:3300/0 conn(0x7f0bd406b640 0x7f0bd406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:49.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.272+0000 7f0bcbe00700 1 -- 172.21.15.80:0/1808741013 >> v2:172.21.15.106:3300/0 conn(0x7f0bd406b640 msgr2=0x7f0bd406e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:49.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.272+0000 7f0bcbe00700 1 --2- 172.21.15.80:0/1808741013 >> v2:172.21.15.106:3300/0 conn(0x7f0bd406b640 0x7f0bd406e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:49.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.272+0000 7f0bcbe00700 1 -- 172.21.15.80:0/1808741013 >> v1:172.21.15.80:6789/0 conn(0x7f0bd40b31c0 legacy=0x7f0bd40cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:49.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.272+0000 7f0bcbe00700 1 -- 172.21.15.80:0/1808741013 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd4070390 con 0x7f0bd40d04e0 2024-05-10T04:23:49.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.272+0000 7f0bd1400700 1 -- 172.21.15.80:0/1808741013 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532039300 0 0) 0x7f0bd40ce9a0 con 0x7f0bd40b31c0 2024-05-10T04:23:49.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.273+0000 7f0bcbe00700 1 --2- 172.21.15.80:0/1808741013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bd40d04e0 0x7f0bd40cc9c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4070280 tx=0x7f0bbc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdbed89402275c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:49.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.273+0000 7f0bd1400700 1 -- 172.21.15.80:0/1808741013 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc011830 con 0x7f0bd40d04e0 2024-05-10T04:23:49.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.273+0000 7f0bd1400700 1 -- 172.21.15.80:0/1808741013 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc011990 con 0x7f0bd40d04e0 2024-05-10T04:23:49.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.273+0000 7f0bd1400700 1 -- 172.21.15.80:0/1808741013 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc011d20 con 0x7f0bd40d04e0 2024-05-10T04:23:49.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.274+0000 7f0bd8a00700 1 -- 172.21.15.80:0/1808741013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bd40d04e0 msgr2=0x7f0bd40cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:49.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.274+0000 7f0bd8a00700 1 --2- 172.21.15.80:0/1808741013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bd40d04e0 0x7f0bd40cc9c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4070280 tx=0x7f0bbc009b20 comp rx=0 tx=0).stop 2024-05-10T04:23:49.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.274+0000 7f0bd8a00700 1 -- 172.21.15.80:0/1808741013 shutdown_connections 2024-05-10T04:23:49.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.274+0000 7f0bd8a00700 1 --2- 172.21.15.80:0/1808741013 >> v2:172.21.15.106:3300/0 conn(0x7f0bd406b640 0x7f0bd406e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:49.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.274+0000 7f0bd8a00700 1 --2- 172.21.15.80:0/1808741013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bd40d04e0 0x7f0bd40cc9c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:49.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.274+0000 7f0bd8a00700 1 -- 172.21.15.80:0/1808741013 >> 172.21.15.80:0/1808741013 conn(0x7f0bd40b26a0 msgr2=0x7f0bd40b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:49.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.274+0000 7f0bd8a00700 1 -- 172.21.15.80:0/1808741013 shutdown_connections 2024-05-10T04:23:49.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.274+0000 7f0bd8a00700 1 -- 172.21.15.80:0/1808741013 wait complete. 2024-05-10T04:23:49.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.276+0000 7f0bd8a00700 1 Processor -- start 2024-05-10T04:23:49.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.276+0000 7f0bd8a00700 1 -- start start 2024-05-10T04:23:49.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.278+0000 7f0bd8a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bd406b640 0x7f0bd414ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:49.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.278+0000 7f0bd8a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bd40b31c0 0x7f0bd409aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:49.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.278+0000 7f0bd8a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0bd40d04e0 0x7f0bd409afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:49.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.278+0000 7f0bd8a00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd40c9300 con 0x7f0bd406b640 2024-05-10T04:23:49.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.278+0000 7f0bd8a00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd409b550 con 0x7f0bd40b31c0 2024-05-10T04:23:49.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.278+0000 7f0bd8a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd409b7a0 con 0x7f0bd40d04e0 2024-05-10T04:23:49.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.278+0000 7f0bd1e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bd406b640 0x7f0bd414ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:49.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.278+0000 7f0bd1e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bd406b640 0x7f0bd414ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55634/0 (socket says 172.21.15.80:55634) 2024-05-10T04:23:49.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.278+0000 7f0bd1e00700 1 -- 172.21.15.80:0/1349521292 learned_addr learned my addr 172.21.15.80:0/1349521292 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:49.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.278+0000 7f0bcbe00700 1 --2- 172.21.15.80:0/1349521292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bd40b31c0 0x7f0bd409aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:49.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.278+0000 7f0bd2800700 1 --2- 172.21.15.80:0/1349521292 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0bd40d04e0 0x7f0bd409afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:49.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.278+0000 7f0bd1e00700 1 -- 172.21.15.80:0/1349521292 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0bd40d04e0 msgr2=0x7f0bd409afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:49.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.278+0000 7f0bd1e00700 1 --2- 172.21.15.80:0/1349521292 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0bd40d04e0 0x7f0bd409afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:49.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.278+0000 7f0bd1e00700 1 -- 172.21.15.80:0/1349521292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bd40b31c0 msgr2=0x7f0bd409aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:49.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.278+0000 7f0bd1e00700 1 --2- 172.21.15.80:0/1349521292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bd40b31c0 0x7f0bd409aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:49.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.278+0000 7f0bd1e00700 1 -- 172.21.15.80:0/1349521292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc0094a0 con 0x7f0bd406b640 2024-05-10T04:23:49.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.279+0000 7f0bd1e00700 1 --2- 172.21.15.80:0/1349521292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bd406b640 0x7f0bd414ce70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400c520 tx=0x7f0bc400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:49.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.279+0000 7f0bca000700 1 -- 172.21.15.80:0/1349521292 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4004c80 con 0x7f0bd406b640 2024-05-10T04:23:49.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.279+0000 7f0bca000700 1 -- 172.21.15.80:0/1349521292 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc4004de0 con 0x7f0bd406b640 2024-05-10T04:23:49.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.279+0000 7f0bd8a00700 1 -- 172.21.15.80:0/1349521292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd409ba80 con 0x7f0bd406b640 2024-05-10T04:23:49.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.279+0000 7f0bca000700 1 -- 172.21.15.80:0/1349521292 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40072d0 con 0x7f0bd406b640 2024-05-10T04:23:49.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.279+0000 7f0bd8a00700 1 -- 172.21.15.80:0/1349521292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd409c040 con 0x7f0bd406b640 2024-05-10T04:23:49.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.280+0000 7f0bd8a00700 1 -- 172.21.15.80:0/1349521292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd4074af0 con 0x7f0bd406b640 2024-05-10T04:23:49.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.281+0000 7f0bca000700 1 -- 172.21.15.80:0/1349521292 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0bc4007430 con 0x7f0bd406b640 2024-05-10T04:23:49.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.282+0000 7f0bca000700 1 --2- 172.21.15.80:0/1349521292 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0bb006acc0 0x7f0bb006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:49.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.282+0000 7f0bca000700 1 -- 172.21.15.80:0/1349521292 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0bc4088dc0 con 0x7f0bd406b640 2024-05-10T04:23:49.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.283+0000 7f0bcbe00700 1 --2- 172.21.15.80:0/1349521292 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0bb006acc0 0x7f0bb006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:49.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.283+0000 7f0bcbe00700 1 --2- 172.21.15.80:0/1349521292 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0bb006acc0 0x7f0bb006d1d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0090b0 tx=0x7f0bbc01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:49.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.287+0000 7f0bca000700 1 -- 172.21.15.80:0/1349521292 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0bc40541c0 con 0x7f0bd406b640 2024-05-10T04:23:49.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.577+0000 7f0bd8a00700 1 -- 172.21.15.80:0/1349521292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f0bd415dc50 con 0x7f0bd406b640 2024-05-10T04:23:49.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.583+0000 7f0bca000700 1 -- 172.21.15.80:0/1349521292 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0bc40577e0 con 0x7f0bd406b640 2024-05-10T04:23:49.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.586+0000 7f0bd8a00700 1 -- 172.21.15.80:0/1349521292 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0bb006acc0 msgr2=0x7f0bb006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:49.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.586+0000 7f0bd8a00700 1 --2- 172.21.15.80:0/1349521292 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0bb006acc0 0x7f0bb006d1d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0090b0 tx=0x7f0bbc01c040 comp rx=0 tx=0).stop 2024-05-10T04:23:49.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.586+0000 7f0bd8a00700 1 -- 172.21.15.80:0/1349521292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bd406b640 msgr2=0x7f0bd414ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:49.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.586+0000 7f0bd8a00700 1 --2- 172.21.15.80:0/1349521292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bd406b640 0x7f0bd414ce70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400c520 tx=0x7f0bc400c8e0 comp rx=0 tx=0).stop 2024-05-10T04:23:49.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.586+0000 7f0bd8a00700 1 -- 172.21.15.80:0/1349521292 shutdown_connections 2024-05-10T04:23:49.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.586+0000 7f0bd8a00700 1 --2- 172.21.15.80:0/1349521292 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0bb006acc0 0x7f0bb006d1d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:49.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.586+0000 7f0bd8a00700 1 --2- 172.21.15.80:0/1349521292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bd406b640 0x7f0bd414ce70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:49.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.586+0000 7f0bd8a00700 1 --2- 172.21.15.80:0/1349521292 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0bd40d04e0 0x7f0bd409afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:49.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.586+0000 7f0bd8a00700 1 --2- 172.21.15.80:0/1349521292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bd40b31c0 0x7f0bd409aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:49.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.586+0000 7f0bd8a00700 1 -- 172.21.15.80:0/1349521292 >> 172.21.15.80:0/1349521292 conn(0x7f0bd40b26a0 msgr2=0x7f0bd40b57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:49.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.586+0000 7f0bd8a00700 1 -- 172.21.15.80:0/1349521292 shutdown_connections 2024-05-10T04:23:49.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.586+0000 7f0bd8a00700 1 -- 172.21.15.80:0/1349521292 wait complete. 2024-05-10T04:23:49.614 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-10T04:23:49.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.871+0000 7f6928a00700 1 Processor -- start 2024-05-10T04:23:49.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.871+0000 7f6928a00700 1 -- start start 2024-05-10T04:23:49.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.873+0000 7f6928a00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f69240d11d0 0x7f69240cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:49.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.873+0000 7f6928a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f69240cc7b0 0x7f69240ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:49.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.873+0000 7f6928a00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692406c5c0 con 0x7f69240d0dc0 2024-05-10T04:23:49.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.873+0000 7f6928a00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692406d9c0 con 0x7f69240cc7b0 2024-05-10T04:23:49.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.873+0000 7f6928a00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692406c3c0 con 0x7f69240d11d0 2024-05-10T04:23:49.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.873+0000 7f6922800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f69240cc7b0 0x7f69240ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:49.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.873+0000 7f6922800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f69240cc7b0 0x7f69240ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55644/0 (socket says 172.21.15.80:55644) 2024-05-10T04:23:49.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.873+0000 7f6922800700 1 -- 172.21.15.80:0/4274827558 learned_addr learned my addr 172.21.15.80:0/4274827558 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:49.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.874+0000 7f691be00700 1 --2- 172.21.15.80:0/4274827558 >> v2:172.21.15.106:3300/0 conn(0x7f69240d11d0 0x7f69240cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:49.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.874+0000 7f6922800700 1 -- 172.21.15.80:0/4274827558 >> v2:172.21.15.106:3300/0 conn(0x7f69240d11d0 msgr2=0x7f69240cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:49.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.874+0000 7f6922800700 1 --2- 172.21.15.80:0/4274827558 >> v2:172.21.15.106:3300/0 conn(0x7f69240d11d0 0x7f69240cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:49.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.874+0000 7f6922800700 1 -- 172.21.15.80:0/4274827558 >> v1:172.21.15.106:6789/0 conn(0x7f69240d0dc0 legacy=0x7f69240d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:49.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.874+0000 7f6922800700 1 -- 172.21.15.80:0/4274827558 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692406c0e0 con 0x7f69240cc7b0 2024-05-10T04:23:49.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.874+0000 7f691be00700 1 --2- 172.21.15.80:0/4274827558 >> v2:172.21.15.106:3300/0 conn(0x7f69240d11d0 0x7f69240cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:49.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.874+0000 7f6922800700 1 --2- 172.21.15.80:0/4274827558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69240cc7b0 0x7f69240ccbc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f692406f370 tx=0x7f691c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e8993b5da8d478 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:49.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.874+0000 7f6921400700 1 -- 172.21.15.80:0/4274827558 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c00e070 con 0x7f69240cc7b0 2024-05-10T04:23:49.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.875+0000 7f6921400700 1 -- 172.21.15.80:0/4274827558 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c00b9c0 con 0x7f69240cc7b0 2024-05-10T04:23:49.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.875+0000 7f6921400700 1 -- 172.21.15.80:0/4274827558 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c00bd70 con 0x7f69240cc7b0 2024-05-10T04:23:49.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.875+0000 7f6928a00700 1 -- 172.21.15.80:0/4274827558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69240cc7b0 msgr2=0x7f69240ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:49.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.875+0000 7f6928a00700 1 --2- 172.21.15.80:0/4274827558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69240cc7b0 0x7f69240ccbc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f692406f370 tx=0x7f691c00b330 comp rx=0 tx=0).stop 2024-05-10T04:23:49.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.875+0000 7f6928a00700 1 -- 172.21.15.80:0/4274827558 shutdown_connections 2024-05-10T04:23:49.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.875+0000 7f6928a00700 1 --2- 172.21.15.80:0/4274827558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69240cc7b0 0x7f69240ccbc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:49.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.875+0000 7f6928a00700 1 --2- 172.21.15.80:0/4274827558 >> v2:172.21.15.106:3300/0 conn(0x7f69240d11d0 0x7f69240cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:49.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.875+0000 7f6928a00700 1 -- 172.21.15.80:0/4274827558 >> 172.21.15.80:0/4274827558 conn(0x7f69240ce6a0 msgr2=0x7f69240ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:49.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.875+0000 7f6928a00700 1 -- 172.21.15.80:0/4274827558 shutdown_connections 2024-05-10T04:23:49.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.875+0000 7f6928a00700 1 -- 172.21.15.80:0/4274827558 wait complete. 2024-05-10T04:23:49.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.878+0000 7f6928a00700 1 Processor -- start 2024-05-10T04:23:49.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.878+0000 7f6928a00700 1 -- start start 2024-05-10T04:23:49.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.879+0000 7f6928a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69240cc7b0 0x7f6924160f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:49.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.879+0000 7f6928a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69240d0dc0 0x7f692415fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:49.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.879+0000 7f6928a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69240d11d0 0x7f69240c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:49.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.879+0000 7f6928a00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69240c7080 con 0x7f69240cc7b0 2024-05-10T04:23:49.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.879+0000 7f6928a00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69241616a0 con 0x7f69240d11d0 2024-05-10T04:23:49.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.879+0000 7f6928a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69241618f0 con 0x7f69240d0dc0 2024-05-10T04:23:49.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.879+0000 7f6921e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69240cc7b0 0x7f6924160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:49.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.880+0000 7f6921e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69240cc7b0 0x7f6924160f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55658/0 (socket says 172.21.15.80:55658) 2024-05-10T04:23:49.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.880+0000 7f6921e00700 1 -- 172.21.15.80:0/528183296 learned_addr learned my addr 172.21.15.80:0/528183296 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:49.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.880+0000 7f6922800700 1 --2- 172.21.15.80:0/528183296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69240d11d0 0x7f69240c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:49.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.880+0000 7f691be00700 1 --2- 172.21.15.80:0/528183296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69240d0dc0 0x7f692415fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:49.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.880+0000 7f6921e00700 1 -- 172.21.15.80:0/528183296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69240d0dc0 msgr2=0x7f692415fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:49.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.880+0000 7f6921e00700 1 --2- 172.21.15.80:0/528183296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69240d0dc0 0x7f692415fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:49.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.880+0000 7f6921e00700 1 -- 172.21.15.80:0/528183296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69240d11d0 msgr2=0x7f69240c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:49.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.880+0000 7f6921e00700 1 --2- 172.21.15.80:0/528183296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69240d11d0 0x7f69240c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:49.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.880+0000 7f6921e00700 1 -- 172.21.15.80:0/528183296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c009b30 con 0x7f69240cc7b0 2024-05-10T04:23:49.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.880+0000 7f691be00700 1 --2- 172.21.15.80:0/528183296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69240d0dc0 0x7f692415fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:49.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.880+0000 7f6921e00700 1 --2- 172.21.15.80:0/528183296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69240cc7b0 0x7f6924160f80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f691400c400 tx=0x7f691400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:49.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.880+0000 7f691a000700 1 -- 172.21.15.80:0/528183296 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140052d0 con 0x7f69240cc7b0 2024-05-10T04:23:49.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.880+0000 7f691a000700 1 -- 172.21.15.80:0/528183296 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6914005450 con 0x7f69240cc7b0 2024-05-10T04:23:49.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.880+0000 7f6928a00700 1 -- 172.21.15.80:0/528183296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69240c6e70 con 0x7f69240cc7b0 2024-05-10T04:23:49.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.880+0000 7f691a000700 1 -- 172.21.15.80:0/528183296 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914003910 con 0x7f69240cc7b0 2024-05-10T04:23:49.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.881+0000 7f6928a00700 1 -- 172.21.15.80:0/528183296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692409e360 con 0x7f69240cc7b0 2024-05-10T04:23:49.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.882+0000 7f6928a00700 1 -- 172.21.15.80:0/528183296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69240b3510 con 0x7f69240cc7b0 2024-05-10T04:23:49.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.882+0000 7f691a000700 1 -- 172.21.15.80:0/528183296 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6914003a70 con 0x7f69240cc7b0 2024-05-10T04:23:49.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.883+0000 7f691a000700 1 --2- 172.21.15.80:0/528183296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f690006acc0 0x7f690006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:49.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.883+0000 7f691a000700 1 -- 172.21.15.80:0/528183296 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6914088460 con 0x7f69240cc7b0 2024-05-10T04:23:49.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.884+0000 7f691be00700 1 --2- 172.21.15.80:0/528183296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f690006acc0 0x7f690006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:49.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.884+0000 7f691be00700 1 --2- 172.21.15.80:0/528183296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f690006acc0 0x7f690006d1d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f69240c68c0 tx=0x7f690c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:49.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:49.888+0000 7f691a000700 1 -- 172.21.15.80:0/528183296 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6914053990 con 0x7f69240cc7b0 2024-05-10T04:23:50.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.171+0000 7f6928a00700 1 -- 172.21.15.80:0/528183296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f69241614c0 con 0x7f69240cc7b0 2024-05-10T04:23:50.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.176+0000 7f691a000700 1 -- 172.21.15.80:0/528183296 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6914056fb0 con 0x7f69240cc7b0 2024-05-10T04:23:50.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.178+0000 7f6928a00700 1 -- 172.21.15.80:0/528183296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f690006acc0 msgr2=0x7f690006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:50.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.178+0000 7f6928a00700 1 --2- 172.21.15.80:0/528183296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f690006acc0 0x7f690006d1d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f69240c68c0 tx=0x7f690c008040 comp rx=0 tx=0).stop 2024-05-10T04:23:50.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.178+0000 7f6928a00700 1 -- 172.21.15.80:0/528183296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69240cc7b0 msgr2=0x7f6924160f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:50.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.178+0000 7f6928a00700 1 --2- 172.21.15.80:0/528183296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69240cc7b0 0x7f6924160f80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f691400c400 tx=0x7f691400c7c0 comp rx=0 tx=0).stop 2024-05-10T04:23:50.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.178+0000 7f6928a00700 1 -- 172.21.15.80:0/528183296 shutdown_connections 2024-05-10T04:23:50.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.178+0000 7f6928a00700 1 --2- 172.21.15.80:0/528183296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f690006acc0 0x7f690006d1d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:50.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.178+0000 7f6928a00700 1 --2- 172.21.15.80:0/528183296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69240cc7b0 0x7f6924160f80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:50.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.178+0000 7f6928a00700 1 --2- 172.21.15.80:0/528183296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69240d11d0 0x7f69240c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:50.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.178+0000 7f6928a00700 1 --2- 172.21.15.80:0/528183296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69240d0dc0 0x7f692415fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:50.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.178+0000 7f6928a00700 1 -- 172.21.15.80:0/528183296 >> 172.21.15.80:0/528183296 conn(0x7f69240ce6a0 msgr2=0x7f69240cc070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:50.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.178+0000 7f6928a00700 1 -- 172.21.15.80:0/528183296 shutdown_connections 2024-05-10T04:23:50.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.178+0000 7f6928a00700 1 -- 172.21.15.80:0/528183296 wait complete. 2024-05-10T04:23:50.205 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-10T04:23:50.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.467+0000 7fd8efe00700 1 Processor -- start 2024-05-10T04:23:50.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.468+0000 7fd8efe00700 1 -- start start 2024-05-10T04:23:50.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.469+0000 7fd8efe00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd8f00b6230 0x7fd8f00d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:50.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.469+0000 7fd8efe00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f00d0ed0 con 0x7fd8f00d0ac0 2024-05-10T04:23:50.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.469+0000 7fd8efe00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f00d2e50 con 0x7fd8f00b98e0 2024-05-10T04:23:50.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.469+0000 7fd8efe00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f00d2c30 con 0x7fd8f00b6230 2024-05-10T04:23:50.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.469+0000 7fd8ef400700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd8f00d0ac0 0x7fd8f015d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34370/0 (socket says 172.21.15.80:34370) 2024-05-10T04:23:50.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.469+0000 7fd8ef400700 1 -- 172.21.15.80:0/3447099828 learned_addr learned my addr 172.21.15.80:0/3447099828 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:50.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.470+0000 7fd8e7e00700 1 --2- 172.21.15.80:0/3447099828 >> v2:172.21.15.106:3300/0 conn(0x7fd8f00b6230 0x7fd8f00d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:50.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.470+0000 7fd8ee000700 1 -- 172.21.15.80:0/3447099828 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911701329 0 0) 0x7fd8f00d0ed0 con 0x7fd8f00d0ac0 2024-05-10T04:23:50.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.470+0000 7fd8ee000700 1 -- 172.21.15.80:0/3447099828 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8d40035b0 con 0x7fd8f00d0ac0 2024-05-10T04:23:50.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.470+0000 7fd8ee000700 1 -- 172.21.15.80:0/3447099828 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1090150956 0 0) 0x7fd8d40035b0 con 0x7fd8f00d0ac0 2024-05-10T04:23:50.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.470+0000 7fd8ee000700 1 -- 172.21.15.80:0/3447099828 >> v2:172.21.15.106:3300/0 conn(0x7fd8f00b6230 msgr2=0x7fd8f00d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:50.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.470+0000 7fd8ee000700 1 --2- 172.21.15.80:0/3447099828 >> v2:172.21.15.106:3300/0 conn(0x7fd8f00b6230 0x7fd8f00d0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:50.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.470+0000 7fd8ee000700 1 -- 172.21.15.80:0/3447099828 >> v1:172.21.15.106:6789/0 conn(0x7fd8f00b98e0 legacy=0x7fd8f00d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:50.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.470+0000 7fd8ee000700 1 -- 172.21.15.80:0/3447099828 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f00d3130 con 0x7fd8f00d0ac0 2024-05-10T04:23:50.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.470+0000 7fd8ee000700 1 -- 172.21.15.80:0/3447099828 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7fd8e80019f0 con 0x7fd8f00d0ac0 2024-05-10T04:23:50.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.470+0000 7fd8ee000700 1 -- 172.21.15.80:0/3447099828 >> v1:172.21.15.80:6789/0 conn(0x7fd8f00d0ac0 legacy=0x7fd8f015d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:50.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.470+0000 7fd8ee000700 1 --2- 172.21.15.80:0/3447099828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8d4003a00 0x7fd8d4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:50.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.470+0000 7fd8ee000700 1 --2- 172.21.15.80:0/3447099828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8d4004850 0x7fd8d4004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:50.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.470+0000 7fd8ee000700 1 --2- 172.21.15.80:0/3447099828 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8d4005210 0x7fd8d400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:50.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.470+0000 7fd8ee000700 1 -- 172.21.15.80:0/3447099828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f00d2c30 con 0x7fd8d4003a00 2024-05-10T04:23:50.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.470+0000 7fd8ee000700 1 -- 172.21.15.80:0/3447099828 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d400c1b0 con 0x7fd8d4004850 2024-05-10T04:23:50.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.470+0000 7fd8ee000700 1 -- 172.21.15.80:0/3447099828 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d400c370 con 0x7fd8d4005210 2024-05-10T04:23:50.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.471+0000 7fd8eea00700 1 --2- 172.21.15.80:0/3447099828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8d4003a00 0x7fd8d4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:50.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.471+0000 7fd8e7e00700 1 --2- 172.21.15.80:0/3447099828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8d4004850 0x7fd8d4004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:50.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.471+0000 7fd8ef400700 1 --2- 172.21.15.80:0/3447099828 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8d4005210 0x7fd8d400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:50.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.471+0000 7fd8eea00700 1 -- 172.21.15.80:0/3447099828 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8d4005210 msgr2=0x7fd8d400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:50.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.471+0000 7fd8eea00700 1 --2- 172.21.15.80:0/3447099828 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8d4005210 0x7fd8d400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:50.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.471+0000 7fd8eea00700 1 -- 172.21.15.80:0/3447099828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8d4004850 msgr2=0x7fd8d4004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:50.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.471+0000 7fd8eea00700 1 --2- 172.21.15.80:0/3447099828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8d4004850 0x7fd8d4004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.471+0000 7fd8eea00700 1 -- 172.21.15.80:0/3447099828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d40035b0 con 0x7fd8d4003a00 2024-05-10T04:23:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.471+0000 7fd8ef400700 1 --2- 172.21.15.80:0/3447099828 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8d4005210 0x7fd8d400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.471+0000 7fd8ef400700 1 -- 172.21.15.80:0/3447099828 reap_dead start 2024-05-10T04:23:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.471+0000 7fd8eea00700 1 --2- 172.21.15.80:0/3447099828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8d4003a00 0x7fd8d4003e70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd8e00017c0 tx=0x7fd8d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e9c9578d9f5444 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.472+0000 7fd8ee000700 1 -- 172.21.15.80:0/3447099828 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e00052d0 con 0x7fd8d4003a00 2024-05-10T04:23:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.472+0000 7fd8ee000700 1 -- 172.21.15.80:0/3447099828 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e0005430 con 0x7fd8d4003a00 2024-05-10T04:23:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.472+0000 7fd8ee000700 1 -- 172.21.15.80:0/3447099828 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e00038c0 con 0x7fd8d4003a00 2024-05-10T04:23:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.472+0000 7fd8efe00700 1 -- 172.21.15.80:0/3447099828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8d4003a00 msgr2=0x7fd8d4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.472+0000 7fd8efe00700 1 --2- 172.21.15.80:0/3447099828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8d4003a00 0x7fd8d4003e70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd8e00017c0 tx=0x7fd8d4005880 comp rx=0 tx=0).stop 2024-05-10T04:23:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.472+0000 7fd8efe00700 1 -- 172.21.15.80:0/3447099828 shutdown_connections 2024-05-10T04:23:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.472+0000 7fd8efe00700 1 --2- 172.21.15.80:0/3447099828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8d4003a00 0x7fd8d4003e70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.472+0000 7fd8efe00700 1 -- 172.21.15.80:0/3447099828 >> 172.21.15.80:0/3447099828 conn(0x7fd8f00676c0 msgr2=0x7fd8f006c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:50.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.472+0000 7fd8efe00700 1 -- 172.21.15.80:0/3447099828 shutdown_connections 2024-05-10T04:23:50.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.472+0000 7fd8efe00700 1 -- 172.21.15.80:0/3447099828 wait complete. 2024-05-10T04:23:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.475+0000 7fd8efe00700 1 Processor -- start 2024-05-10T04:23:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.475+0000 7fd8efe00700 1 -- start start 2024-05-10T04:23:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.476+0000 7fd8efe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8d4003a00 0x7fd8f00acca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.476+0000 7fd8efe00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8f00ad1e0 0x7fd8f00c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.476+0000 7fd8efe00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8f00c84c0 0x7fd8f00c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.476+0000 7fd8efe00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f00c8e10 con 0x7fd8d4003a00 2024-05-10T04:23:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.476+0000 7fd8efe00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f014fa20 con 0x7fd8f00ad1e0 2024-05-10T04:23:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.476+0000 7fd8efe00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f00ad5f0 con 0x7fd8f00c84c0 2024-05-10T04:23:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.477+0000 7fd8eea00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8d4003a00 0x7fd8f00acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.477+0000 7fd8eea00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8d4003a00 0x7fd8f00acca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55674/0 (socket says 172.21.15.80:55674) 2024-05-10T04:23:50.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.477+0000 7fd8eea00700 1 -- 172.21.15.80:0/3952022290 learned_addr learned my addr 172.21.15.80:0/3952022290 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.477+0000 7fd8eea00700 1 -- 172.21.15.80:0/3952022290 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8f00c84c0 msgr2=0x7fd8f00c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.477+0000 7fd8eea00700 1 --2- 172.21.15.80:0/3952022290 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8f00c84c0 0x7fd8f00c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.477+0000 7fd8eea00700 1 -- 172.21.15.80:0/3952022290 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8f00ad1e0 msgr2=0x7fd8f00c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.477+0000 7fd8eea00700 1 --2- 172.21.15.80:0/3952022290 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8f00ad1e0 0x7fd8f00c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.477+0000 7fd8eea00700 1 -- 172.21.15.80:0/3952022290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f014f810 con 0x7fd8d4003a00 2024-05-10T04:23:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.477+0000 7fd8eea00700 1 --2- 172.21.15.80:0/3952022290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8d4003a00 0x7fd8f00acca0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0015040 tx=0x7fd8e0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.478+0000 7fd8e6a00700 1 -- 172.21.15.80:0/3952022290 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0001290 con 0x7fd8d4003a00 2024-05-10T04:23:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.478+0000 7fd8e6a00700 1 -- 172.21.15.80:0/3952022290 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e001d480 con 0x7fd8d4003a00 2024-05-10T04:23:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.478+0000 7fd8e6a00700 1 -- 172.21.15.80:0/3952022290 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e001d810 con 0x7fd8d4003a00 2024-05-10T04:23:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.478+0000 7fd8efe00700 1 -- 172.21.15.80:0/3952022290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f00aa7a0 con 0x7fd8d4003a00 2024-05-10T04:23:50.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.478+0000 7fd8efe00700 1 -- 172.21.15.80:0/3952022290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f00aad40 con 0x7fd8d4003a00 2024-05-10T04:23:50.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.479+0000 7fd8efe00700 1 -- 172.21.15.80:0/3952022290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f0074af0 con 0x7fd8d4003a00 2024-05-10T04:23:50.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.480+0000 7fd8e6a00700 1 -- 172.21.15.80:0/3952022290 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd8e0019040 con 0x7fd8d4003a00 2024-05-10T04:23:50.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.481+0000 7fd8e6a00700 1 --2- 172.21.15.80:0/3952022290 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd8cc06ac90 0x7fd8cc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:50.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.481+0000 7fd8e6a00700 1 -- 172.21.15.80:0/3952022290 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd8e0089d10 con 0x7fd8d4003a00 2024-05-10T04:23:50.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.481+0000 7fd8e7e00700 1 --2- 172.21.15.80:0/3952022290 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd8cc06ac90 0x7fd8cc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:50.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.482+0000 7fd8e7e00700 1 --2- 172.21.15.80:0/3952022290 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd8cc06ac90 0x7fd8cc06d1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009160 tx=0x7fd8d8006ab0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:50.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.485+0000 7fd8e6a00700 1 -- 172.21.15.80:0/3952022290 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd8e008f020 con 0x7fd8d4003a00 2024-05-10T04:23:50.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.773+0000 7fd8efe00700 1 -- 172.21.15.80:0/3952022290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd8f00cee10 con 0x7fd8d4003a00 2024-05-10T04:23:50.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.778+0000 7fd8e6a00700 1 -- 172.21.15.80:0/3952022290 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd8e0055350 con 0x7fd8d4003a00 2024-05-10T04:23:50.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.780+0000 7fd8efe00700 1 -- 172.21.15.80:0/3952022290 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd8cc06ac90 msgr2=0x7fd8cc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:50.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.780+0000 7fd8efe00700 1 --2- 172.21.15.80:0/3952022290 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd8cc06ac90 0x7fd8cc06d1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009160 tx=0x7fd8d8006ab0 comp rx=0 tx=0).stop 2024-05-10T04:23:50.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.780+0000 7fd8efe00700 1 -- 172.21.15.80:0/3952022290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8d4003a00 msgr2=0x7fd8f00acca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:50.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.780+0000 7fd8efe00700 1 --2- 172.21.15.80:0/3952022290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8d4003a00 0x7fd8f00acca0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0015040 tx=0x7fd8e0001120 comp rx=0 tx=0).stop 2024-05-10T04:23:50.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.780+0000 7fd8efe00700 1 -- 172.21.15.80:0/3952022290 shutdown_connections 2024-05-10T04:23:50.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.780+0000 7fd8efe00700 1 --2- 172.21.15.80:0/3952022290 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd8cc06ac90 0x7fd8cc06d1a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:50.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.780+0000 7fd8efe00700 1 --2- 172.21.15.80:0/3952022290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8d4003a00 0x7fd8f00acca0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:50.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.780+0000 7fd8efe00700 1 --2- 172.21.15.80:0/3952022290 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8f00c84c0 0x7fd8f00c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:50.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.780+0000 7fd8efe00700 1 --2- 172.21.15.80:0/3952022290 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8f00ad1e0 0x7fd8f00c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:50.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.780+0000 7fd8efe00700 1 -- 172.21.15.80:0/3952022290 >> 172.21.15.80:0/3952022290 conn(0x7fd8f00676c0 msgr2=0x7fd8f0161000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:50.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.781+0000 7fd8efe00700 1 -- 172.21.15.80:0/3952022290 shutdown_connections 2024-05-10T04:23:50.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:50.781+0000 7fd8efe00700 1 -- 172.21.15.80:0/3952022290 wait complete. 2024-05-10T04:23:50.809 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:23:51.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.066+0000 7f2809600700 1 Processor -- start 2024-05-10T04:23:51.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.066+0000 7f2809600700 1 -- start start 2024-05-10T04:23:51.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.068+0000 7f2809600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2804161fa0 0x7f28040d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:51.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.068+0000 7f2809600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f28040d0b70 0x7f28040b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:51.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.068+0000 7f2809600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28040d28c0 con 0x7f28040b2f50 2024-05-10T04:23:51.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.068+0000 7f2809600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28040b3360 con 0x7f2804161fa0 2024-05-10T04:23:51.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.068+0000 7f2809600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28040d2ba0 con 0x7f28040d0b70 2024-05-10T04:23:51.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.068+0000 7f2802000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2804161fa0 0x7f28040d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:51.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.068+0000 7f2802000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2804161fa0 0x7f28040d0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55684/0 (socket says 172.21.15.80:55684) 2024-05-10T04:23:51.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.068+0000 7f2802000700 1 -- 172.21.15.80:0/3397288395 learned_addr learned my addr 172.21.15.80:0/3397288395 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:51.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.068+0000 7f2803400700 1 --2- 172.21.15.80:0/3397288395 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f28040d0b70 0x7f28040b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:51.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.068+0000 7f2802000700 1 -- 172.21.15.80:0/3397288395 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f28040d0b70 msgr2=0x7f28040b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:51.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.068+0000 7f2802000700 1 --2- 172.21.15.80:0/3397288395 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f28040d0b70 0x7f28040b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:51.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.068+0000 7f2802000700 1 -- 172.21.15.80:0/3397288395 >> v1:172.21.15.106:6789/0 conn(0x7f28040b2f50 legacy=0x7f28040d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:51.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.069+0000 7f2802000700 1 -- 172.21.15.80:0/3397288395 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28040cf970 con 0x7f2804161fa0 2024-05-10T04:23:51.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.069+0000 7f2802000700 1 --2- 172.21.15.80:0/3397288395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2804161fa0 0x7f28040d0630 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f27f00098f0 tx=0x7f27f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d80b5e8e44b3044 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:51.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.069+0000 7f2801600700 1 -- 172.21.15.80:0/3397288395 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f000b8a0 con 0x7f2804161fa0 2024-05-10T04:23:51.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.069+0000 7f2801600700 1 -- 172.21.15.80:0/3397288395 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f000ba00 con 0x7f2804161fa0 2024-05-10T04:23:51.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.069+0000 7f2801600700 1 -- 172.21.15.80:0/3397288395 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f000bd90 con 0x7f2804161fa0 2024-05-10T04:23:51.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.070+0000 7f2809600700 1 -- 172.21.15.80:0/3397288395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2804161fa0 msgr2=0x7f28040d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:51.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.070+0000 7f2809600700 1 --2- 172.21.15.80:0/3397288395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2804161fa0 0x7f28040d0630 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f27f00098f0 tx=0x7f27f0009c00 comp rx=0 tx=0).stop 2024-05-10T04:23:51.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.070+0000 7f2809600700 1 -- 172.21.15.80:0/3397288395 shutdown_connections 2024-05-10T04:23:51.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.070+0000 7f2809600700 1 --2- 172.21.15.80:0/3397288395 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f28040d0b70 0x7f28040b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:51.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.070+0000 7f2809600700 1 --2- 172.21.15.80:0/3397288395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2804161fa0 0x7f28040d0630 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:51.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.070+0000 7f2809600700 1 -- 172.21.15.80:0/3397288395 >> 172.21.15.80:0/3397288395 conn(0x7f280406c3f0 msgr2=0x7f280406c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:51.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.070+0000 7f2809600700 1 -- 172.21.15.80:0/3397288395 shutdown_connections 2024-05-10T04:23:51.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.070+0000 7f2809600700 1 -- 172.21.15.80:0/3397288395 wait complete. 2024-05-10T04:23:51.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.072+0000 7f2809600700 1 Processor -- start 2024-05-10T04:23:51.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.072+0000 7f2809600700 1 -- start start 2024-05-10T04:23:51.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.074+0000 7f2809600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28040b2f50 0x7f28040c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:51.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.074+0000 7f2809600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28040d0b70 0x7f280415ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:51.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.074+0000 7f2809600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2804161fa0 0x7f280415f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:51.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.074+0000 7f2809600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28040cd160 con 0x7f28040d0b70 2024-05-10T04:23:51.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.074+0000 7f2809600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28040ce080 con 0x7f28040b2f50 2024-05-10T04:23:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.074+0000 7f2809600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28040cae10 con 0x7f2804161fa0 2024-05-10T04:23:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.074+0000 7f2802000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28040d0b70 0x7f280415ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.074+0000 7f2802000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28040d0b70 0x7f280415ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55700/0 (socket says 172.21.15.80:55700) 2024-05-10T04:23:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.074+0000 7f2802000700 1 -- 172.21.15.80:0/2729453913 learned_addr learned my addr 172.21.15.80:0/2729453913 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.074+0000 7f2803400700 1 --2- 172.21.15.80:0/2729453913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2804161fa0 0x7f280415f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.074+0000 7f2802a00700 1 --2- 172.21.15.80:0/2729453913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28040b2f50 0x7f28040c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.074+0000 7f2802000700 1 -- 172.21.15.80:0/2729453913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2804161fa0 msgr2=0x7f280415f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.074+0000 7f2802000700 1 --2- 172.21.15.80:0/2729453913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2804161fa0 0x7f280415f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.074+0000 7f2802000700 1 -- 172.21.15.80:0/2729453913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28040b2f50 msgr2=0x7f28040c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.074+0000 7f2802000700 1 --2- 172.21.15.80:0/2729453913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28040b2f50 0x7f28040c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.074+0000 7f2802000700 1 -- 172.21.15.80:0/2729453913 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f0009550 con 0x7f28040d0b70 2024-05-10T04:23:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.074+0000 7f2803400700 1 --2- 172.21.15.80:0/2729453913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2804161fa0 0x7f280415f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.075+0000 7f2802000700 1 --2- 172.21.15.80:0/2729453913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28040d0b70 0x7f280415ee50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009c40 tx=0x7f27f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:51.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.075+0000 7f27faa00700 1 -- 172.21.15.80:0/2729453913 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00036a0 con 0x7f28040d0b70 2024-05-10T04:23:51.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.075+0000 7f27faa00700 1 -- 172.21.15.80:0/2729453913 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f001e070 con 0x7f28040d0b70 2024-05-10T04:23:51.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.075+0000 7f2809600700 1 -- 172.21.15.80:0/2729453913 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28040cb060 con 0x7f28040d0b70 2024-05-10T04:23:51.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.075+0000 7f27faa00700 1 -- 172.21.15.80:0/2729453913 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0003a40 con 0x7f28040d0b70 2024-05-10T04:23:51.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.075+0000 7f2809600700 1 -- 172.21.15.80:0/2729453913 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28040cb620 con 0x7f28040d0b70 2024-05-10T04:23:51.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.076+0000 7f2809600700 1 -- 172.21.15.80:0/2729453913 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2804074af0 con 0x7f28040d0b70 2024-05-10T04:23:51.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.077+0000 7f27faa00700 1 -- 172.21.15.80:0/2729453913 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f27f0003ba0 con 0x7f28040d0b70 2024-05-10T04:23:51.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.078+0000 7f27faa00700 1 --2- 172.21.15.80:0/2729453913 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f27e406acc0 0x7f27e406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:51.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.078+0000 7f27faa00700 1 -- 172.21.15.80:0/2729453913 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f27f0020070 con 0x7f28040d0b70 2024-05-10T04:23:51.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.078+0000 7f2802a00700 1 --2- 172.21.15.80:0/2729453913 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f27e406acc0 0x7f27e406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:51.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.079+0000 7f2802a00700 1 --2- 172.21.15.80:0/2729453913 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f27e406acc0 0x7f27e406d1d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f27f4000f60 tx=0x7f27f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:51.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.082+0000 7f27faa00700 1 -- 172.21.15.80:0/2729453913 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f27f00559b0 con 0x7f28040d0b70 2024-05-10T04:23:51.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.289+0000 7f2809600700 1 -- 172.21.15.80:0/2729453913 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28040b34a0 con 0x7f28040d0b70 2024-05-10T04:23:51.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.290+0000 7f27faa00700 1 -- 172.21.15.80:0/2729453913 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12389 (secure 0 0 0) 0x7f27f0058fd0 con 0x7f28040d0b70 2024-05-10T04:23:51.291 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:51.291 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":30,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:23:46.582661+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:23:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.292+0000 7f2809600700 1 -- 172.21.15.80:0/2729453913 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f27e406acc0 msgr2=0x7f27e406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.292+0000 7f2809600700 1 --2- 172.21.15.80:0/2729453913 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f27e406acc0 0x7f27e406d1d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f27f4000f60 tx=0x7f27f4009040 comp rx=0 tx=0).stop 2024-05-10T04:23:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.292+0000 7f2809600700 1 -- 172.21.15.80:0/2729453913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28040d0b70 msgr2=0x7f280415ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.292+0000 7f2809600700 1 --2- 172.21.15.80:0/2729453913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28040d0b70 0x7f280415ee50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009c40 tx=0x7f27f0004750 comp rx=0 tx=0).stop 2024-05-10T04:23:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.292+0000 7f2809600700 1 -- 172.21.15.80:0/2729453913 shutdown_connections 2024-05-10T04:23:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.292+0000 7f2809600700 1 --2- 172.21.15.80:0/2729453913 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f27e406acc0 0x7f27e406d1d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.292+0000 7f2809600700 1 --2- 172.21.15.80:0/2729453913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2804161fa0 0x7f280415f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:51.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.292+0000 7f2809600700 1 --2- 172.21.15.80:0/2729453913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28040b2f50 0x7f28040c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:51.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.292+0000 7f2809600700 1 --2- 172.21.15.80:0/2729453913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28040d0b70 0x7f280415ee50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:51.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.292+0000 7f2809600700 1 -- 172.21.15.80:0/2729453913 >> 172.21.15.80:0/2729453913 conn(0x7f280406c3f0 msgr2=0x7f2804160250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:51.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.293+0000 7f2809600700 1 -- 172.21.15.80:0/2729453913 shutdown_connections 2024-05-10T04:23:51.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.293+0000 7f2809600700 1 -- 172.21.15.80:0/2729453913 wait complete. 2024-05-10T04:23:51.322 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:22:26.793377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:23:51.322 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:23:51.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.583+0000 7feb9d400700 1 Processor -- start 2024-05-10T04:23:51.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.583+0000 7feb9d400700 1 -- start start 2024-05-10T04:23:51.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.585+0000 7feb9d400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb980d0c90 0x7feb9815d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:51.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.585+0000 7feb9d400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb980d2e50 con 0x7feb980b6230 2024-05-10T04:23:51.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.585+0000 7feb9d400700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb980d3130 con 0x7feb980b98e0 2024-05-10T04:23:51.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.585+0000 7feb9d400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb980d2c30 con 0x7feb980d0c90 2024-05-10T04:23:51.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.585+0000 7feb97400700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7feb980b6230 0x7feb980d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34374/0 (socket says 172.21.15.80:34374) 2024-05-10T04:23:51.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.585+0000 7feb97400700 1 -- 172.21.15.80:0/18460728 learned_addr learned my addr 172.21.15.80:0/18460728 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:51.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.585+0000 7feb9ca00700 1 --2- 172.21.15.80:0/18460728 >> v2:172.21.15.80:3300/0 conn(0x7feb980d0c90 0x7feb9815d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:51.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.586+0000 7feb96a00700 1 -- 172.21.15.80:0/18460728 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492284991 0 0) 0x7feb980d2e50 con 0x7feb980b6230 2024-05-10T04:23:51.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.586+0000 7feb96a00700 1 -- 172.21.15.80:0/18460728 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb7c0035b0 con 0x7feb980b6230 2024-05-10T04:23:51.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.586+0000 7feb9ca00700 1 -- 172.21.15.80:0/18460728 >> v1:172.21.15.106:6789/0 conn(0x7feb980b98e0 legacy=0x7feb980d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:51.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.586+0000 7feb9ca00700 1 -- 172.21.15.80:0/18460728 >> v1:172.21.15.80:6789/0 conn(0x7feb980b6230 legacy=0x7feb980d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:51.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.586+0000 7feb9ca00700 1 -- 172.21.15.80:0/18460728 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb980d3410 con 0x7feb980d0c90 2024-05-10T04:23:51.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.586+0000 7feb9ca00700 1 --2- 172.21.15.80:0/18460728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb980d0c90 0x7feb9815d7f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feb90009d90 tx=0x7feb9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9385180bbff0b69 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:51.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.586+0000 7feb96a00700 1 -- 172.21.15.80:0/18460728 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9000e070 con 0x7feb980d0c90 2024-05-10T04:23:51.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.587+0000 7feb96a00700 1 -- 172.21.15.80:0/18460728 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9000bb20 con 0x7feb980d0c90 2024-05-10T04:23:51.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.587+0000 7feb96a00700 1 -- 172.21.15.80:0/18460728 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9000be90 con 0x7feb980d0c90 2024-05-10T04:23:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.587+0000 7feb9d400700 1 -- 172.21.15.80:0/18460728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb980d0c90 msgr2=0x7feb9815d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.587+0000 7feb9d400700 1 --2- 172.21.15.80:0/18460728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb980d0c90 0x7feb9815d7f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feb90009d90 tx=0x7feb9000b330 comp rx=0 tx=0).stop 2024-05-10T04:23:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.587+0000 7feb9d400700 1 -- 172.21.15.80:0/18460728 shutdown_connections 2024-05-10T04:23:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.587+0000 7feb9d400700 1 --2- 172.21.15.80:0/18460728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb980d0c90 0x7feb9815d7f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.587+0000 7feb9d400700 1 -- 172.21.15.80:0/18460728 >> 172.21.15.80:0/18460728 conn(0x7feb980676c0 msgr2=0x7feb9806c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.587+0000 7feb9d400700 1 -- 172.21.15.80:0/18460728 shutdown_connections 2024-05-10T04:23:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.587+0000 7feb9d400700 1 -- 172.21.15.80:0/18460728 wait complete. 2024-05-10T04:23:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.590+0000 7feb9d400700 1 Processor -- start 2024-05-10T04:23:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.590+0000 7feb9d400700 1 -- start start 2024-05-10T04:23:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.591+0000 7feb9d400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb980b6230 0x7feb980aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.591+0000 7feb9d400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb980b98e0 0x7feb981e6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.591+0000 7feb9d400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb980d0c90 0x7feb9814caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.591+0000 7feb9d400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb98153250 con 0x7feb980d0c90 2024-05-10T04:23:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.591+0000 7feb9d400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb981e79f0 con 0x7feb980b6230 2024-05-10T04:23:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.591+0000 7feb9d400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb981e7e50 con 0x7feb980b98e0 2024-05-10T04:23:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.591+0000 7feb9ca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb980d0c90 0x7feb9814caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:51.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.591+0000 7feb9ca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb980d0c90 0x7feb9814caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55712/0 (socket says 172.21.15.80:55712) 2024-05-10T04:23:51.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.591+0000 7feb9ca00700 1 -- 172.21.15.80:0/3902373418 learned_addr learned my addr 172.21.15.80:0/3902373418 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:51.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.592+0000 7feb97e00700 1 --2- 172.21.15.80:0/3902373418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb980b6230 0x7feb980aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:51.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.592+0000 7feb97400700 1 --2- 172.21.15.80:0/3902373418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb980b98e0 0x7feb981e6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:51.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.592+0000 7feb9ca00700 1 -- 172.21.15.80:0/3902373418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb980b98e0 msgr2=0x7feb981e6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:51.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.592+0000 7feb9ca00700 1 --2- 172.21.15.80:0/3902373418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb980b98e0 0x7feb981e6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:51.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.592+0000 7feb9ca00700 1 -- 172.21.15.80:0/3902373418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb980b6230 msgr2=0x7feb980aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:51.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.592+0000 7feb9ca00700 1 --2- 172.21.15.80:0/3902373418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb980b6230 0x7feb980aa610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:51.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.592+0000 7feb9ca00700 1 -- 172.21.15.80:0/3902373418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90009a70 con 0x7feb980d0c90 2024-05-10T04:23:51.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.592+0000 7feb97400700 1 --2- 172.21.15.80:0/3902373418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb980b98e0 0x7feb981e6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.592+0000 7feb9ca00700 1 --2- 172.21.15.80:0/3902373418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb980d0c90 0x7feb9814caf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7feb9000b680 tx=0x7feb90004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.592+0000 7feb8fe00700 1 -- 172.21.15.80:0/3902373418 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900048e0 con 0x7feb980d0c90 2024-05-10T04:23:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.593+0000 7feb8fe00700 1 -- 172.21.15.80:0/3902373418 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb90020070 con 0x7feb980d0c90 2024-05-10T04:23:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.593+0000 7feb9d400700 1 -- 172.21.15.80:0/3902373418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb981e7500 con 0x7feb980d0c90 2024-05-10T04:23:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.593+0000 7feb8fe00700 1 -- 172.21.15.80:0/3902373418 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900276c0 con 0x7feb980d0c90 2024-05-10T04:23:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.593+0000 7feb9d400700 1 -- 172.21.15.80:0/3902373418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9814d3d0 con 0x7feb980d0c90 2024-05-10T04:23:51.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.594+0000 7feb9d400700 1 -- 172.21.15.80:0/3902373418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb98074af0 con 0x7feb980d0c90 2024-05-10T04:23:51.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.595+0000 7feb8fe00700 1 -- 172.21.15.80:0/3902373418 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feb90012430 con 0x7feb980d0c90 2024-05-10T04:23:51.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.596+0000 7feb8fe00700 1 --2- 172.21.15.80:0/3902373418 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7feb7806ac90 0x7feb7806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:51.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.596+0000 7feb8fe00700 1 -- 172.21.15.80:0/3902373418 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feb90022070 con 0x7feb980d0c90 2024-05-10T04:23:51.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.596+0000 7feb97e00700 1 --2- 172.21.15.80:0/3902373418 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7feb7806ac90 0x7feb7806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:51.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.597+0000 7feb97e00700 1 --2- 172.21.15.80:0/3902373418 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7feb7806ac90 0x7feb7806d1a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feb88007fd0 tx=0x7feb88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:51.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.600+0000 7feb8fe00700 1 -- 172.21.15.80:0/3902373418 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7feb900565e0 con 0x7feb980d0c90 2024-05-10T04:23:51.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.804+0000 7feb9d400700 1 -- 172.21.15.80:0/3902373418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb980cf0a0 con 0x7feb980d0c90 2024-05-10T04:23:51.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.805+0000 7feb8fe00700 1 -- 172.21.15.80:0/3902373418 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb90059c00 con 0x7feb980d0c90 2024-05-10T04:23:51.806 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-10T04:23:51.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.807+0000 7feb9d400700 1 -- 172.21.15.80:0/3902373418 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7feb7806ac90 msgr2=0x7feb7806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:51.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.807+0000 7feb9d400700 1 --2- 172.21.15.80:0/3902373418 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7feb7806ac90 0x7feb7806d1a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feb88007fd0 tx=0x7feb88009040 comp rx=0 tx=0).stop 2024-05-10T04:23:51.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.807+0000 7feb9d400700 1 -- 172.21.15.80:0/3902373418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb980d0c90 msgr2=0x7feb9814caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:51.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.807+0000 7feb9d400700 1 --2- 172.21.15.80:0/3902373418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb980d0c90 0x7feb9814caf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7feb9000b680 tx=0x7feb90004ad0 comp rx=0 tx=0).stop 2024-05-10T04:23:51.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.807+0000 7feb9d400700 1 -- 172.21.15.80:0/3902373418 shutdown_connections 2024-05-10T04:23:51.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.807+0000 7feb9d400700 1 --2- 172.21.15.80:0/3902373418 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7feb7806ac90 0x7feb7806d1a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:51.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.807+0000 7feb9d400700 1 --2- 172.21.15.80:0/3902373418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb980d0c90 0x7feb9814caf0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:51.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.807+0000 7feb9d400700 1 --2- 172.21.15.80:0/3902373418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb980b6230 0x7feb980aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:51.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.807+0000 7feb9d400700 1 --2- 172.21.15.80:0/3902373418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb980b98e0 0x7feb981e6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:51.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.807+0000 7feb9d400700 1 -- 172.21.15.80:0/3902373418 >> 172.21.15.80:0/3902373418 conn(0x7feb980676c0 msgr2=0x7feb980b80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:51.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.807+0000 7feb9d400700 1 -- 172.21.15.80:0/3902373418 shutdown_connections 2024-05-10T04:23:51.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:51.807+0000 7feb9d400700 1 -- 172.21.15.80:0/3902373418 wait complete. 2024-05-10T04:23:51.836 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T04:23:52.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.094+0000 7f3ae1200700 1 Processor -- start 2024-05-10T04:23:52.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.095+0000 7f3ae1200700 1 -- start start 2024-05-10T04:23:52.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.096+0000 7f3ae1200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3adc162bc0 0x7f3adc0b3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:52.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.096+0000 7f3ae1200700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3adc0d2710 0x7f3adc0d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:52.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.096+0000 7f3ae1200700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3adc15f960 con 0x7f3adc0b5bf0 2024-05-10T04:23:52.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.096+0000 7f3ae1200700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3adc15f680 con 0x7f3adc162bc0 2024-05-10T04:23:52.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.096+0000 7f3ae1200700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3adc1620e0 con 0x7f3adc0d2710 2024-05-10T04:23:52.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.097+0000 7f3ad9e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3adc162bc0 0x7f3adc0b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:52.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.097+0000 7f3ada800700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3adc0d2710 0x7f3adc0d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:52.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.097+0000 7f3ad9e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3adc162bc0 0x7f3adc0b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55726/0 (socket says 172.21.15.80:55726) 2024-05-10T04:23:52.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.097+0000 7f3ad9e00700 1 -- 172.21.15.80:0/852435427 learned_addr learned my addr 172.21.15.80:0/852435427 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:52.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.097+0000 7f3ad3e00700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3adc0b5bf0 0x7f3adc0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:60552/0 (socket says 172.21.15.80:60552) 2024-05-10T04:23:52.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.097+0000 7f3ad9e00700 1 -- 172.21.15.80:0/852435427 >> v2:172.21.15.106:3300/0 conn(0x7f3adc0d2710 msgr2=0x7f3adc0d2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:52.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.097+0000 7f3ad9e00700 1 --2- 172.21.15.80:0/852435427 >> v2:172.21.15.106:3300/0 conn(0x7f3adc0d2710 0x7f3adc0d2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:52.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.097+0000 7f3ad9e00700 1 -- 172.21.15.80:0/852435427 >> v1:172.21.15.106:6789/0 conn(0x7f3adc0b5bf0 legacy=0x7f3adc0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:52.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.097+0000 7f3ad9e00700 1 -- 172.21.15.80:0/852435427 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc1623c0 con 0x7f3adc162bc0 2024-05-10T04:23:52.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.097+0000 7f3ad9e00700 1 --2- 172.21.15.80:0/852435427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3adc162bc0 0x7f3adc0b3100 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3adc0d0660 tx=0x7f3acc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf9280d55874a68 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:52.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.098+0000 7f3ad9400700 1 -- 172.21.15.80:0/852435427 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc011830 con 0x7f3adc162bc0 2024-05-10T04:23:52.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.098+0000 7f3ad9400700 1 -- 172.21.15.80:0/852435427 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc011990 con 0x7f3adc162bc0 2024-05-10T04:23:52.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.098+0000 7f3ad9400700 1 -- 172.21.15.80:0/852435427 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc011d20 con 0x7f3adc162bc0 2024-05-10T04:23:52.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.098+0000 7f3ae1200700 1 -- 172.21.15.80:0/852435427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3adc162bc0 msgr2=0x7f3adc0b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:52.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.098+0000 7f3ae1200700 1 --2- 172.21.15.80:0/852435427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3adc162bc0 0x7f3adc0b3100 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3adc0d0660 tx=0x7f3acc009bd0 comp rx=0 tx=0).stop 2024-05-10T04:23:52.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.098+0000 7f3ae1200700 1 -- 172.21.15.80:0/852435427 shutdown_connections 2024-05-10T04:23:52.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.098+0000 7f3ae1200700 1 --2- 172.21.15.80:0/852435427 >> v2:172.21.15.106:3300/0 conn(0x7f3adc0d2710 0x7f3adc0d2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:52.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.098+0000 7f3ae1200700 1 --2- 172.21.15.80:0/852435427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3adc162bc0 0x7f3adc0b3100 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:52.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.098+0000 7f3ae1200700 1 -- 172.21.15.80:0/852435427 >> 172.21.15.80:0/852435427 conn(0x7f3adc0d0c30 msgr2=0x7f3adc0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:52.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.099+0000 7f3ae1200700 1 -- 172.21.15.80:0/852435427 shutdown_connections 2024-05-10T04:23:52.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.099+0000 7f3ae1200700 1 -- 172.21.15.80:0/852435427 wait complete. 2024-05-10T04:23:52.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.101+0000 7f3ae1200700 1 Processor -- start 2024-05-10T04:23:52.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.101+0000 7f3ae1200700 1 -- start start 2024-05-10T04:23:52.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.102+0000 7f3ae1200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3adc0b5bf0 0x7f3adc158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:52.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.102+0000 7f3ae1200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3adc0d2710 0x7f3adc1f73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:52.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.102+0000 7f3ae1200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3adc162bc0 0x7f3adc1e9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:52.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.102+0000 7f3ae1200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc1f5db0 con 0x7f3adc0d2710 2024-05-10T04:23:52.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.102+0000 7f3ae1200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc159000 con 0x7f3adc0b5bf0 2024-05-10T04:23:52.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.102+0000 7f3ae1200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc158d60 con 0x7f3adc162bc0 2024-05-10T04:23:52.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.103+0000 7f3ad3e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3adc0d2710 0x7f3adc1f73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:52.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.103+0000 7f3ad9e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3adc0b5bf0 0x7f3adc158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:52.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.103+0000 7f3ad3e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3adc0d2710 0x7f3adc1f73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55728/0 (socket says 172.21.15.80:55728) 2024-05-10T04:23:52.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.103+0000 7f3ad3e00700 1 -- 172.21.15.80:0/4155732607 learned_addr learned my addr 172.21.15.80:0/4155732607 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:52.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.103+0000 7f3ada800700 1 --2- 172.21.15.80:0/4155732607 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3adc162bc0 0x7f3adc1e9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:52.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.103+0000 7f3ad3e00700 1 -- 172.21.15.80:0/4155732607 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3adc162bc0 msgr2=0x7f3adc1e9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:52.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.103+0000 7f3ad3e00700 1 --2- 172.21.15.80:0/4155732607 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3adc162bc0 0x7f3adc1e9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:52.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.103+0000 7f3ad3e00700 1 -- 172.21.15.80:0/4155732607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3adc0b5bf0 msgr2=0x7f3adc158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:52.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.103+0000 7f3ad3e00700 1 --2- 172.21.15.80:0/4155732607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3adc0b5bf0 0x7f3adc158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:52.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.103+0000 7f3ad3e00700 1 -- 172.21.15.80:0/4155732607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc009550 con 0x7f3adc0d2710 2024-05-10T04:23:52.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.103+0000 7f3ad3e00700 1 --2- 172.21.15.80:0/4155732607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3adc0d2710 0x7f3adc1f73f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400c460 tx=0x7f3ac400c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:52.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.104+0000 7f3ad2000700 1 -- 172.21.15.80:0/4155732607 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4004ac0 con 0x7f3adc0d2710 2024-05-10T04:23:52.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.104+0000 7f3ad2000700 1 -- 172.21.15.80:0/4155732607 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac4004c20 con 0x7f3adc0d2710 2024-05-10T04:23:52.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.104+0000 7f3ad2000700 1 -- 172.21.15.80:0/4155732607 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac40070d0 con 0x7f3adc0d2710 2024-05-10T04:23:52.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.104+0000 7f3ae1200700 1 -- 172.21.15.80:0/4155732607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3adc159250 con 0x7f3adc0d2710 2024-05-10T04:23:52.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.104+0000 7f3ae1200700 1 -- 172.21.15.80:0/4155732607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3adc159810 con 0x7f3adc0d2710 2024-05-10T04:23:52.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.105+0000 7f3ae1200700 1 -- 172.21.15.80:0/4155732607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3adc1f46e0 con 0x7f3adc0d2710 2024-05-10T04:23:52.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.106+0000 7f3ad2000700 1 -- 172.21.15.80:0/4155732607 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3ac4007230 con 0x7f3adc0d2710 2024-05-10T04:23:52.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.107+0000 7f3ad2000700 1 --2- 172.21.15.80:0/4155732607 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3ab806ac90 0x7f3ab806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:52.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.107+0000 7f3ad2000700 1 -- 172.21.15.80:0/4155732607 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3ac4088820 con 0x7f3adc0d2710 2024-05-10T04:23:52.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.107+0000 7f3ad9e00700 1 --2- 172.21.15.80:0/4155732607 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3ab806ac90 0x7f3ab806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:52.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.108+0000 7f3ad9e00700 1 --2- 172.21.15.80:0/4155732607 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3ab806ac90 0x7f3ab806d1a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3acc014040 tx=0x7f3acc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:52.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.111+0000 7f3ad2000700 1 -- 172.21.15.80:0/4155732607 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3ac4053c20 con 0x7f3adc0d2710 2024-05-10T04:23:52.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.322+0000 7f3ae1200700 1 -- 172.21.15.80:0/4155732607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3adc074af0 con 0x7f3adc0d2710 2024-05-10T04:23:52.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.322+0000 7f3ad2000700 1 -- 172.21.15.80:0/4155732607 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3ac4057240 con 0x7f3adc0d2710 2024-05-10T04:23:52.324 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:52.324 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2024-05-10T04:23:52.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-10T04:23:52.324 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2024-05-10T04:23:52.324 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": ".mgr" 2024-05-10T04:23:52.324 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-10T04:23:52.324 INFO:teuthology.orchestra.run.smithi080.stdout:] 2024-05-10T04:23:52.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.325+0000 7f3ae1200700 1 -- 172.21.15.80:0/4155732607 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3ab806ac90 msgr2=0x7f3ab806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:52.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.325+0000 7f3ae1200700 1 --2- 172.21.15.80:0/4155732607 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3ab806ac90 0x7f3ab806d1a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3acc014040 tx=0x7f3acc008030 comp rx=0 tx=0).stop 2024-05-10T04:23:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.325+0000 7f3ae1200700 1 -- 172.21.15.80:0/4155732607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3adc0d2710 msgr2=0x7f3adc1f73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.325+0000 7f3ae1200700 1 --2- 172.21.15.80:0/4155732607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3adc0d2710 0x7f3adc1f73f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400c460 tx=0x7f3ac400c770 comp rx=0 tx=0).stop 2024-05-10T04:23:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.325+0000 7f3ae1200700 1 -- 172.21.15.80:0/4155732607 shutdown_connections 2024-05-10T04:23:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.325+0000 7f3ae1200700 1 --2- 172.21.15.80:0/4155732607 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f3ab806ac90 0x7f3ab806d1a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.325+0000 7f3ae1200700 1 --2- 172.21.15.80:0/4155732607 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3adc162bc0 0x7f3adc1e9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.325+0000 7f3ae1200700 1 --2- 172.21.15.80:0/4155732607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3adc0b5bf0 0x7f3adc158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.325+0000 7f3ae1200700 1 --2- 172.21.15.80:0/4155732607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3adc0d2710 0x7f3adc1f73f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.325+0000 7f3ae1200700 1 -- 172.21.15.80:0/4155732607 >> 172.21.15.80:0/4155732607 conn(0x7f3adc0d0c30 msgr2=0x7f3adc160150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.325+0000 7f3ae1200700 1 -- 172.21.15.80:0/4155732607 shutdown_connections 2024-05-10T04:23:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.325+0000 7f3ae1200700 1 -- 172.21.15.80:0/4155732607 wait complete. 2024-05-10T04:23:52.352 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T04:23:52.353 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T04:23:52.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.615+0000 7fce0c600700 1 Processor -- start 2024-05-10T04:23:52.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.615+0000 7fce0c600700 1 -- start start 2024-05-10T04:23:52.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.617+0000 7fce0c600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce040cf130 0x7fce04162b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:52.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.617+0000 7fce0c600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fce0406ccb0 0x7fce0415e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:52.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.617+0000 7fce0c600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fce040d0710 0x7fce040d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:52.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.617+0000 7fce0c600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce04162700 con 0x7fce040d0710 2024-05-10T04:23:52.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.617+0000 7fce0c600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce0406d0c0 con 0x7fce0406ccb0 2024-05-10T04:23:52.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.617+0000 7fce0c600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0415e990 con 0x7fce040cf130 2024-05-10T04:23:52.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.617+0000 7fce0a600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fce040d0710 0x7fce040d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:52.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.618+0000 7fce0a600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fce040d0710 0x7fce040d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55740/0 (socket says 172.21.15.80:55740) 2024-05-10T04:23:52.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.618+0000 7fce0a600700 1 -- 172.21.15.80:0/2656533099 learned_addr learned my addr 172.21.15.80:0/2656533099 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:52.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.618+0000 7fce09c00700 1 --2- 172.21.15.80:0/2656533099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce040cf130 0x7fce04162b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:52.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.618+0000 7fce09200700 1 --2- 172.21.15.80:0/2656533099 >> v2:172.21.15.106:3300/0 conn(0x7fce0406ccb0 0x7fce0415e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:52.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.618+0000 7fce0a600700 1 -- 172.21.15.80:0/2656533099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce040cf130 msgr2=0x7fce04162b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:52.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.618+0000 7fce0a600700 1 --2- 172.21.15.80:0/2656533099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce040cf130 0x7fce04162b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:52.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.618+0000 7fce0a600700 1 -- 172.21.15.80:0/2656533099 >> v2:172.21.15.106:3300/0 conn(0x7fce0406ccb0 msgr2=0x7fce0415e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:52.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.618+0000 7fce0a600700 1 --2- 172.21.15.80:0/2656533099 >> v2:172.21.15.106:3300/0 conn(0x7fce0406ccb0 0x7fce0415e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:52.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.618+0000 7fce0a600700 1 -- 172.21.15.80:0/2656533099 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce040cf5f0 con 0x7fce040d0710 2024-05-10T04:23:52.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.618+0000 7fce0a600700 1 --2- 172.21.15.80:0/2656533099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce040d0710 0x7fce040d0b20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fce040d1630 tx=0x7fcdfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f5bfb7f02642fe server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:52.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.618+0000 7fce03e00700 1 -- 172.21.15.80:0/2656533099 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc00e070 con 0x7fce040d0710 2024-05-10T04:23:52.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.618+0000 7fce03e00700 1 -- 172.21.15.80:0/2656533099 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc00b9c0 con 0x7fce040d0710 2024-05-10T04:23:52.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.618+0000 7fce03e00700 1 -- 172.21.15.80:0/2656533099 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc00bd70 con 0x7fce040d0710 2024-05-10T04:23:52.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.619+0000 7fce0c600700 1 -- 172.21.15.80:0/2656533099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce040d0710 msgr2=0x7fce040d0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:52.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.619+0000 7fce0c600700 1 --2- 172.21.15.80:0/2656533099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce040d0710 0x7fce040d0b20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fce040d1630 tx=0x7fcdfc00b330 comp rx=0 tx=0).stop 2024-05-10T04:23:52.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.619+0000 7fce0c600700 1 -- 172.21.15.80:0/2656533099 shutdown_connections 2024-05-10T04:23:52.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.619+0000 7fce0c600700 1 --2- 172.21.15.80:0/2656533099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce040d0710 0x7fce040d0b20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:52.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.619+0000 7fce0c600700 1 --2- 172.21.15.80:0/2656533099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce040cf130 0x7fce04162b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:52.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.619+0000 7fce0c600700 1 --2- 172.21.15.80:0/2656533099 >> v2:172.21.15.106:3300/0 conn(0x7fce0406ccb0 0x7fce0415e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:52.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.619+0000 7fce0c600700 1 -- 172.21.15.80:0/2656533099 >> 172.21.15.80:0/2656533099 conn(0x7fce040b5c00 msgr2=0x7fce040b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:52.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.619+0000 7fce0c600700 1 -- 172.21.15.80:0/2656533099 shutdown_connections 2024-05-10T04:23:52.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.619+0000 7fce0c600700 1 -- 172.21.15.80:0/2656533099 wait complete. 2024-05-10T04:23:52.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.622+0000 7fce0c600700 1 Processor -- start 2024-05-10T04:23:52.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.622+0000 7fce0c600700 1 -- start start 2024-05-10T04:23:52.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.623+0000 7fce0c600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce0406ccb0 0x7fce041581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:52.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.623+0000 7fce0c600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce040d0710 0x7fce04159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:52.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.623+0000 7fce0c600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce040ab0e0 0x7fce0415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:52.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.623+0000 7fce0c600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0415fbd0 con 0x7fce0406ccb0 2024-05-10T04:23:52.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.623+0000 7fce0c600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce041f5f00 con 0x7fce040ab0e0 2024-05-10T04:23:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.623+0000 7fce0c600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0415ada0 con 0x7fce040d0710 2024-05-10T04:23:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.624+0000 7fce09c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce0406ccb0 0x7fce041581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.624+0000 7fce09c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce0406ccb0 0x7fce041581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55752/0 (socket says 172.21.15.80:55752) 2024-05-10T04:23:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.624+0000 7fce09c00700 1 -- 172.21.15.80:0/3989133998 learned_addr learned my addr 172.21.15.80:0/3989133998 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.624+0000 7fce09200700 1 --2- 172.21.15.80:0/3989133998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce040d0710 0x7fce04159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.624+0000 7fce0a600700 1 --2- 172.21.15.80:0/3989133998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce040ab0e0 0x7fce0415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.624+0000 7fce09c00700 1 -- 172.21.15.80:0/3989133998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce040d0710 msgr2=0x7fce04159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.624+0000 7fce09c00700 1 --2- 172.21.15.80:0/3989133998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce040d0710 0x7fce04159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.624+0000 7fce09c00700 1 -- 172.21.15.80:0/3989133998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce040ab0e0 msgr2=0x7fce0415a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.624+0000 7fce09c00700 1 --2- 172.21.15.80:0/3989133998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce040ab0e0 0x7fce0415a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.624+0000 7fce09c00700 1 -- 172.21.15.80:0/3989133998 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc009b30 con 0x7fce0406ccb0 2024-05-10T04:23:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.624+0000 7fce09c00700 1 --2- 172.21.15.80:0/3989133998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce0406ccb0 0x7fce041581c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800d800 tx=0x7fcdf800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.624+0000 7fce01600700 1 -- 172.21.15.80:0/3989133998 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf80125f0 con 0x7fce0406ccb0 2024-05-10T04:23:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.624+0000 7fce01600700 1 -- 172.21.15.80:0/3989133998 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf8012750 con 0x7fce0406ccb0 2024-05-10T04:23:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.624+0000 7fce0c600700 1 -- 172.21.15.80:0/3989133998 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce041f6150 con 0x7fce0406ccb0 2024-05-10T04:23:52.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.625+0000 7fce01600700 1 -- 172.21.15.80:0/3989133998 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8012b00 con 0x7fce0406ccb0 2024-05-10T04:23:52.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.625+0000 7fce0c600700 1 -- 172.21.15.80:0/3989133998 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce041f6710 con 0x7fce0406ccb0 2024-05-10T04:23:52.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.626+0000 7fce0c600700 1 -- 172.21.15.80:0/3989133998 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce040732b0 con 0x7fce0406ccb0 2024-05-10T04:23:52.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.627+0000 7fce01600700 1 -- 172.21.15.80:0/3989133998 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcdf8012c60 con 0x7fce0406ccb0 2024-05-10T04:23:52.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.628+0000 7fce01600700 1 --2- 172.21.15.80:0/3989133998 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcde406acc0 0x7fcde406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:52.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.628+0000 7fce01600700 1 -- 172.21.15.80:0/3989133998 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcdf8089400 con 0x7fce0406ccb0 2024-05-10T04:23:52.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.628+0000 7fce09200700 1 --2- 172.21.15.80:0/3989133998 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcde406acc0 0x7fcde406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:52.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.629+0000 7fce09200700 1 --2- 172.21.15.80:0/3989133998 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcde406acc0 0x7fcde406d1d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fce040b8e10 tx=0x7fcdf0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:52.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.632+0000 7fce01600700 1 -- 172.21.15.80:0/3989133998 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcdf8054890 con 0x7fce0406ccb0 2024-05-10T04:23:52.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:52.838+0000 7fce0c600700 1 -- 172.21.15.80:0/3989133998 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fce04074af0 con 0x7fce0406ccb0 2024-05-10T04:23:53.075 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:23:53.080 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:23:53.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.404+0000 7fce01600700 1 -- 172.21.15.80:0/3989133998 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcdf8057eb0 con 0x7fce0406ccb0 2024-05-10T04:23:53.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.409+0000 7fce0c600700 1 -- 172.21.15.80:0/3989133998 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcde406acc0 msgr2=0x7fcde406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:53.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.409+0000 7fce0c600700 1 --2- 172.21.15.80:0/3989133998 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcde406acc0 0x7fcde406d1d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fce040b8e10 tx=0x7fcdf0008040 comp rx=0 tx=0).stop 2024-05-10T04:23:53.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.409+0000 7fce0c600700 1 -- 172.21.15.80:0/3989133998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce0406ccb0 msgr2=0x7fce041581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:53.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.409+0000 7fce0c600700 1 --2- 172.21.15.80:0/3989133998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce0406ccb0 0x7fce041581c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800d800 tx=0x7fcdf800dbc0 comp rx=0 tx=0).stop 2024-05-10T04:23:53.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.410+0000 7fce0c600700 1 -- 172.21.15.80:0/3989133998 shutdown_connections 2024-05-10T04:23:53.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.410+0000 7fce0c600700 1 --2- 172.21.15.80:0/3989133998 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcde406acc0 0x7fcde406d1d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:53.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.410+0000 7fce0c600700 1 --2- 172.21.15.80:0/3989133998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce0406ccb0 0x7fce041581c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:53.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.410+0000 7fce0c600700 1 --2- 172.21.15.80:0/3989133998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce040ab0e0 0x7fce0415a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:53.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.410+0000 7fce0c600700 1 --2- 172.21.15.80:0/3989133998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce040d0710 0x7fce04159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:53.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.410+0000 7fce0c600700 1 -- 172.21.15.80:0/3989133998 >> 172.21.15.80:0/3989133998 conn(0x7fce040b5c00 msgr2=0x7fce040b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:53.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.411+0000 7fce0c600700 1 -- 172.21.15.80:0/3989133998 shutdown_connections 2024-05-10T04:23:53.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.411+0000 7fce0c600700 1 -- 172.21.15.80:0/3989133998 wait complete. 2024-05-10T04:23:53.414 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2024-05-10T04:23:53.441 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T04:23:53.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.711+0000 7f6a63e00700 1 Processor -- start 2024-05-10T04:23:53.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.711+0000 7f6a63e00700 1 -- start start 2024-05-10T04:23:53.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.713+0000 7f6a63e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a5c0d0dc0 0x7f6a5c0d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:53.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.713+0000 7f6a63e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a5c0d08b0 0x7f6a5c162ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:53.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.713+0000 7f6a63e00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c06c5c0 con 0x7f6a5c0d11d0 2024-05-10T04:23:53.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.713+0000 7f6a63e00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5c06d9c0 con 0x7f6a5c0d08b0 2024-05-10T04:23:53.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.713+0000 7f6a63e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c06c3c0 con 0x7f6a5c0d0dc0 2024-05-10T04:23:53.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.713+0000 7f6a60a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a5c0d08b0 0x7f6a5c162ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:53.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.713+0000 7f6a60a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a5c0d08b0 0x7f6a5c162ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59768/0 (socket says 172.21.15.80:59768) 2024-05-10T04:23:53.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.713+0000 7f6a60a00700 1 -- 172.21.15.80:0/398342017 learned_addr learned my addr 172.21.15.80:0/398342017 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:53.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.713+0000 7f6a60a00700 1 -- 172.21.15.80:0/398342017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a5c0d0dc0 msgr2=0x7f6a5c0d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:53.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.713+0000 7f6a61400700 1 --2- 172.21.15.80:0/398342017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a5c0d0dc0 0x7f6a5c0d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:53.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.714+0000 7f6a60a00700 1 --2- 172.21.15.80:0/398342017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a5c0d0dc0 0x7f6a5c0d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:53.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.714+0000 7f6a60a00700 1 -- 172.21.15.80:0/398342017 >> v1:172.21.15.106:6789/0 conn(0x7f6a5c0d11d0 legacy=0x7f6a5c163000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:53.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.714+0000 7f6a60a00700 1 -- 172.21.15.80:0/398342017 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c06c0e0 con 0x7f6a5c0d08b0 2024-05-10T04:23:53.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.714+0000 7f6a61400700 1 --2- 172.21.15.80:0/398342017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a5c0d0dc0 0x7f6a5c0d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:53.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.714+0000 7f6a60a00700 1 --2- 172.21.15.80:0/398342017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c0d08b0 0x7f6a5c162ac0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6a480098f0 tx=0x7f6a48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf716c7c615ae9f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:53.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.714+0000 7f6a5be00700 1 -- 172.21.15.80:0/398342017 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48004230 con 0x7f6a5c0d08b0 2024-05-10T04:23:53.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.714+0000 7f6a5be00700 1 -- 172.21.15.80:0/398342017 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a48004390 con 0x7f6a5c0d08b0 2024-05-10T04:23:53.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.714+0000 7f6a5be00700 1 -- 172.21.15.80:0/398342017 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a480036a0 con 0x7f6a5c0d08b0 2024-05-10T04:23:53.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.715+0000 7f6a63e00700 1 -- 172.21.15.80:0/398342017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c0d08b0 msgr2=0x7f6a5c162ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:53.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.715+0000 7f6a63e00700 1 --2- 172.21.15.80:0/398342017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c0d08b0 0x7f6a5c162ac0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6a480098f0 tx=0x7f6a48009c00 comp rx=0 tx=0).stop 2024-05-10T04:23:53.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.715+0000 7f6a63e00700 1 -- 172.21.15.80:0/398342017 shutdown_connections 2024-05-10T04:23:53.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.715+0000 7f6a63e00700 1 --2- 172.21.15.80:0/398342017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a5c0d0dc0 0x7f6a5c0d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:53.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.715+0000 7f6a63e00700 1 --2- 172.21.15.80:0/398342017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c0d08b0 0x7f6a5c162ac0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:53.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.715+0000 7f6a63e00700 1 -- 172.21.15.80:0/398342017 >> 172.21.15.80:0/398342017 conn(0x7f6a5c0ce6a0 msgr2=0x7f6a5c0ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:53.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.715+0000 7f6a63e00700 1 -- 172.21.15.80:0/398342017 shutdown_connections 2024-05-10T04:23:53.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.715+0000 7f6a63e00700 1 -- 172.21.15.80:0/398342017 wait complete. 2024-05-10T04:23:53.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.717+0000 7f6a63e00700 1 Processor -- start 2024-05-10T04:23:53.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.717+0000 7f6a63e00700 1 -- start start 2024-05-10T04:23:53.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.719+0000 7f6a63e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c0d08b0 0x7f6a5c0c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.719+0000 7f6a63e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a5c0d0dc0 0x7f6a5c1f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.719+0000 7f6a63e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a5c0d11d0 0x7f6a5c151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.719+0000 7f6a63e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0c67a0 con 0x7f6a5c0d08b0 2024-05-10T04:23:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.719+0000 7f6a63e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c152820 con 0x7f6a5c0d0dc0 2024-05-10T04:23:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.719+0000 7f6a63e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0c69a0 con 0x7f6a5c0d11d0 2024-05-10T04:23:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.719+0000 7f6a61400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c0d08b0 0x7f6a5c0c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.719+0000 7f6a61400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c0d08b0 0x7f6a5c0c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59770/0 (socket says 172.21.15.80:59770) 2024-05-10T04:23:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.719+0000 7f6a61400700 1 -- 172.21.15.80:0/3265527837 learned_addr learned my addr 172.21.15.80:0/3265527837 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.719+0000 7f6a60a00700 1 --2- 172.21.15.80:0/3265527837 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a5c0d0dc0 0x7f6a5c1f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.719+0000 7f6a61e00700 1 --2- 172.21.15.80:0/3265527837 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a5c0d11d0 0x7f6a5c151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.720+0000 7f6a61400700 1 -- 172.21.15.80:0/3265527837 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a5c0d11d0 msgr2=0x7f6a5c151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.720+0000 7f6a61400700 1 --2- 172.21.15.80:0/3265527837 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a5c0d11d0 0x7f6a5c151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.720+0000 7f6a61400700 1 -- 172.21.15.80:0/3265527837 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a5c0d0dc0 msgr2=0x7f6a5c1f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:53.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.720+0000 7f6a61400700 1 --2- 172.21.15.80:0/3265527837 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a5c0d0dc0 0x7f6a5c1f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:53.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.720+0000 7f6a61400700 1 -- 172.21.15.80:0/3265527837 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a48009550 con 0x7f6a5c0d08b0 2024-05-10T04:23:53.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.720+0000 7f6a61e00700 1 --2- 172.21.15.80:0/3265527837 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a5c0d11d0 0x7f6a5c151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:53.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.720+0000 7f6a61400700 1 --2- 172.21.15.80:0/3265527837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c0d08b0 0x7f6a5c0c7c90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000c7f0 tx=0x7f6a5000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:53.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.720+0000 7f6a59600700 1 -- 172.21.15.80:0/3265527837 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a50005c20 con 0x7f6a5c0d08b0 2024-05-10T04:23:53.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.720+0000 7f6a59600700 1 -- 172.21.15.80:0/3265527837 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a50005d80 con 0x7f6a5c0d08b0 2024-05-10T04:23:53.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.720+0000 7f6a63e00700 1 -- 172.21.15.80:0/3265527837 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5c0c6bf0 con 0x7f6a5c0d08b0 2024-05-10T04:23:53.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.720+0000 7f6a59600700 1 -- 172.21.15.80:0/3265527837 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a50011840 con 0x7f6a5c0d08b0 2024-05-10T04:23:53.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.720+0000 7f6a63e00700 1 -- 172.21.15.80:0/3265527837 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c0c71b0 con 0x7f6a5c0d08b0 2024-05-10T04:23:53.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.721+0000 7f6a63e00700 1 -- 172.21.15.80:0/3265527837 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5c0c7ae0 con 0x7f6a5c0d08b0 2024-05-10T04:23:53.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.723+0000 7f6a59600700 1 -- 172.21.15.80:0/3265527837 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6a500119a0 con 0x7f6a5c0d08b0 2024-05-10T04:23:53.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.723+0000 7f6a59600700 1 --2- 172.21.15.80:0/3265527837 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a3c06ac90 0x7f6a3c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:53.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.724+0000 7f6a59600700 1 -- 172.21.15.80:0/3265527837 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6a500892b0 con 0x7f6a5c0d08b0 2024-05-10T04:23:53.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.724+0000 7f6a60a00700 1 --2- 172.21.15.80:0/3265527837 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a3c06ac90 0x7f6a3c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:53.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.725+0000 7f6a60a00700 1 --2- 172.21.15.80:0/3265527837 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a3c06ac90 0x7f6a3c06d1a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c06f370 tx=0x7f6a48008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:53.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.727+0000 7f6a59600700 1 -- 172.21.15.80:0/3265527837 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6a50054660 con 0x7f6a5c0d08b0 2024-05-10T04:23:53.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:53.932+0000 7f6a63e00700 1 -- 172.21.15.80:0/3265527837 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6a5c0b3510 con 0x7f6a5c0d08b0 2024-05-10T04:23:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.412+0000 7f6a59600700 1 -- 172.21.15.80:0/3265527837 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6a5001e0d0 con 0x7f6a5c0d08b0 2024-05-10T04:23:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.417+0000 7f6a63e00700 1 -- 172.21.15.80:0/3265527837 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a3c06ac90 msgr2=0x7f6a3c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.417+0000 7f6a63e00700 1 --2- 172.21.15.80:0/3265527837 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a3c06ac90 0x7f6a3c06d1a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c06f370 tx=0x7f6a48008030 comp rx=0 tx=0).stop 2024-05-10T04:23:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.417+0000 7f6a63e00700 1 -- 172.21.15.80:0/3265527837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c0d08b0 msgr2=0x7f6a5c0c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:54.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.417+0000 7f6a63e00700 1 --2- 172.21.15.80:0/3265527837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c0d08b0 0x7f6a5c0c7c90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000c7f0 tx=0x7f6a5000cb00 comp rx=0 tx=0).stop 2024-05-10T04:23:54.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.418+0000 7f6a63e00700 1 -- 172.21.15.80:0/3265527837 shutdown_connections 2024-05-10T04:23:54.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.418+0000 7f6a63e00700 1 --2- 172.21.15.80:0/3265527837 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6a3c06ac90 0x7f6a3c06d1a0 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c06f370 tx=0x7f6a48008030 comp rx=0 tx=0).stop 2024-05-10T04:23:54.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.418+0000 7f6a63e00700 1 --2- 172.21.15.80:0/3265527837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c0d08b0 0x7f6a5c0c7c90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:54.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.418+0000 7f6a63e00700 1 --2- 172.21.15.80:0/3265527837 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a5c0d11d0 0x7f6a5c151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:54.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.418+0000 7f6a63e00700 1 --2- 172.21.15.80:0/3265527837 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a5c0d0dc0 0x7f6a5c1f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:54.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.418+0000 7f6a63e00700 1 -- 172.21.15.80:0/3265527837 >> 172.21.15.80:0/3265527837 conn(0x7f6a5c0ce6a0 msgr2=0x7f6a5c162140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:54.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.418+0000 7f6a63e00700 1 -- 172.21.15.80:0/3265527837 shutdown_connections 2024-05-10T04:23:54.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.419+0000 7f6a63e00700 1 -- 172.21.15.80:0/3265527837 wait complete. 2024-05-10T04:23:54.424 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2024-05-10T04:23:54.461 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T04:23:54.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.724+0000 7fdae6a00700 1 Processor -- start 2024-05-10T04:23:54.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.724+0000 7fdae6a00700 1 -- start start 2024-05-10T04:23:54.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.726+0000 7fdae6a00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdae015ea10 0x7fdae006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:54.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.726+0000 7fdae6a00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae006c5f0 con 0x7fdae00b5c90 2024-05-10T04:23:54.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.726+0000 7fdae6a00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae0162850 con 0x7fdae0158c70 2024-05-10T04:23:54.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.726+0000 7fdae6a00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae015ee20 con 0x7fdae015ea10 2024-05-10T04:23:54.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.726+0000 7fdae4a00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdae00b5c90 0x7fdae00b60a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49142/0 (socket says 172.21.15.80:49142) 2024-05-10T04:23:54.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.726+0000 7fdae4a00700 1 -- 172.21.15.80:0/872410235 learned_addr learned my addr 172.21.15.80:0/872410235 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.726+0000 7fdadf400700 1 --2- 172.21.15.80:0/872410235 >> v2:172.21.15.106:3300/0 conn(0x7fdae015ea10 0x7fdae006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.726+0000 7fdadea00700 1 -- 172.21.15.80:0/872410235 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235923235 0 0) 0x7fdae006c5f0 con 0x7fdae00b5c90 2024-05-10T04:23:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.726+0000 7fdadea00700 1 -- 172.21.15.80:0/872410235 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac40035b0 con 0x7fdae00b5c90 2024-05-10T04:23:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.726+0000 7fdadea00700 1 -- 172.21.15.80:0/872410235 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759953844 0 0) 0x7fdae0162850 con 0x7fdae0158c70 2024-05-10T04:23:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.727+0000 7fdadea00700 1 -- 172.21.15.80:0/872410235 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdae006c5f0 con 0x7fdae0158c70 2024-05-10T04:23:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.727+0000 7fdadf400700 1 -- 172.21.15.80:0/872410235 >> v1:172.21.15.106:6789/0 conn(0x7fdae0158c70 legacy=0x7fdae0162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.727+0000 7fdadf400700 1 -- 172.21.15.80:0/872410235 >> v1:172.21.15.80:6789/0 conn(0x7fdae00b5c90 legacy=0x7fdae00b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.727+0000 7fdadf400700 1 -- 172.21.15.80:0/872410235 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae0162b30 con 0x7fdae015ea10 2024-05-10T04:23:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.727+0000 7fdadf400700 1 --2- 172.21.15.80:0/872410235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdae015ea10 0x7fdae006ca80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009840 tx=0x7fdacc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be30729a44a90070 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.727+0000 7fdadea00700 1 -- 172.21.15.80:0/872410235 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc011830 con 0x7fdae015ea10 2024-05-10T04:23:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.727+0000 7fdadea00700 1 -- 172.21.15.80:0/872410235 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc011990 con 0x7fdae015ea10 2024-05-10T04:23:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.727+0000 7fdadea00700 1 -- 172.21.15.80:0/872410235 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc011d00 con 0x7fdae015ea10 2024-05-10T04:23:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.728+0000 7fdae6a00700 1 -- 172.21.15.80:0/872410235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdae015ea10 msgr2=0x7fdae006ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.728+0000 7fdae6a00700 1 --2- 172.21.15.80:0/872410235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdae015ea10 0x7fdae006ca80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009840 tx=0x7fdacc009b50 comp rx=0 tx=0).stop 2024-05-10T04:23:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.728+0000 7fdae6a00700 1 -- 172.21.15.80:0/872410235 shutdown_connections 2024-05-10T04:23:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.728+0000 7fdae6a00700 1 --2- 172.21.15.80:0/872410235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdae015ea10 0x7fdae006ca80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.728+0000 7fdae6a00700 1 -- 172.21.15.80:0/872410235 >> 172.21.15.80:0/872410235 conn(0x7fdae00d0d30 msgr2=0x7fdae00d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.728+0000 7fdae6a00700 1 -- 172.21.15.80:0/872410235 shutdown_connections 2024-05-10T04:23:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.728+0000 7fdae6a00700 1 -- 172.21.15.80:0/872410235 wait complete. 2024-05-10T04:23:54.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.730+0000 7fdae6a00700 1 Processor -- start 2024-05-10T04:23:54.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.731+0000 7fdae6a00700 1 -- start start 2024-05-10T04:23:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.732+0000 7fdae6a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdae00b5c90 0x7fdae00c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.732+0000 7fdae6a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdae0158c70 0x7fdae0142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.732+0000 7fdae6a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdae015ea10 0x7fdae01552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.732+0000 7fdae6a00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae01432a0 con 0x7fdae0158c70 2024-05-10T04:23:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.732+0000 7fdae6a00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae0152f50 con 0x7fdae00b5c90 2024-05-10T04:23:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.732+0000 7fdae6a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00c9520 con 0x7fdae015ea10 2024-05-10T04:23:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.732+0000 7fdadf400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdae0158c70 0x7fdae0142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.732+0000 7fdadf400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdae0158c70 0x7fdae0142c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59774/0 (socket says 172.21.15.80:59774) 2024-05-10T04:23:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.732+0000 7fdadf400700 1 -- 172.21.15.80:0/2988784226 learned_addr learned my addr 172.21.15.80:0/2988784226 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.733+0000 7fdadfe00700 1 --2- 172.21.15.80:0/2988784226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdae00b5c90 0x7fdae00c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.733+0000 7fdae4a00700 1 --2- 172.21.15.80:0/2988784226 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdae015ea10 0x7fdae01552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.733+0000 7fdadf400700 1 -- 172.21.15.80:0/2988784226 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdae015ea10 msgr2=0x7fdae01552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.733+0000 7fdadf400700 1 --2- 172.21.15.80:0/2988784226 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdae015ea10 0x7fdae01552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.733+0000 7fdadf400700 1 -- 172.21.15.80:0/2988784226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdae00b5c90 msgr2=0x7fdae00c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.733+0000 7fdadf400700 1 --2- 172.21.15.80:0/2988784226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdae00b5c90 0x7fdae00c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.733+0000 7fdadf400700 1 -- 172.21.15.80:0/2988784226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc0094a0 con 0x7fdae0158c70 2024-05-10T04:23:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.733+0000 7fdadfe00700 1 --2- 172.21.15.80:0/2988784226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdae00b5c90 0x7fdae00c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.733+0000 7fdadf400700 1 --2- 172.21.15.80:0/2988784226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdae0158c70 0x7fdae0142c60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009b90 tx=0x7fdacc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:54.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.733+0000 7fdad7e00700 1 -- 172.21.15.80:0/2988784226 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc01a860 con 0x7fdae0158c70 2024-05-10T04:23:54.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.734+0000 7fdad7e00700 1 -- 172.21.15.80:0/2988784226 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc01a9c0 con 0x7fdae0158c70 2024-05-10T04:23:54.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.734+0000 7fdae6a00700 1 -- 172.21.15.80:0/2988784226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae01531a0 con 0x7fdae0158c70 2024-05-10T04:23:54.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.734+0000 7fdad7e00700 1 -- 172.21.15.80:0/2988784226 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc01ad30 con 0x7fdae0158c70 2024-05-10T04:23:54.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.734+0000 7fdae6a00700 1 -- 172.21.15.80:0/2988784226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae01538c0 con 0x7fdae0158c70 2024-05-10T04:23:54.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.735+0000 7fdae6a00700 1 -- 172.21.15.80:0/2988784226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae00732b0 con 0x7fdae0158c70 2024-05-10T04:23:54.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.736+0000 7fdad7e00700 1 -- 172.21.15.80:0/2988784226 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdacc022070 con 0x7fdae0158c70 2024-05-10T04:23:54.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.738+0000 7fdad7e00700 1 --2- 172.21.15.80:0/2988784226 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdac006ac90 0x7fdac006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:54.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.738+0000 7fdad7e00700 1 -- 172.21.15.80:0/2988784226 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fdacc08a820 con 0x7fdae0158c70 2024-05-10T04:23:54.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.738+0000 7fdadfe00700 1 --2- 172.21.15.80:0/2988784226 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdac006ac90 0x7fdac006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:54.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.739+0000 7fdadfe00700 1 --2- 172.21.15.80:0/2988784226 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdac006ac90 0x7fdac006d1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdad00011e0 tx=0x7fdad0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:54.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.742+0000 7fdad7e00700 1 -- 172.21.15.80:0/2988784226 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdacc055af0 con 0x7fdae0158c70 2024-05-10T04:23:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.991+0000 7fdae6a00700 1 -- 172.21.15.80:0/2988784226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdae00d2240 con 0x7fdae0158c70 2024-05-10T04:23:55.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:54.999+0000 7fdad7e00700 1 -- 172.21.15.80:0/2988784226 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdacc0150c0 con 0x7fdae0158c70 2024-05-10T04:23:55.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.005+0000 7fdae6a00700 1 -- 172.21.15.80:0/2988784226 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdac006ac90 msgr2=0x7fdac006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:55.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.005+0000 7fdae6a00700 1 --2- 172.21.15.80:0/2988784226 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdac006ac90 0x7fdac006d1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdad00011e0 tx=0x7fdad0009040 comp rx=0 tx=0).stop 2024-05-10T04:23:55.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.005+0000 7fdae6a00700 1 -- 172.21.15.80:0/2988784226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdae0158c70 msgr2=0x7fdae0142c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:55.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.005+0000 7fdae6a00700 1 --2- 172.21.15.80:0/2988784226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdae0158c70 0x7fdae0142c60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009b90 tx=0x7fdacc004750 comp rx=0 tx=0).stop 2024-05-10T04:23:55.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.006+0000 7fdae6a00700 1 -- 172.21.15.80:0/2988784226 shutdown_connections 2024-05-10T04:23:55.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.006+0000 7fdae6a00700 1 --2- 172.21.15.80:0/2988784226 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fdac006ac90 0x7fdac006d1a0 secure :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdad00011e0 tx=0x7fdad0009040 comp rx=0 tx=0).stop 2024-05-10T04:23:55.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.006+0000 7fdae6a00700 1 --2- 172.21.15.80:0/2988784226 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdae015ea10 0x7fdae01552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.006+0000 7fdae6a00700 1 --2- 172.21.15.80:0/2988784226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdae00b5c90 0x7fdae00c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.006+0000 7fdae6a00700 1 --2- 172.21.15.80:0/2988784226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdae0158c70 0x7fdae0142c60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.006+0000 7fdae6a00700 1 -- 172.21.15.80:0/2988784226 >> 172.21.15.80:0/2988784226 conn(0x7fdae00d0d30 msgr2=0x7fdae00b4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:55.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.010+0000 7fdae6a00700 1 -- 172.21.15.80:0/2988784226 shutdown_connections 2024-05-10T04:23:55.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.011+0000 7fdae6a00700 1 -- 172.21.15.80:0/2988784226 wait complete. 2024-05-10T04:23:55.019 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 4 and data pool 5 2024-05-10T04:23:55.051 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:23:55.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.309+0000 7fea41800700 1 Processor -- start 2024-05-10T04:23:55.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.310+0000 7fea41800700 1 -- start start 2024-05-10T04:23:55.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.311+0000 7fea41800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea3c0b2f50 0x7fea3c161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:55.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.311+0000 7fea41800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fea3c0d3030 0x7fea3c0d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:55.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.311+0000 7fea41800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3c0d28c0 con 0x7fea3c0d0630 2024-05-10T04:23:55.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.311+0000 7fea41800700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea3c0b3360 con 0x7fea3c0d3030 2024-05-10T04:23:55.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.311+0000 7fea41800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c1624e0 con 0x7fea3c0b2f50 2024-05-10T04:23:55.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.312+0000 7fea33e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fea3c0d3030 0x7fea3c0d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:55.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.312+0000 7fea3b400700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fea3c0d0630 0x7fea3c0d0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49152/0 (socket says 172.21.15.80:49152) 2024-05-10T04:23:55.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.312+0000 7fea3b400700 1 -- 172.21.15.80:0/3217010674 learned_addr learned my addr 172.21.15.80:0/3217010674 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:55.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.312+0000 7fea3aa00700 1 --2- 172.21.15.80:0/3217010674 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea3c0b2f50 0x7fea3c161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:55.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.312+0000 7fea33e00700 1 -- 172.21.15.80:0/3217010674 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea3c0b2f50 msgr2=0x7fea3c161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:55.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.312+0000 7fea33e00700 1 --2- 172.21.15.80:0/3217010674 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea3c0b2f50 0x7fea3c161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.312+0000 7fea33e00700 1 -- 172.21.15.80:0/3217010674 >> v1:172.21.15.80:6789/0 conn(0x7fea3c0d0630 legacy=0x7fea3c0d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:55.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.312+0000 7fea33e00700 1 -- 172.21.15.80:0/3217010674 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c0d2ba0 con 0x7fea3c0d3030 2024-05-10T04:23:55.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.312+0000 7fea3a000700 1 -- 172.21.15.80:0/3217010674 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486028786 0 0) 0x7fea3c0d28c0 con 0x7fea3c0d0630 2024-05-10T04:23:55.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.313+0000 7fea33e00700 1 --2- 172.21.15.80:0/3217010674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea3c0d3030 0x7fea3c0d3440 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fea24009840 tx=0x7fea24009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc25bce452a9af0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:55.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.313+0000 7fea3a000700 1 -- 172.21.15.80:0/3217010674 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24011830 con 0x7fea3c0d3030 2024-05-10T04:23:55.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.313+0000 7fea3a000700 1 -- 172.21.15.80:0/3217010674 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea24011990 con 0x7fea3c0d3030 2024-05-10T04:23:55.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.313+0000 7fea3a000700 1 -- 172.21.15.80:0/3217010674 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24011d20 con 0x7fea3c0d3030 2024-05-10T04:23:55.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.313+0000 7fea41800700 1 -- 172.21.15.80:0/3217010674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea3c0d3030 msgr2=0x7fea3c0d3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:55.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.313+0000 7fea41800700 1 --2- 172.21.15.80:0/3217010674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea3c0d3030 0x7fea3c0d3440 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fea24009840 tx=0x7fea24009b50 comp rx=0 tx=0).stop 2024-05-10T04:23:55.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.314+0000 7fea41800700 1 -- 172.21.15.80:0/3217010674 shutdown_connections 2024-05-10T04:23:55.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.314+0000 7fea41800700 1 --2- 172.21.15.80:0/3217010674 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea3c0b2f50 0x7fea3c161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.314+0000 7fea41800700 1 --2- 172.21.15.80:0/3217010674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea3c0d3030 0x7fea3c0d3440 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.314+0000 7fea41800700 1 -- 172.21.15.80:0/3217010674 >> 172.21.15.80:0/3217010674 conn(0x7fea3c06c3f0 msgr2=0x7fea3c06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:55.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.314+0000 7fea41800700 1 -- 172.21.15.80:0/3217010674 shutdown_connections 2024-05-10T04:23:55.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.314+0000 7fea41800700 1 -- 172.21.15.80:0/3217010674 wait complete. 2024-05-10T04:23:55.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.316+0000 7fea41800700 1 Processor -- start 2024-05-10T04:23:55.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.316+0000 7fea41800700 1 -- start start 2024-05-10T04:23:55.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.317+0000 7fea41800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea3c0b2f50 0x7fea3c0c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:55.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.317+0000 7fea41800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea3c0d0630 0x7fea3c14a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:55.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.317+0000 7fea41800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea3c0d3030 0x7fea3c14cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:55.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.317+0000 7fea41800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c0cb730 con 0x7fea3c0b2f50 2024-05-10T04:23:55.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.317+0000 7fea41800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c14aee0 con 0x7fea3c0d0630 2024-05-10T04:23:55.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.317+0000 7fea41800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c0ccf90 con 0x7fea3c0d3030 2024-05-10T04:23:55.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.318+0000 7fea3aa00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea3c0b2f50 0x7fea3c0c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:55.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.318+0000 7fea3aa00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea3c0b2f50 0x7fea3c0c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59780/0 (socket says 172.21.15.80:59780) 2024-05-10T04:23:55.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.318+0000 7fea3aa00700 1 -- 172.21.15.80:0/2693280569 learned_addr learned my addr 172.21.15.80:0/2693280569 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:55.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.318+0000 7fea3b400700 1 --2- 172.21.15.80:0/2693280569 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea3c0d3030 0x7fea3c14cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:55.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.318+0000 7fea33e00700 1 --2- 172.21.15.80:0/2693280569 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea3c0d0630 0x7fea3c14a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:55.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.318+0000 7fea3aa00700 1 -- 172.21.15.80:0/2693280569 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea3c0d3030 msgr2=0x7fea3c14cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:55.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.318+0000 7fea3aa00700 1 --2- 172.21.15.80:0/2693280569 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea3c0d3030 0x7fea3c14cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.318+0000 7fea3aa00700 1 -- 172.21.15.80:0/2693280569 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea3c0d0630 msgr2=0x7fea3c14a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:55.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.318+0000 7fea3aa00700 1 --2- 172.21.15.80:0/2693280569 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea3c0d0630 0x7fea3c14a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.318+0000 7fea3aa00700 1 -- 172.21.15.80:0/2693280569 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea240094a0 con 0x7fea3c0b2f50 2024-05-10T04:23:55.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.318+0000 7fea3aa00700 1 --2- 172.21.15.80:0/2693280569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea3c0b2f50 0x7fea3c0c8370 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00e8a0 tx=0x7fea2c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:55.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.319+0000 7fea32a00700 1 -- 172.21.15.80:0/2693280569 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c00ee40 con 0x7fea3c0b2f50 2024-05-10T04:23:55.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.319+0000 7fea32a00700 1 -- 172.21.15.80:0/2693280569 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2c00c850 con 0x7fea3c0b2f50 2024-05-10T04:23:55.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.319+0000 7fea41800700 1 -- 172.21.15.80:0/2693280569 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3c0cd7a0 con 0x7fea3c0b2f50 2024-05-10T04:23:55.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.319+0000 7fea32a00700 1 -- 172.21.15.80:0/2693280569 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c00cbc0 con 0x7fea3c0b2f50 2024-05-10T04:23:55.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.319+0000 7fea41800700 1 -- 172.21.15.80:0/2693280569 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3c0cd1e0 con 0x7fea3c0b2f50 2024-05-10T04:23:55.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.320+0000 7fea41800700 1 -- 172.21.15.80:0/2693280569 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3c074af0 con 0x7fea3c0b2f50 2024-05-10T04:23:55.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.321+0000 7fea32a00700 1 -- 172.21.15.80:0/2693280569 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fea2c00cd20 con 0x7fea3c0b2f50 2024-05-10T04:23:55.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.321+0000 7fea32a00700 1 --2- 172.21.15.80:0/2693280569 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fea1806acc0 0x7fea1806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:55.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.322+0000 7fea32a00700 1 -- 172.21.15.80:0/2693280569 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea2c0892c0 con 0x7fea3c0b2f50 2024-05-10T04:23:55.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.322+0000 7fea33e00700 1 --2- 172.21.15.80:0/2693280569 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fea1806acc0 0x7fea1806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:55.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.323+0000 7fea33e00700 1 --2- 172.21.15.80:0/2693280569 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fea1806acc0 0x7fea1806d1d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0b7110 tx=0x7fea24008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:55.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.326+0000 7fea32a00700 1 -- 172.21.15.80:0/2693280569 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fea2c054410 con 0x7fea3c0b2f50 2024-05-10T04:23:55.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.535+0000 7fea41800700 1 -- 172.21.15.80:0/2693280569 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea3c0b34a0 con 0x7fea3c0b2f50 2024-05-10T04:23:55.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.536+0000 7fea32a00700 1 -- 172.21.15.80:0/2693280569 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16114 (secure 0 0 0) 0x7fea2c057a30 con 0x7fea3c0b2f50 2024-05-10T04:23:55.538 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:55.538 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":33,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:23:54.993436+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:23:52.881736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T04:23:53.974964+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:23:55.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.539+0000 7fea41800700 1 -- 172.21.15.80:0/2693280569 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fea1806acc0 msgr2=0x7fea1806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:55.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.539+0000 7fea41800700 1 --2- 172.21.15.80:0/2693280569 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fea1806acc0 0x7fea1806d1d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0b7110 tx=0x7fea24008030 comp rx=0 tx=0).stop 2024-05-10T04:23:55.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.539+0000 7fea41800700 1 -- 172.21.15.80:0/2693280569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea3c0b2f50 msgr2=0x7fea3c0c8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:55.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.539+0000 7fea41800700 1 --2- 172.21.15.80:0/2693280569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea3c0b2f50 0x7fea3c0c8370 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00e8a0 tx=0x7fea2c00ec60 comp rx=0 tx=0).stop 2024-05-10T04:23:55.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.539+0000 7fea41800700 1 -- 172.21.15.80:0/2693280569 shutdown_connections 2024-05-10T04:23:55.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.539+0000 7fea41800700 1 --2- 172.21.15.80:0/2693280569 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fea1806acc0 0x7fea1806d1d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.539+0000 7fea41800700 1 --2- 172.21.15.80:0/2693280569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea3c0b2f50 0x7fea3c0c8370 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.539+0000 7fea41800700 1 --2- 172.21.15.80:0/2693280569 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea3c0d3030 0x7fea3c14cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.539+0000 7fea41800700 1 --2- 172.21.15.80:0/2693280569 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea3c0d0630 0x7fea3c14a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.539+0000 7fea41800700 1 -- 172.21.15.80:0/2693280569 >> 172.21.15.80:0/2693280569 conn(0x7fea3c06c3f0 msgr2=0x7fea3c161cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:55.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.539+0000 7fea41800700 1 -- 172.21.15.80:0/2693280569 shutdown_connections 2024-05-10T04:23:55.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.539+0000 7fea41800700 1 -- 172.21.15.80:0/2693280569 wait complete. 2024-05-10T04:23:55.567 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:23:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.826+0000 7fc4ca200700 1 Processor -- start 2024-05-10T04:23:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.826+0000 7fc4ca200700 1 -- start start 2024-05-10T04:23:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.828+0000 7fc4ca200700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc4c40cb0e0 0x7fc4c40b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.828+0000 7fc4ca200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc4c40b6270 0x7fc4c406ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.828+0000 7fc4ca200700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c40b20e0 con 0x7fc4c406b170 2024-05-10T04:23:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.828+0000 7fc4ca200700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c40b13c0 con 0x7fc4c40cb0e0 2024-05-10T04:23:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.828+0000 7fc4ca200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c40ceab0 con 0x7fc4c40b6270 2024-05-10T04:23:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.829+0000 7fc4c3e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc4c406b170 0x7fc4c40cd4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49168/0 (socket says 172.21.15.80:49168) 2024-05-10T04:23:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.829+0000 7fc4c3e00700 1 -- 172.21.15.80:0/128455064 learned_addr learned my addr 172.21.15.80:0/128455064 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:23:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.829+0000 7fc4c3400700 1 --2- 172.21.15.80:0/128455064 >> v2:172.21.15.106:3300/0 conn(0x7fc4c40cb0e0 0x7fc4c40b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.829+0000 7fc4bbe00700 1 --2- 172.21.15.80:0/128455064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc4c40b6270 0x7fc4c406ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.829+0000 7fc4c2a00700 1 -- 172.21.15.80:0/128455064 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967073238 0 0) 0x7fc4c40b20e0 con 0x7fc4c406b170 2024-05-10T04:23:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.829+0000 7fc4c2a00700 1 -- 172.21.15.80:0/128455064 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4a80035b0 con 0x7fc4c406b170 2024-05-10T04:23:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.829+0000 7fc4c2a00700 1 -- 172.21.15.80:0/128455064 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 362823565 0 0) 0x7fc4a80035b0 con 0x7fc4c406b170 2024-05-10T04:23:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.829+0000 7fc4c2a00700 1 -- 172.21.15.80:0/128455064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc4c40b6270 msgr2=0x7fc4c406ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.829+0000 7fc4c2a00700 1 --2- 172.21.15.80:0/128455064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc4c40b6270 0x7fc4c406ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.829+0000 7fc4c2a00700 1 -- 172.21.15.80:0/128455064 >> v2:172.21.15.106:3300/0 conn(0x7fc4c40cb0e0 msgr2=0x7fc4c40b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.829+0000 7fc4c2a00700 1 --2- 172.21.15.80:0/128455064 >> v2:172.21.15.106:3300/0 conn(0x7fc4c40cb0e0 0x7fc4c40b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.829+0000 7fc4c2a00700 1 -- 172.21.15.80:0/128455064 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c406b580 con 0x7fc4c406b170 2024-05-10T04:23:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.829+0000 7fc4c2a00700 1 -- 172.21.15.80:0/128455064 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7fc4bc0019f0 con 0x7fc4c406b170 2024-05-10T04:23:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.829+0000 7fc4bbe00700 1 --2- 172.21.15.80:0/128455064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc4c40b6270 0x7fc4c406ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:23:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.829+0000 7fc4c2a00700 1 -- 172.21.15.80:0/128455064 >> v1:172.21.15.80:6789/0 conn(0x7fc4c406b170 legacy=0x7fc4c40cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.830+0000 7fc4c2a00700 1 --2- 172.21.15.80:0/128455064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003a00 0x7fc4a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.830+0000 7fc4c2a00700 1 --2- 172.21.15.80:0/128455064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc4c40b6270 0x7fc4a8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.830+0000 7fc4c2a00700 1 --2- 172.21.15.80:0/128455064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4a8004d90 0x7fc4a80051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.830+0000 7fc4c2a00700 1 -- 172.21.15.80:0/128455064 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c40b13c0 con 0x7fc4a8003a00 2024-05-10T04:23:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.830+0000 7fc4c2a00700 1 -- 172.21.15.80:0/128455064 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a800ba10 con 0x7fc4a8004d90 2024-05-10T04:23:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.830+0000 7fc4c2a00700 1 -- 172.21.15.80:0/128455064 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a800bb50 con 0x7fc4c40b6270 2024-05-10T04:23:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.830+0000 7fc4c3400700 1 --2- 172.21.15.80:0/128455064 >> v2:172.21.15.106:3300/0 conn(0x7fc4c40cb0e0 0x7fc4c40b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:23:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.830+0000 7fc4bbe00700 1 --2- 172.21.15.80:0/128455064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc4c40b6270 0x7fc4a8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.830+0000 7fc4c3400700 1 --2- 172.21.15.80:0/128455064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003a00 0x7fc4a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.830+0000 7fc4c3e00700 1 --2- 172.21.15.80:0/128455064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4a8004d90 0x7fc4a80051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.830+0000 7fc4c3400700 1 -- 172.21.15.80:0/128455064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc4c40b6270 msgr2=0x7fc4a8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.830+0000 7fc4c3400700 1 --2- 172.21.15.80:0/128455064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc4c40b6270 0x7fc4a8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.830+0000 7fc4c3400700 1 -- 172.21.15.80:0/128455064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4a8004d90 msgr2=0x7fc4a80051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.830+0000 7fc4c3400700 1 --2- 172.21.15.80:0/128455064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4a8004d90 0x7fc4a80051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.830+0000 7fc4c3400700 1 -- 172.21.15.80:0/128455064 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac0094a0 con 0x7fc4a8003a00 2024-05-10T04:23:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.831+0000 7fc4c3400700 1 --2- 172.21.15.80:0/128455064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003a00 0x7fc4a8003e70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009d30 tx=0x7fc4a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad5c2ef648ba761 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.831+0000 7fc4c2a00700 1 -- 172.21.15.80:0/128455064 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4009e80 con 0x7fc4a8003a00 2024-05-10T04:23:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.831+0000 7fc4c2a00700 1 -- 172.21.15.80:0/128455064 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b400e9a0 con 0x7fc4a8003a00 2024-05-10T04:23:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.831+0000 7fc4c2a00700 1 -- 172.21.15.80:0/128455064 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400ed10 con 0x7fc4a8003a00 2024-05-10T04:23:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.831+0000 7fc4ca200700 1 -- 172.21.15.80:0/128455064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003a00 msgr2=0x7fc4a8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.831+0000 7fc4ca200700 1 --2- 172.21.15.80:0/128455064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003a00 0x7fc4a8003e70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009d30 tx=0x7fc4a8005880 comp rx=0 tx=0).stop 2024-05-10T04:23:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.832+0000 7fc4c3e00700 1 -- 172.21.15.80:0/128455064 reap_dead start 2024-05-10T04:23:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.832+0000 7fc4ca200700 1 -- 172.21.15.80:0/128455064 shutdown_connections 2024-05-10T04:23:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.832+0000 7fc4ca200700 1 -- 172.21.15.80:0/128455064 >> 172.21.15.80:0/128455064 conn(0x7fc4c40d0a90 msgr2=0x7fc4c40d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.832+0000 7fc4ca200700 1 -- 172.21.15.80:0/128455064 shutdown_connections 2024-05-10T04:23:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.832+0000 7fc4ca200700 1 -- 172.21.15.80:0/128455064 wait complete. 2024-05-10T04:23:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.834+0000 7fc4ca200700 1 Processor -- start 2024-05-10T04:23:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.834+0000 7fc4ca200700 1 -- start start 2024-05-10T04:23:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.836+0000 7fc4ca200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003a00 0x7fc4c40ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.836+0000 7fc4ca200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4c4152770 0x7fc4c414bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.836+0000 7fc4ca200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc4c41f7620 0x7fc4c41f7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.836+0000 7fc4ca200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c40afd30 con 0x7fc4a8003a00 2024-05-10T04:23:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.836+0000 7fc4ca200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c40c5540 con 0x7fc4c4152770 2024-05-10T04:23:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.836+0000 7fc4ca200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c40aff80 con 0x7fc4c41f7620 2024-05-10T04:23:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.836+0000 7fc4c3400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003a00 0x7fc4c40ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.836+0000 7fc4c3400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003a00 0x7fc4c40ad800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59794/0 (socket says 172.21.15.80:59794) 2024-05-10T04:23:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.836+0000 7fc4c3400700 1 -- 172.21.15.80:0/3098451914 learned_addr learned my addr 172.21.15.80:0/3098451914 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.836+0000 7fc4c3e00700 1 --2- 172.21.15.80:0/3098451914 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc4c41f7620 0x7fc4c41f7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.836+0000 7fc4bbe00700 1 --2- 172.21.15.80:0/3098451914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4c4152770 0x7fc4c414bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.836+0000 7fc4c3400700 1 -- 172.21.15.80:0/3098451914 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc4c41f7620 msgr2=0x7fc4c41f7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.836+0000 7fc4c3400700 1 --2- 172.21.15.80:0/3098451914 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc4c41f7620 0x7fc4c41f7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.836+0000 7fc4c3400700 1 -- 172.21.15.80:0/3098451914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4c4152770 msgr2=0x7fc4c414bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.836+0000 7fc4c3400700 1 --2- 172.21.15.80:0/3098451914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4c4152770 0x7fc4c414bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:55.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.836+0000 7fc4c3400700 1 -- 172.21.15.80:0/3098451914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c40b0260 con 0x7fc4a8003a00 2024-05-10T04:23:55.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.836+0000 7fc4c3e00700 1 --2- 172.21.15.80:0/3098451914 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc4c41f7620 0x7fc4c41f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:55.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.837+0000 7fc4c3400700 1 --2- 172.21.15.80:0/3098451914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003a00 0x7fc4c40ad800 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80047b0 tx=0x7fc4b40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:55.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.837+0000 7fc4bb400700 1 -- 172.21.15.80:0/3098451914 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4020070 con 0x7fc4a8003a00 2024-05-10T04:23:55.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.837+0000 7fc4bb400700 1 -- 172.21.15.80:0/3098451914 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b4009e80 con 0x7fc4a8003a00 2024-05-10T04:23:55.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.837+0000 7fc4ca200700 1 -- 172.21.15.80:0/3098451914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c40afd30 con 0x7fc4a8003a00 2024-05-10T04:23:55.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.837+0000 7fc4bb400700 1 -- 172.21.15.80:0/3098451914 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4006e60 con 0x7fc4a8003a00 2024-05-10T04:23:55.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.837+0000 7fc4ca200700 1 -- 172.21.15.80:0/3098451914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c40c5790 con 0x7fc4a8003a00 2024-05-10T04:23:55.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.838+0000 7fc4ca200700 1 -- 172.21.15.80:0/3098451914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c40c5b00 con 0x7fc4a8003a00 2024-05-10T04:23:55.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.839+0000 7fc4bb400700 1 -- 172.21.15.80:0/3098451914 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc4b4003b10 con 0x7fc4a8003a00 2024-05-10T04:23:55.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.840+0000 7fc4bb400700 1 --2- 172.21.15.80:0/3098451914 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc4a006ac90 0x7fc4a006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:55.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.840+0000 7fc4bb400700 1 -- 172.21.15.80:0/3098451914 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4b408a8d0 con 0x7fc4a8003a00 2024-05-10T04:23:55.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.841+0000 7fc4bbe00700 1 --2- 172.21.15.80:0/3098451914 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc4a006ac90 0x7fc4a006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:55.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.841+0000 7fc4bbe00700 1 --2- 172.21.15.80:0/3098451914 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc4a006ac90 0x7fc4a006d1a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40b3290 tx=0x7fc4ac009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:55.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:55.845+0000 7fc4bb400700 1 -- 172.21.15.80:0/3098451914 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc4b4055aa0 con 0x7fc4a8003a00 2024-05-10T04:23:56.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.053+0000 7fc4ca200700 1 -- 172.21.15.80:0/3098451914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4c4074af0 con 0x7fc4a8003a00 2024-05-10T04:23:56.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.054+0000 7fc4bb400700 1 -- 172.21.15.80:0/3098451914 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16101 (secure 0 0 0) 0x7fc4b402a090 con 0x7fc4a8003a00 2024-05-10T04:23:56.055 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:56.055 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":34,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:23:55.996940+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:23:52.881736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T04:23:53.974964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:23:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.056+0000 7fc4ca200700 1 -- 172.21.15.80:0/3098451914 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc4a006ac90 msgr2=0x7fc4a006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.056+0000 7fc4ca200700 1 --2- 172.21.15.80:0/3098451914 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc4a006ac90 0x7fc4a006d1a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40b3290 tx=0x7fc4ac009210 comp rx=0 tx=0).stop 2024-05-10T04:23:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.056+0000 7fc4ca200700 1 -- 172.21.15.80:0/3098451914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003a00 msgr2=0x7fc4c40ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.056+0000 7fc4ca200700 1 --2- 172.21.15.80:0/3098451914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003a00 0x7fc4c40ad800 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80047b0 tx=0x7fc4b40047c0 comp rx=0 tx=0).stop 2024-05-10T04:23:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.056+0000 7fc4ca200700 1 -- 172.21.15.80:0/3098451914 shutdown_connections 2024-05-10T04:23:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.056+0000 7fc4ca200700 1 --2- 172.21.15.80:0/3098451914 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc4a006ac90 0x7fc4a006d1a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.056+0000 7fc4ca200700 1 --2- 172.21.15.80:0/3098451914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003a00 0x7fc4c40ad800 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.056+0000 7fc4ca200700 1 --2- 172.21.15.80:0/3098451914 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc4c41f7620 0x7fc4c41f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.056+0000 7fc4ca200700 1 --2- 172.21.15.80:0/3098451914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4c4152770 0x7fc4c414bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.056+0000 7fc4ca200700 1 -- 172.21.15.80:0/3098451914 >> 172.21.15.80:0/3098451914 conn(0x7fc4c40d0a90 msgr2=0x7fc4c415dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.056+0000 7fc4ca200700 1 -- 172.21.15.80:0/3098451914 shutdown_connections 2024-05-10T04:23:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.056+0000 7fc4ca200700 1 -- 172.21.15.80:0/3098451914 wait complete. 2024-05-10T04:23:56.083 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T04:23:56.222 INFO:tasks.ceph.mds.c.smithi080.stderr:2024-05-10T04:23:56.221+0000 7f4866600700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T04:23:56.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.343+0000 7fea68600700 1 Processor -- start 2024-05-10T04:23:56.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.343+0000 7fea68600700 1 -- start start 2024-05-10T04:23:56.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.345+0000 7fea68600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fea600b47e0 0x7fea600cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:56.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.345+0000 7fea68600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fea6006e800 0x7fea6006ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:56.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.345+0000 7fea68600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6015c4e0 con 0x7fea6015b9c0 2024-05-10T04:23:56.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.345+0000 7fea68600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6015c710 con 0x7fea6006e800 2024-05-10T04:23:56.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.345+0000 7fea68600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea600cf940 con 0x7fea600b47e0 2024-05-10T04:23:56.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.346+0000 7fea65200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fea6006e800 0x7fea6006ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:56.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.346+0000 7fea65200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fea6006e800 0x7fea6006ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59806/0 (socket says 172.21.15.80:59806) 2024-05-10T04:23:56.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.346+0000 7fea65200700 1 -- 172.21.15.80:0/435023881 learned_addr learned my addr 172.21.15.80:0/435023881 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:56.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.346+0000 7fea65c00700 1 --2- 172.21.15.80:0/435023881 >> v2:172.21.15.106:3300/0 conn(0x7fea600b47e0 0x7fea600cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:56.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.346+0000 7fea65200700 1 -- 172.21.15.80:0/435023881 >> v2:172.21.15.106:3300/0 conn(0x7fea600b47e0 msgr2=0x7fea600cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:56.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.346+0000 7fea65200700 1 --2- 172.21.15.80:0/435023881 >> v2:172.21.15.106:3300/0 conn(0x7fea600b47e0 0x7fea600cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:56.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.346+0000 7fea65200700 1 -- 172.21.15.80:0/435023881 >> v1:172.21.15.106:6789/0 conn(0x7fea6015b9c0 legacy=0x7fea6015bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:56.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.346+0000 7fea65200700 1 -- 172.21.15.80:0/435023881 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6006f150 con 0x7fea6006e800 2024-05-10T04:23:56.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.346+0000 7fea65200700 1 --2- 172.21.15.80:0/435023881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea6006e800 0x7fea6006ec10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fea60071140 tx=0x7fea4c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b938035ab3eb547c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:56.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.347+0000 7fea5fe00700 1 -- 172.21.15.80:0/435023881 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c00dd10 con 0x7fea6006e800 2024-05-10T04:23:56.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.347+0000 7fea5fe00700 1 -- 172.21.15.80:0/435023881 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c00de70 con 0x7fea6006e800 2024-05-10T04:23:56.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.347+0000 7fea5fe00700 1 -- 172.21.15.80:0/435023881 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c010670 con 0x7fea6006e800 2024-05-10T04:23:56.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.347+0000 7fea68600700 1 -- 172.21.15.80:0/435023881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea6006e800 msgr2=0x7fea6006ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:56.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.347+0000 7fea68600700 1 --2- 172.21.15.80:0/435023881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea6006e800 0x7fea6006ec10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fea60071140 tx=0x7fea4c00bea0 comp rx=0 tx=0).stop 2024-05-10T04:23:56.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.347+0000 7fea68600700 1 -- 172.21.15.80:0/435023881 shutdown_connections 2024-05-10T04:23:56.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.347+0000 7fea68600700 1 --2- 172.21.15.80:0/435023881 >> v2:172.21.15.106:3300/0 conn(0x7fea600b47e0 0x7fea600cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:56.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.347+0000 7fea68600700 1 --2- 172.21.15.80:0/435023881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea6006e800 0x7fea6006ec10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:56.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.347+0000 7fea68600700 1 -- 172.21.15.80:0/435023881 >> 172.21.15.80:0/435023881 conn(0x7fea600b1830 msgr2=0x7fea600b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:56.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.348+0000 7fea68600700 1 -- 172.21.15.80:0/435023881 shutdown_connections 2024-05-10T04:23:56.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.348+0000 7fea68600700 1 -- 172.21.15.80:0/435023881 wait complete. 2024-05-10T04:23:56.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.350+0000 7fea68600700 1 Processor -- start 2024-05-10T04:23:56.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.350+0000 7fea68600700 1 -- start start 2024-05-10T04:23:56.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.351+0000 7fea68600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea6006e800 0x7fea6013d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:56.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.351+0000 7fea68600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea600b47e0 0x7fea60150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:56.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.351+0000 7fea68600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea6015b9c0 0x7fea600cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:56.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.351+0000 7fea68600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea601f5110 con 0x7fea600b47e0 2024-05-10T04:23:56.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.351+0000 7fea68600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea60150e60 con 0x7fea6006e800 2024-05-10T04:23:56.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.351+0000 7fea68600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea60151cf0 con 0x7fea6015b9c0 2024-05-10T04:23:56.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.352+0000 7fea65200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea600b47e0 0x7fea60150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:56.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.352+0000 7fea65200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea600b47e0 0x7fea60150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59822/0 (socket says 172.21.15.80:59822) 2024-05-10T04:23:56.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.352+0000 7fea65200700 1 -- 172.21.15.80:0/2645499840 learned_addr learned my addr 172.21.15.80:0/2645499840 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:56.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.352+0000 7fea65c00700 1 --2- 172.21.15.80:0/2645499840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea6006e800 0x7fea6013d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:56.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.352+0000 7fea66600700 1 --2- 172.21.15.80:0/2645499840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea6015b9c0 0x7fea600cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:56.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.352+0000 7fea65200700 1 -- 172.21.15.80:0/2645499840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea6015b9c0 msgr2=0x7fea600cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:56.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.352+0000 7fea65200700 1 --2- 172.21.15.80:0/2645499840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea6015b9c0 0x7fea600cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:56.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.352+0000 7fea65200700 1 -- 172.21.15.80:0/2645499840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea6006e800 msgr2=0x7fea6013d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:56.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.352+0000 7fea65200700 1 --2- 172.21.15.80:0/2645499840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea6006e800 0x7fea6013d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:56.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.352+0000 7fea65200700 1 -- 172.21.15.80:0/2645499840 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c00b7f0 con 0x7fea600b47e0 2024-05-10T04:23:56.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.352+0000 7fea66600700 1 --2- 172.21.15.80:0/2645499840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea6015b9c0 0x7fea600cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:56.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.352+0000 7fea65200700 1 --2- 172.21.15.80:0/2645499840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea600b47e0 0x7fea60150410 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fea4c000c00 tx=0x7fea4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:56.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.353+0000 7fea5d600700 1 -- 172.21.15.80:0/2645499840 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c003c70 con 0x7fea600b47e0 2024-05-10T04:23:56.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.353+0000 7fea5d600700 1 -- 172.21.15.80:0/2645499840 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c003df0 con 0x7fea600b47e0 2024-05-10T04:23:56.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.353+0000 7fea5d600700 1 -- 172.21.15.80:0/2645499840 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c0106b0 con 0x7fea600b47e0 2024-05-10T04:23:56.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.353+0000 7fea68600700 1 -- 172.21.15.80:0/2645499840 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea601513c0 con 0x7fea600b47e0 2024-05-10T04:23:56.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.353+0000 7fea68600700 1 -- 172.21.15.80:0/2645499840 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea60151980 con 0x7fea600b47e0 2024-05-10T04:23:56.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.354+0000 7fea68600700 1 -- 172.21.15.80:0/2645499840 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea60074af0 con 0x7fea600b47e0 2024-05-10T04:23:56.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.355+0000 7fea5d600700 1 -- 172.21.15.80:0/2645499840 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fea4c019400 con 0x7fea600b47e0 2024-05-10T04:23:56.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.356+0000 7fea5d600700 1 --2- 172.21.15.80:0/2645499840 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fea4006ac90 0x7fea4006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:56.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.356+0000 7fea5d600700 1 -- 172.21.15.80:0/2645499840 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea4c08a6a0 con 0x7fea600b47e0 2024-05-10T04:23:56.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.356+0000 7fea65c00700 1 --2- 172.21.15.80:0/2645499840 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fea4006ac90 0x7fea4006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:56.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.357+0000 7fea65c00700 1 --2- 172.21.15.80:0/2645499840 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fea4006ac90 0x7fea4006d1a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fea54006b20 tx=0x7fea54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:56.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.361+0000 7fea5d600700 1 -- 172.21.15.80:0/2645499840 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fea4c055880 con 0x7fea600b47e0 2024-05-10T04:23:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:56.616+0000 7fea68600700 1 -- 172.21.15.80:0/2645499840 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fea60151e30 con 0x7fea600b47e0 2024-05-10T04:23:57.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.430+0000 7fea5d600700 1 -- 172.21.15.80:0/2645499840 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fea4c058ea0 con 0x7fea600b47e0 2024-05-10T04:23:57.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.432+0000 7fea68600700 1 -- 172.21.15.80:0/2645499840 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fea4006ac90 msgr2=0x7fea4006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:57.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.432+0000 7fea68600700 1 --2- 172.21.15.80:0/2645499840 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fea4006ac90 0x7fea4006d1a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fea54006b20 tx=0x7fea54008040 comp rx=0 tx=0).stop 2024-05-10T04:23:57.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.432+0000 7fea68600700 1 -- 172.21.15.80:0/2645499840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea600b47e0 msgr2=0x7fea60150410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:57.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.432+0000 7fea68600700 1 --2- 172.21.15.80:0/2645499840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea600b47e0 0x7fea60150410 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fea4c000c00 tx=0x7fea4c004750 comp rx=0 tx=0).stop 2024-05-10T04:23:57.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.432+0000 7fea68600700 1 -- 172.21.15.80:0/2645499840 shutdown_connections 2024-05-10T04:23:57.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.433+0000 7fea68600700 1 --2- 172.21.15.80:0/2645499840 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fea4006ac90 0x7fea4006d1a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:57.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.433+0000 7fea68600700 1 --2- 172.21.15.80:0/2645499840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea6015b9c0 0x7fea600cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:57.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.433+0000 7fea68600700 1 --2- 172.21.15.80:0/2645499840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea6006e800 0x7fea6013d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:57.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.433+0000 7fea68600700 1 --2- 172.21.15.80:0/2645499840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea600b47e0 0x7fea60150410 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:57.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.433+0000 7fea68600700 1 -- 172.21.15.80:0/2645499840 >> 172.21.15.80:0/2645499840 conn(0x7fea600b1830 msgr2=0x7fea60071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:57.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.433+0000 7fea68600700 1 -- 172.21.15.80:0/2645499840 shutdown_connections 2024-05-10T04:23:57.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.433+0000 7fea68600700 1 -- 172.21.15.80:0/2645499840 wait complete. 2024-05-10T04:23:57.461 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T04:23:57.461 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T04:23:57.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.725+0000 7f703be00700 1 Processor -- start 2024-05-10T04:23:57.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.725+0000 7f703be00700 1 -- start start 2024-05-10T04:23:57.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.727+0000 7f703be00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7034158c70 0x7f703415ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:57.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.727+0000 7f703be00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7034162000 0x7f703406ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:57.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.727+0000 7f703be00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f70340b5c90 0x7f70340b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:57.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.727+0000 7f703be00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703406c5f0 con 0x7f7034158c70 2024-05-10T04:23:57.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.727+0000 7f703be00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70340b65e0 con 0x7f70340b5c90 2024-05-10T04:23:57.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.727+0000 7f703be00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7034162850 con 0x7f7034162000 2024-05-10T04:23:57.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.727+0000 7f7039400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7034158c70 0x7f703415ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:57.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.727+0000 7f7039400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7034158c70 0x7f703415ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59824/0 (socket says 172.21.15.80:59824) 2024-05-10T04:23:57.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.727+0000 7f7039400700 1 -- 172.21.15.80:0/2187262998 learned_addr learned my addr 172.21.15.80:0/2187262998 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:57.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.728+0000 7f7039e00700 1 --2- 172.21.15.80:0/2187262998 >> v2:172.21.15.106:3300/0 conn(0x7f70340b5c90 0x7f70340b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:57.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.728+0000 7f7038a00700 1 --2- 172.21.15.80:0/2187262998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7034162000 0x7f703406ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:57.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.728+0000 7f7039400700 1 -- 172.21.15.80:0/2187262998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7034162000 msgr2=0x7f703406ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:57.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.728+0000 7f7039400700 1 --2- 172.21.15.80:0/2187262998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7034162000 0x7f703406ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:57.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.728+0000 7f7039400700 1 -- 172.21.15.80:0/2187262998 >> v2:172.21.15.106:3300/0 conn(0x7f70340b5c90 msgr2=0x7f70340b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:57.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.728+0000 7f7039400700 1 --2- 172.21.15.80:0/2187262998 >> v2:172.21.15.106:3300/0 conn(0x7f70340b5c90 0x7f70340b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:57.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.728+0000 7f7039400700 1 -- 172.21.15.80:0/2187262998 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7034162b30 con 0x7f7034158c70 2024-05-10T04:23:57.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.728+0000 7f7039400700 1 --2- 172.21.15.80:0/2187262998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7034158c70 0x7f703415ea10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f70340d3b00 tx=0x7f7028009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73916fc7d43f669a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:57.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.728+0000 7f7033e00700 1 -- 172.21.15.80:0/2187262998 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7028011830 con 0x7f7034158c70 2024-05-10T04:23:57.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.729+0000 7f7033e00700 1 -- 172.21.15.80:0/2187262998 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7028011990 con 0x7f7034158c70 2024-05-10T04:23:57.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.729+0000 7f7033e00700 1 -- 172.21.15.80:0/2187262998 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7028011d20 con 0x7f7034158c70 2024-05-10T04:23:57.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.729+0000 7f703be00700 1 -- 172.21.15.80:0/2187262998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7034158c70 msgr2=0x7f703415ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:57.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.729+0000 7f703be00700 1 --2- 172.21.15.80:0/2187262998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7034158c70 0x7f703415ea10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f70340d3b00 tx=0x7f7028009bd0 comp rx=0 tx=0).stop 2024-05-10T04:23:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.729+0000 7f703be00700 1 -- 172.21.15.80:0/2187262998 shutdown_connections 2024-05-10T04:23:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.729+0000 7f703be00700 1 --2- 172.21.15.80:0/2187262998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7034158c70 0x7f703415ea10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.729+0000 7f703be00700 1 --2- 172.21.15.80:0/2187262998 >> v2:172.21.15.106:3300/0 conn(0x7f70340b5c90 0x7f70340b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.729+0000 7f703be00700 1 --2- 172.21.15.80:0/2187262998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7034162000 0x7f703406ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.729+0000 7f703be00700 1 -- 172.21.15.80:0/2187262998 >> 172.21.15.80:0/2187262998 conn(0x7f70340d0d30 msgr2=0x7f70340d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.729+0000 7f703be00700 1 -- 172.21.15.80:0/2187262998 shutdown_connections 2024-05-10T04:23:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.729+0000 7f703be00700 1 -- 172.21.15.80:0/2187262998 wait complete. 2024-05-10T04:23:57.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.732+0000 7f703be00700 1 Processor -- start 2024-05-10T04:23:57.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.733+0000 7f703be00700 1 -- start start 2024-05-10T04:23:57.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.734+0000 7f703be00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70340b5c90 0x7f703414cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:57.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.734+0000 7f703be00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7034158c70 0x7f70341f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:57.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.734+0000 7f703be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7034162000 0x7f70341f8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:57.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.734+0000 7f703be00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70341e9b50 con 0x7f7034162000 2024-05-10T04:23:57.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.734+0000 7f703be00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7034151400 con 0x7f70340b5c90 2024-05-10T04:23:57.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.734+0000 7f703be00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70341507f0 con 0x7f7034158c70 2024-05-10T04:23:57.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.735+0000 7f7039e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7034162000 0x7f70341f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:57.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.735+0000 7f7039e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7034162000 0x7f70341f8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59830/0 (socket says 172.21.15.80:59830) 2024-05-10T04:23:57.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.735+0000 7f7039e00700 1 -- 172.21.15.80:0/2314728394 learned_addr learned my addr 172.21.15.80:0/2314728394 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:57.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.735+0000 7f7038a00700 1 --2- 172.21.15.80:0/2314728394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7034158c70 0x7f70341f82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:57.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.735+0000 7f7039400700 1 --2- 172.21.15.80:0/2314728394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70340b5c90 0x7f703414cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:57.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.735+0000 7f7039e00700 1 -- 172.21.15.80:0/2314728394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7034158c70 msgr2=0x7f70341f82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.735+0000 7f7039e00700 1 --2- 172.21.15.80:0/2314728394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7034158c70 0x7f70341f82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.735+0000 7f7039e00700 1 -- 172.21.15.80:0/2314728394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70340b5c90 msgr2=0x7f703414cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.735+0000 7f7039e00700 1 --2- 172.21.15.80:0/2314728394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70340b5c90 0x7f703414cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.735+0000 7f7039e00700 1 -- 172.21.15.80:0/2314728394 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7028009550 con 0x7f7034162000 2024-05-10T04:23:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.735+0000 7f7039e00700 1 --2- 172.21.15.80:0/2314728394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7034162000 0x7f70341f8830 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f702c00eea0 tx=0x7f702c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.736+0000 7f7031600700 1 -- 172.21.15.80:0/2314728394 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c010040 con 0x7f7034162000 2024-05-10T04:23:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.736+0000 7f7031600700 1 -- 172.21.15.80:0/2314728394 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c00ba50 con 0x7f7034162000 2024-05-10T04:23:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.736+0000 7f703be00700 1 -- 172.21.15.80:0/2314728394 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7034150ad0 con 0x7f7034162000 2024-05-10T04:23:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.736+0000 7f7031600700 1 -- 172.21.15.80:0/2314728394 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c009b20 con 0x7f7034162000 2024-05-10T04:23:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.736+0000 7f703be00700 1 -- 172.21.15.80:0/2314728394 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7034151090 con 0x7f7034162000 2024-05-10T04:23:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.737+0000 7f703be00700 1 -- 172.21.15.80:0/2314728394 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70340732b0 con 0x7f7034162000 2024-05-10T04:23:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.738+0000 7f7031600700 1 -- 172.21.15.80:0/2314728394 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f702c01d400 con 0x7f7034162000 2024-05-10T04:23:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.739+0000 7f7031600700 1 --2- 172.21.15.80:0/2314728394 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f701406ac90 0x7f701406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.739+0000 7f7031600700 1 -- 172.21.15.80:0/2314728394 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f702c089b60 con 0x7f7034162000 2024-05-10T04:23:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.739+0000 7f7039400700 1 --2- 172.21.15.80:0/2314728394 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f701406ac90 0x7f701406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.740+0000 7f7039400700 1 --2- 172.21.15.80:0/2314728394 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f701406ac90 0x7f701406d1a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70340d3b00 tx=0x7f7028008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:57.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.743+0000 7f7031600700 1 -- 172.21.15.80:0/2314728394 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f702c054ca0 con 0x7f7034162000 2024-05-10T04:23:57.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:57.994+0000 7f703be00700 1 -- 172.21.15.80:0/2314728394 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7034151570 con 0x7f7034162000 2024-05-10T04:23:58.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.433+0000 7f7031600700 1 -- 172.21.15.80:0/2314728394 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f702c018020 con 0x7f7034162000 2024-05-10T04:23:58.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.435+0000 7f703be00700 1 -- 172.21.15.80:0/2314728394 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f701406ac90 msgr2=0x7f701406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:58.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.435+0000 7f703be00700 1 --2- 172.21.15.80:0/2314728394 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f701406ac90 0x7f701406d1a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70340d3b00 tx=0x7f7028008030 comp rx=0 tx=0).stop 2024-05-10T04:23:58.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.435+0000 7f703be00700 1 -- 172.21.15.80:0/2314728394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7034162000 msgr2=0x7f70341f8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:58.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.435+0000 7f703be00700 1 --2- 172.21.15.80:0/2314728394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7034162000 0x7f70341f8830 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f702c00eea0 tx=0x7f702c009f60 comp rx=0 tx=0).stop 2024-05-10T04:23:58.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.436+0000 7f703be00700 1 -- 172.21.15.80:0/2314728394 shutdown_connections 2024-05-10T04:23:58.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.436+0000 7f703be00700 1 --2- 172.21.15.80:0/2314728394 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f701406ac90 0x7f701406d1a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:58.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.436+0000 7f703be00700 1 --2- 172.21.15.80:0/2314728394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7034162000 0x7f70341f8830 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:58.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.436+0000 7f703be00700 1 --2- 172.21.15.80:0/2314728394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70340b5c90 0x7f703414cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:58.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.436+0000 7f703be00700 1 --2- 172.21.15.80:0/2314728394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7034158c70 0x7f70341f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:58.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.436+0000 7f703be00700 1 -- 172.21.15.80:0/2314728394 >> 172.21.15.80:0/2314728394 conn(0x7f70340d0d30 msgr2=0x7f70340d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:58.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.436+0000 7f703be00700 1 -- 172.21.15.80:0/2314728394 shutdown_connections 2024-05-10T04:23:58.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.436+0000 7f703be00700 1 -- 172.21.15.80:0/2314728394 wait complete. 2024-05-10T04:23:58.463 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T04:23:58.463 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:23:58.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.721+0000 7f72d2000700 1 Processor -- start 2024-05-10T04:23:58.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.721+0000 7f72d2000700 1 -- start start 2024-05-10T04:23:58.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.723+0000 7f72d2000700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f72cc0b2f50 0x7f72cc161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:58.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.723+0000 7f72d2000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f72cc0d0d40 0x7f72cc0d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:58.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.723+0000 7f72d2000700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc0d28c0 con 0x7f72cc0d3030 2024-05-10T04:23:58.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.723+0000 7f72d2000700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72cc0b3360 con 0x7f72cc0d0d40 2024-05-10T04:23:58.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.723+0000 7f72d2000700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72cc1624e0 con 0x7f72cc0b2f50 2024-05-10T04:23:58.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.724+0000 7f72cbe00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f72cc0d0d40 0x7f72cc0d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:58.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.724+0000 7f72cbe00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f72cc0d0d40 0x7f72cc0d3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59836/0 (socket says 172.21.15.80:59836) 2024-05-10T04:23:58.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.724+0000 7f72cbe00700 1 -- 172.21.15.80:0/1763503102 learned_addr learned my addr 172.21.15.80:0/1763503102 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:58.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.724+0000 7f72cb400700 1 --2- 172.21.15.80:0/1763503102 >> v2:172.21.15.106:3300/0 conn(0x7f72cc0b2f50 0x7f72cc161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:58.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.724+0000 7f72cbe00700 1 -- 172.21.15.80:0/1763503102 >> v2:172.21.15.106:3300/0 conn(0x7f72cc0b2f50 msgr2=0x7f72cc161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:58.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.724+0000 7f72cbe00700 1 --2- 172.21.15.80:0/1763503102 >> v2:172.21.15.106:3300/0 conn(0x7f72cc0b2f50 0x7f72cc161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:58.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.724+0000 7f72cbe00700 1 -- 172.21.15.80:0/1763503102 >> v1:172.21.15.106:6789/0 conn(0x7f72cc0d3030 legacy=0x7f72cc0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:58.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.724+0000 7f72cbe00700 1 -- 172.21.15.80:0/1763503102 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc0d2ba0 con 0x7f72cc0d0d40 2024-05-10T04:23:58.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.724+0000 7f72ca000700 1 -- 172.21.15.80:0/1763503102 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302232871 0 0) 0x7f72cc0d28c0 con 0x7f72cc0d3030 2024-05-10T04:23:58.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.725+0000 7f72cbe00700 1 --2- 172.21.15.80:0/1763503102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0d0d40 0x7f72cc0d3440 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f72cc06d410 tx=0x7f72c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b014926f6d084d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:58.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.725+0000 7f72ca000700 1 -- 172.21.15.80:0/1763503102 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c400e070 con 0x7f72cc0d0d40 2024-05-10T04:23:58.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.725+0000 7f72ca000700 1 -- 172.21.15.80:0/1763503102 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c400b8d0 con 0x7f72cc0d0d40 2024-05-10T04:23:58.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.725+0000 7f72ca000700 1 -- 172.21.15.80:0/1763503102 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c400bc80 con 0x7f72cc0d0d40 2024-05-10T04:23:58.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.725+0000 7f72d2000700 1 -- 172.21.15.80:0/1763503102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0d0d40 msgr2=0x7f72cc0d3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:58.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.725+0000 7f72d2000700 1 --2- 172.21.15.80:0/1763503102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0d0d40 0x7f72cc0d3440 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f72cc06d410 tx=0x7f72c400b330 comp rx=0 tx=0).stop 2024-05-10T04:23:58.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.725+0000 7f72d2000700 1 -- 172.21.15.80:0/1763503102 shutdown_connections 2024-05-10T04:23:58.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.725+0000 7f72d2000700 1 --2- 172.21.15.80:0/1763503102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0d0d40 0x7f72cc0d3440 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:58.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.725+0000 7f72d2000700 1 --2- 172.21.15.80:0/1763503102 >> v2:172.21.15.106:3300/0 conn(0x7f72cc0b2f50 0x7f72cc161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:58.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.726+0000 7f72d2000700 1 -- 172.21.15.80:0/1763503102 >> 172.21.15.80:0/1763503102 conn(0x7f72cc06c3f0 msgr2=0x7f72cc06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:58.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.726+0000 7f72d2000700 1 -- 172.21.15.80:0/1763503102 shutdown_connections 2024-05-10T04:23:58.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.726+0000 7f72d2000700 1 -- 172.21.15.80:0/1763503102 wait complete. 2024-05-10T04:23:58.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.728+0000 7f72d2000700 1 Processor -- start 2024-05-10T04:23:58.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.728+0000 7f72d2000700 1 -- start start 2024-05-10T04:23:58.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.730+0000 7f72d2000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72cc0b2f50 0x7f72cc0ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:58.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.730+0000 7f72d2000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72cc0d0d40 0x7f72cc160300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:58.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.730+0000 7f72d2000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0d3030 0x7f72cc160840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:58.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.730+0000 7f72d2000700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc1f6120 con 0x7f72cc0d3030 2024-05-10T04:23:58.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.730+0000 7f72d2000700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0c86e0 con 0x7f72cc0b2f50 2024-05-10T04:23:58.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.730+0000 7f72d2000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0c8930 con 0x7f72cc0d0d40 2024-05-10T04:23:58.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.730+0000 7f72cbe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0d3030 0x7f72cc160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:58.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.730+0000 7f72cbe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0d3030 0x7f72cc160840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59844/0 (socket says 172.21.15.80:59844) 2024-05-10T04:23:58.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.730+0000 7f72cbe00700 1 -- 172.21.15.80:0/2061350797 learned_addr learned my addr 172.21.15.80:0/2061350797 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:58.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.730+0000 7f72cb400700 1 --2- 172.21.15.80:0/2061350797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72cc0b2f50 0x7f72cc0ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:58.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.730+0000 7f72caa00700 1 --2- 172.21.15.80:0/2061350797 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72cc0d0d40 0x7f72cc160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:58.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.730+0000 7f72cbe00700 1 -- 172.21.15.80:0/2061350797 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72cc0d0d40 msgr2=0x7f72cc160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:58.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.730+0000 7f72cbe00700 1 --2- 172.21.15.80:0/2061350797 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72cc0d0d40 0x7f72cc160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:58.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.730+0000 7f72cbe00700 1 -- 172.21.15.80:0/2061350797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72cc0b2f50 msgr2=0x7f72cc0ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:58.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.730+0000 7f72cbe00700 1 --2- 172.21.15.80:0/2061350797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72cc0b2f50 0x7f72cc0ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:58.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.730+0000 7f72cbe00700 1 -- 172.21.15.80:0/2061350797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c4009b30 con 0x7f72cc0d3030 2024-05-10T04:23:58.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.730+0000 7f72caa00700 1 --2- 172.21.15.80:0/2061350797 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72cc0d0d40 0x7f72cc160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:58.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.731+0000 7f72cbe00700 1 --2- 172.21.15.80:0/2061350797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0d3030 0x7f72cc160840 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0d1310 tx=0x7f72c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:58.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.731+0000 7f72c3400700 1 -- 172.21.15.80:0/2061350797 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4004930 con 0x7f72cc0d3030 2024-05-10T04:23:58.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.731+0000 7f72c3400700 1 -- 172.21.15.80:0/2061350797 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c40092e0 con 0x7f72cc0d3030 2024-05-10T04:23:58.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.731+0000 7f72d2000700 1 -- 172.21.15.80:0/2061350797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72cc0c8c10 con 0x7f72cc0d3030 2024-05-10T04:23:58.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.731+0000 7f72c3400700 1 -- 172.21.15.80:0/2061350797 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c401b630 con 0x7f72cc0d3030 2024-05-10T04:23:58.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.731+0000 7f72d2000700 1 -- 172.21.15.80:0/2061350797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72cc1f48c0 con 0x7f72cc0d3030 2024-05-10T04:23:58.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.732+0000 7f72d2000700 1 -- 172.21.15.80:0/2061350797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72cc1f4a80 con 0x7f72cc0d3030 2024-05-10T04:23:58.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.733+0000 7f72c3400700 1 -- 172.21.15.80:0/2061350797 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f72c401b790 con 0x7f72cc0d3030 2024-05-10T04:23:58.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.734+0000 7f72c3400700 1 --2- 172.21.15.80:0/2061350797 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f72ac06acc0 0x7f72ac06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:58.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.734+0000 7f72c3400700 1 -- 172.21.15.80:0/2061350797 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72c408a8c0 con 0x7f72cc0d3030 2024-05-10T04:23:58.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.734+0000 7f72cb400700 1 --2- 172.21.15.80:0/2061350797 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f72ac06acc0 0x7f72ac06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:58.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.735+0000 7f72cb400700 1 --2- 172.21.15.80:0/2061350797 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f72ac06acc0 0x7f72ac06d1d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f72cc08d080 tx=0x7f72bc009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:58.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.738+0000 7f72c3400700 1 -- 172.21.15.80:0/2061350797 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f72c4055a00 con 0x7f72cc0d3030 2024-05-10T04:23:58.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.990+0000 7f72d2000700 1 -- 172.21.15.80:0/2061350797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72cc074af0 con 0x7f72cc0d3030 2024-05-10T04:23:58.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.991+0000 7f72c3400700 1 -- 172.21.15.80:0/2061350797 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f72c408a020 con 0x7f72cc0d3030 2024-05-10T04:23:58.992 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:58.992 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6834/607016626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":607016626},{"type":"v1","addr":"172.21.15.80:6834","nonce":607016626}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4981,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1819064685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1819064685},{"type":"v1","addr":"172.21.15.106:6836","nonce":1819064685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4984,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3006235418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3006235418},{"type":"v1","addr":"172.21.15.106:6837","nonce":3006235418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:23:54.993823+0000","modified":"2024-05-10T04:23:58.429131+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6835/707679728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":707679728},{"type":"v1","addr":"172.21.15.80:6835","nonce":707679728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-10T04:23:58.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.993+0000 7f72d2000700 1 -- 172.21.15.80:0/2061350797 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f72ac06acc0 msgr2=0x7f72ac06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:58.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.993+0000 7f72d2000700 1 --2- 172.21.15.80:0/2061350797 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f72ac06acc0 0x7f72ac06d1d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f72cc08d080 tx=0x7f72bc009210 comp rx=0 tx=0).stop 2024-05-10T04:23:58.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.993+0000 7f72d2000700 1 -- 172.21.15.80:0/2061350797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0d3030 msgr2=0x7f72cc160840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:58.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.993+0000 7f72d2000700 1 --2- 172.21.15.80:0/2061350797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0d3030 0x7f72cc160840 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0d1310 tx=0x7f72c4004ad0 comp rx=0 tx=0).stop 2024-05-10T04:23:58.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.993+0000 7f72d2000700 1 -- 172.21.15.80:0/2061350797 shutdown_connections 2024-05-10T04:23:58.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.993+0000 7f72d2000700 1 --2- 172.21.15.80:0/2061350797 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f72ac06acc0 0x7f72ac06d1d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:58.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.993+0000 7f72d2000700 1 --2- 172.21.15.80:0/2061350797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0d3030 0x7f72cc160840 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:58.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.993+0000 7f72d2000700 1 --2- 172.21.15.80:0/2061350797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72cc0b2f50 0x7f72cc0ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:58.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.993+0000 7f72d2000700 1 --2- 172.21.15.80:0/2061350797 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72cc0d0d40 0x7f72cc160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:58.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.993+0000 7f72d2000700 1 -- 172.21.15.80:0/2061350797 >> 172.21.15.80:0/2061350797 conn(0x7f72cc06c3f0 msgr2=0x7f72cc15e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:58.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.993+0000 7f72d2000700 1 -- 172.21.15.80:0/2061350797 shutdown_connections 2024-05-10T04:23:58.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:58.993+0000 7f72d2000700 1 -- 172.21.15.80:0/2061350797 wait complete. 2024-05-10T04:23:58.996 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 16 2024-05-10T04:23:59.023 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:23:59.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.280+0000 7f259da00700 1 Processor -- start 2024-05-10T04:23:59.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.280+0000 7f259da00700 1 -- start start 2024-05-10T04:23:59.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.282+0000 7f259da00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f259815b870 0x7f259815c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:59.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.282+0000 7f259da00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f25980b31d0 0x7f259806d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:59.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.282+0000 7f259da00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25980cf360 con 0x7f25980cdde0 2024-05-10T04:23:59.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.282+0000 7f259da00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259815c730 con 0x7f25980b31d0 2024-05-10T04:23:59.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.282+0000 7f259da00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25980ce750 con 0x7f259815b870 2024-05-10T04:23:59.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.282+0000 7f2597400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f25980b31d0 0x7f259806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:59.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.282+0000 7f2597400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f25980b31d0 0x7f259806d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59856/0 (socket says 172.21.15.80:59856) 2024-05-10T04:23:59.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.282+0000 7f2597400700 1 -- 172.21.15.80:0/3525011657 learned_addr learned my addr 172.21.15.80:0/3525011657 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:59.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.282+0000 7f2596a00700 1 --2- 172.21.15.80:0/3525011657 >> v2:172.21.15.106:3300/0 conn(0x7f259815b870 0x7f259815c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:59.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.283+0000 7f2597400700 1 -- 172.21.15.80:0/3525011657 >> v2:172.21.15.106:3300/0 conn(0x7f259815b870 msgr2=0x7f259815c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:59.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.283+0000 7f2597400700 1 --2- 172.21.15.80:0/3525011657 >> v2:172.21.15.106:3300/0 conn(0x7f259815b870 0x7f259815c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:59.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.283+0000 7f2597400700 1 -- 172.21.15.80:0/3525011657 >> v1:172.21.15.106:6789/0 conn(0x7f25980cdde0 legacy=0x7f25980b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:59.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.283+0000 7f2597400700 1 -- 172.21.15.80:0/3525011657 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25980cea30 con 0x7f25980b31d0 2024-05-10T04:23:59.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.283+0000 7f2597400700 1 --2- 172.21.15.80:0/3525011657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25980b31d0 0x7f259806d710 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2598070b10 tx=0x7f259000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3702472412b3be server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:59.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.283+0000 7f2596000700 1 -- 172.21.15.80:0/3525011657 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259000e070 con 0x7f25980b31d0 2024-05-10T04:23:59.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.283+0000 7f2596000700 1 -- 172.21.15.80:0/3525011657 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259000b910 con 0x7f25980b31d0 2024-05-10T04:23:59.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.283+0000 7f2596000700 1 -- 172.21.15.80:0/3525011657 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259000bcc0 con 0x7f25980b31d0 2024-05-10T04:23:59.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.284+0000 7f259da00700 1 -- 172.21.15.80:0/3525011657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25980b31d0 msgr2=0x7f259806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:59.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.284+0000 7f259da00700 1 --2- 172.21.15.80:0/3525011657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25980b31d0 0x7f259806d710 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2598070b10 tx=0x7f259000b330 comp rx=0 tx=0).stop 2024-05-10T04:23:59.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.284+0000 7f259da00700 1 -- 172.21.15.80:0/3525011657 shutdown_connections 2024-05-10T04:23:59.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.284+0000 7f259da00700 1 --2- 172.21.15.80:0/3525011657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25980b31d0 0x7f259806d710 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:59.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.284+0000 7f259da00700 1 --2- 172.21.15.80:0/3525011657 >> v2:172.21.15.106:3300/0 conn(0x7f259815b870 0x7f259815c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:59.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.284+0000 7f259da00700 1 -- 172.21.15.80:0/3525011657 >> 172.21.15.80:0/3525011657 conn(0x7f259806b470 msgr2=0x7f25980b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:59.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.284+0000 7f259da00700 1 -- 172.21.15.80:0/3525011657 shutdown_connections 2024-05-10T04:23:59.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.284+0000 7f259da00700 1 -- 172.21.15.80:0/3525011657 wait complete. 2024-05-10T04:23:59.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.287+0000 7f259da00700 1 Processor -- start 2024-05-10T04:23:59.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.287+0000 7f259da00700 1 -- start start 2024-05-10T04:23:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.288+0000 7f259da00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25980cdde0 0x7f2598132190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.288+0000 7f259da00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259815b870 0x7f259813aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.288+0000 7f259da00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f259813b530 0x7f259815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.288+0000 7f259da00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259815e730 con 0x7f259815b870 2024-05-10T04:23:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.288+0000 7f259da00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259813b940 con 0x7f25980cdde0 2024-05-10T04:23:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.288+0000 7f259da00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259813dd80 con 0x7f259813b530 2024-05-10T04:23:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.288+0000 7f258fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259815b870 0x7f259813aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.289+0000 7f258fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259815b870 0x7f259813aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59860/0 (socket says 172.21.15.80:59860) 2024-05-10T04:23:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.289+0000 7f258fe00700 1 -- 172.21.15.80:0/3879024764 learned_addr learned my addr 172.21.15.80:0/3879024764 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.289+0000 7f2596a00700 1 --2- 172.21.15.80:0/3879024764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25980cdde0 0x7f2598132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.289+0000 7f2597400700 1 --2- 172.21.15.80:0/3879024764 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f259813b530 0x7f259815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.289+0000 7f258fe00700 1 -- 172.21.15.80:0/3879024764 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f259813b530 msgr2=0x7f259815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.289+0000 7f258fe00700 1 --2- 172.21.15.80:0/3879024764 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f259813b530 0x7f259815a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.289+0000 7f258fe00700 1 -- 172.21.15.80:0/3879024764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25980cdde0 msgr2=0x7f2598132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.289+0000 7f258fe00700 1 --2- 172.21.15.80:0/3879024764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25980cdde0 0x7f2598132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:59.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.289+0000 7f258fe00700 1 -- 172.21.15.80:0/3879024764 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2590009b30 con 0x7f259815b870 2024-05-10T04:23:59.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.289+0000 7f2596a00700 1 --2- 172.21.15.80:0/3879024764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25980cdde0 0x7f2598132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:23:59.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.289+0000 7f258fe00700 1 --2- 172.21.15.80:0/3879024764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259815b870 0x7f259813aff0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f258000c450 tx=0x7f258000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:59.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.290+0000 7f258ea00700 1 -- 172.21.15.80:0/3879024764 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25800052d0 con 0x7f259815b870 2024-05-10T04:23:59.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.290+0000 7f258ea00700 1 -- 172.21.15.80:0/3879024764 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2580005430 con 0x7f259815b870 2024-05-10T04:23:59.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.290+0000 7f258ea00700 1 -- 172.21.15.80:0/3879024764 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25800038c0 con 0x7f259815b870 2024-05-10T04:23:59.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.290+0000 7f259da00700 1 -- 172.21.15.80:0/3879024764 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259813ceb0 con 0x7f259815b870 2024-05-10T04:23:59.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.290+0000 7f259da00700 1 -- 172.21.15.80:0/3879024764 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25981326d0 con 0x7f259815b870 2024-05-10T04:23:59.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.291+0000 7f259da00700 1 -- 172.21.15.80:0/3879024764 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2598074af0 con 0x7f259815b870 2024-05-10T04:23:59.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.292+0000 7f258ea00700 1 -- 172.21.15.80:0/3879024764 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2580003a20 con 0x7f259815b870 2024-05-10T04:23:59.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.293+0000 7f258ea00700 1 --2- 172.21.15.80:0/3879024764 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f257406ac90 0x7f257406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:59.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.293+0000 7f258ea00700 1 -- 172.21.15.80:0/3879024764 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2580088720 con 0x7f259815b870 2024-05-10T04:23:59.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.294+0000 7f2596a00700 1 --2- 172.21.15.80:0/3879024764 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f257406ac90 0x7f257406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:59.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.294+0000 7f2596a00700 1 --2- 172.21.15.80:0/3879024764 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f257406ac90 0x7f257406d1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f25980b5130 tx=0x7f2588008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:59.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.298+0000 7f258ea00700 1 -- 172.21.15.80:0/3879024764 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2580053860 con 0x7f259815b870 2024-05-10T04:23:59.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.506+0000 7f259da00700 1 -- 172.21.15.80:0/3879024764 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f259813dec0 con 0x7f259815b870 2024-05-10T04:23:59.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.507+0000 7f258ea00700 1 -- 172.21.15.80:0/3879024764 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16101 (secure 0 0 0) 0x7f2580056e80 con 0x7f259815b870 2024-05-10T04:23:59.509 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:23:59.509 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":34,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:23:55.996940+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:23:52.881736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T04:23:53.974964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:23:59.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.510+0000 7f259da00700 1 -- 172.21.15.80:0/3879024764 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f257406ac90 msgr2=0x7f257406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:59.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.510+0000 7f259da00700 1 --2- 172.21.15.80:0/3879024764 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f257406ac90 0x7f257406d1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f25980b5130 tx=0x7f2588008040 comp rx=0 tx=0).stop 2024-05-10T04:23:59.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.510+0000 7f259da00700 1 -- 172.21.15.80:0/3879024764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259815b870 msgr2=0x7f259813aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:59.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.510+0000 7f259da00700 1 --2- 172.21.15.80:0/3879024764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259815b870 0x7f259813aff0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f258000c450 tx=0x7f258000c810 comp rx=0 tx=0).stop 2024-05-10T04:23:59.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.510+0000 7f259da00700 1 -- 172.21.15.80:0/3879024764 shutdown_connections 2024-05-10T04:23:59.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.510+0000 7f259da00700 1 --2- 172.21.15.80:0/3879024764 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f257406ac90 0x7f257406d1a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:59.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.510+0000 7f259da00700 1 --2- 172.21.15.80:0/3879024764 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f259813b530 0x7f259815a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:59.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.510+0000 7f259da00700 1 --2- 172.21.15.80:0/3879024764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25980cdde0 0x7f2598132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:59.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.510+0000 7f259da00700 1 --2- 172.21.15.80:0/3879024764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259815b870 0x7f259813aff0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:59.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.510+0000 7f259da00700 1 -- 172.21.15.80:0/3879024764 >> 172.21.15.80:0/3879024764 conn(0x7f259806b470 msgr2=0x7f25980b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:59.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.510+0000 7f259da00700 1 -- 172.21.15.80:0/3879024764 shutdown_connections 2024-05-10T04:23:59.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.510+0000 7f259da00700 1 -- 172.21.15.80:0/3879024764 wait complete. 2024-05-10T04:23:59.539 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-10T04:23:59.539 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:23:59.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.798+0000 7f40b7e00700 1 Processor -- start 2024-05-10T04:23:59.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.798+0000 7f40b7e00700 1 -- start start 2024-05-10T04:23:59.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.800+0000 7f40b7e00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f40b015b870 0x7f40b015c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:59.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.800+0000 7f40b7e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f40b00b31d0 0x7f40b006d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:59.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.800+0000 7f40b7e00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b00cf360 con 0x7f40b00cdde0 2024-05-10T04:23:59.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.800+0000 7f40b7e00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b015c730 con 0x7f40b00b31d0 2024-05-10T04:23:59.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.800+0000 7f40b7e00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b00ce750 con 0x7f40b015b870 2024-05-10T04:23:59.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.800+0000 7f40b5e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f40b00b31d0 0x7f40b006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:59.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.800+0000 7f40b5e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f40b00b31d0 0x7f40b006d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59868/0 (socket says 172.21.15.80:59868) 2024-05-10T04:23:59.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.800+0000 7f40b5e00700 1 -- 172.21.15.80:0/1317606973 learned_addr learned my addr 172.21.15.80:0/1317606973 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:59.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.800+0000 7f40b5400700 1 --2- 172.21.15.80:0/1317606973 >> v2:172.21.15.106:3300/0 conn(0x7f40b015b870 0x7f40b015c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:59.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.800+0000 7f40b5e00700 1 -- 172.21.15.80:0/1317606973 >> v2:172.21.15.106:3300/0 conn(0x7f40b015b870 msgr2=0x7f40b015c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:59.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.800+0000 7f40b5e00700 1 --2- 172.21.15.80:0/1317606973 >> v2:172.21.15.106:3300/0 conn(0x7f40b015b870 0x7f40b015c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:59.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.800+0000 7f40b5e00700 1 -- 172.21.15.80:0/1317606973 >> v1:172.21.15.106:6789/0 conn(0x7f40b00cdde0 legacy=0x7f40b00b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:23:59.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.800+0000 7f40b5e00700 1 -- 172.21.15.80:0/1317606973 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b00cea30 con 0x7f40b00b31d0 2024-05-10T04:23:59.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.800+0000 7f40b5400700 1 --2- 172.21.15.80:0/1317606973 >> v2:172.21.15.106:3300/0 conn(0x7f40b015b870 0x7f40b015c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:23:59.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.801+0000 7f40b5e00700 1 --2- 172.21.15.80:0/1317606973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40b00b31d0 0x7f40b006d710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f40b0070b10 tx=0x7f40a800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22aa6aa6b9d6ae7c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:59.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.801+0000 7f40afe00700 1 -- 172.21.15.80:0/1317606973 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8010070 con 0x7f40b00b31d0 2024-05-10T04:23:59.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.801+0000 7f40afe00700 1 -- 172.21.15.80:0/1317606973 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a800dd50 con 0x7f40b00b31d0 2024-05-10T04:23:59.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.801+0000 7f40afe00700 1 -- 172.21.15.80:0/1317606973 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a800b310 con 0x7f40b00b31d0 2024-05-10T04:23:59.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.802+0000 7f40b7e00700 1 -- 172.21.15.80:0/1317606973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40b00b31d0 msgr2=0x7f40b006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:59.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.802+0000 7f40b7e00700 1 --2- 172.21.15.80:0/1317606973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40b00b31d0 0x7f40b006d710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f40b0070b10 tx=0x7f40a800d430 comp rx=0 tx=0).stop 2024-05-10T04:23:59.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.802+0000 7f40b7e00700 1 -- 172.21.15.80:0/1317606973 shutdown_connections 2024-05-10T04:23:59.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.802+0000 7f40b7e00700 1 --2- 172.21.15.80:0/1317606973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40b00b31d0 0x7f40b006d710 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:59.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.802+0000 7f40b7e00700 1 --2- 172.21.15.80:0/1317606973 >> v2:172.21.15.106:3300/0 conn(0x7f40b015b870 0x7f40b015c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:59.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.802+0000 7f40b7e00700 1 -- 172.21.15.80:0/1317606973 >> 172.21.15.80:0/1317606973 conn(0x7f40b006b470 msgr2=0x7f40b00b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:23:59.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.802+0000 7f40b7e00700 1 -- 172.21.15.80:0/1317606973 shutdown_connections 2024-05-10T04:23:59.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.802+0000 7f40b7e00700 1 -- 172.21.15.80:0/1317606973 wait complete. 2024-05-10T04:23:59.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.804+0000 7f40b7e00700 1 Processor -- start 2024-05-10T04:23:59.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.804+0000 7f40b7e00700 1 -- start start 2024-05-10T04:23:59.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.806+0000 7f40b7e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40b00cdde0 0x7f40b01f8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:59.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.806+0000 7f40b7e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40b015b870 0x7f40b013c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:59.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.806+0000 7f40b7e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40b013c5b0 0x7f40b015c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:59.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.806+0000 7f40b7e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b015df40 con 0x7f40b015b870 2024-05-10T04:23:59.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.806+0000 7f40b7e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b013b0a0 con 0x7f40b00cdde0 2024-05-10T04:23:59.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.806+0000 7f40b7e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b01f8a40 con 0x7f40b013c5b0 2024-05-10T04:23:59.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.806+0000 7f40b4a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40b015b870 0x7f40b013c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:59.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.806+0000 7f40b4a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40b015b870 0x7f40b013c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59872/0 (socket says 172.21.15.80:59872) 2024-05-10T04:23:59.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.806+0000 7f40b4a00700 1 -- 172.21.15.80:0/3825984659 learned_addr learned my addr 172.21.15.80:0/3825984659 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:23:59.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.806+0000 7f40b5400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40b00cdde0 0x7f40b01f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:59.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.806+0000 7f40b5e00700 1 --2- 172.21.15.80:0/3825984659 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40b013c5b0 0x7f40b015c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:59.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.806+0000 7f40b4a00700 1 -- 172.21.15.80:0/3825984659 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40b013c5b0 msgr2=0x7f40b015c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:59.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.806+0000 7f40b4a00700 1 --2- 172.21.15.80:0/3825984659 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40b013c5b0 0x7f40b015c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:59.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.806+0000 7f40b4a00700 1 -- 172.21.15.80:0/3825984659 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40b00cdde0 msgr2=0x7f40b01f8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:23:59.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.806+0000 7f40b4a00700 1 --2- 172.21.15.80:0/3825984659 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40b00cdde0 0x7f40b01f8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:23:59.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.806+0000 7f40b4a00700 1 -- 172.21.15.80:0/3825984659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a800bd40 con 0x7f40b015b870 2024-05-10T04:23:59.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.807+0000 7f40b4a00700 1 --2- 172.21.15.80:0/3825984659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40b015b870 0x7f40b013c070 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f409c00b4a0 tx=0x7f409c00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:59.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.807+0000 7f40ad600700 1 -- 172.21.15.80:0/3825984659 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c011830 con 0x7f40b015b870 2024-05-10T04:23:59.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.807+0000 7f40ad600700 1 -- 172.21.15.80:0/3825984659 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c011990 con 0x7f40b015b870 2024-05-10T04:23:59.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.807+0000 7f40ad600700 1 -- 172.21.15.80:0/3825984659 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c011d40 con 0x7f40b015b870 2024-05-10T04:23:59.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.807+0000 7f40b7e00700 1 -- 172.21.15.80:0/3825984659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b015e150 con 0x7f40b015b870 2024-05-10T04:23:59.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.807+0000 7f40b7e00700 1 -- 172.21.15.80:0/3825984659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b015e710 con 0x7f40b015b870 2024-05-10T04:23:59.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.808+0000 7f40b7e00700 1 -- 172.21.15.80:0/3825984659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b0074af0 con 0x7f40b015b870 2024-05-10T04:23:59.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.809+0000 7f40ad600700 1 -- 172.21.15.80:0/3825984659 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f409c01a400 con 0x7f40b015b870 2024-05-10T04:23:59.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.810+0000 7f40ad600700 1 --2- 172.21.15.80:0/3825984659 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f409006acc0 0x7f409006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:23:59.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.810+0000 7f40ad600700 1 -- 172.21.15.80:0/3825984659 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f409c088fe0 con 0x7f40b015b870 2024-05-10T04:23:59.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.811+0000 7f40b5400700 1 --2- 172.21.15.80:0/3825984659 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f409006acc0 0x7f409006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:23:59.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.811+0000 7f40b5400700 1 --2- 172.21.15.80:0/3825984659 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f409006acc0 0x7f409006d1d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f40b00b5130 tx=0x7f40a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:23:59.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:23:59.815+0000 7f40ad600700 1 -- 172.21.15.80:0/3825984659 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f409c0540d0 con 0x7f40b015b870 2024-05-10T04:24:00.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.012+0000 7f40b7e00700 1 -- 172.21.15.80:0/3825984659 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40b00ceff0 con 0x7f409006acc0 2024-05-10T04:24:00.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.023+0000 7f40ad600700 1 -- 172.21.15.80:0/3825984659 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288539 (secure 0 0 0) 0x7f40a400c040 con 0x7f409006acc0 2024-05-10T04:24:00.029 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:24:00.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.027+0000 7f40b7e00700 1 -- 172.21.15.80:0/3825984659 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f409006acc0 msgr2=0x7f409006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:00.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.028+0000 7f40b7e00700 1 --2- 172.21.15.80:0/3825984659 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f409006acc0 0x7f409006d1d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f40b00b5130 tx=0x7f40a4008040 comp rx=0 tx=0).stop 2024-05-10T04:24:00.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.028+0000 7f40b7e00700 1 -- 172.21.15.80:0/3825984659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40b015b870 msgr2=0x7f40b013c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:00.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.028+0000 7f40b7e00700 1 --2- 172.21.15.80:0/3825984659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40b015b870 0x7f40b013c070 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f409c00b4a0 tx=0x7f409c00b7b0 comp rx=0 tx=0).stop 2024-05-10T04:24:00.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.028+0000 7f40b7e00700 1 -- 172.21.15.80:0/3825984659 shutdown_connections 2024-05-10T04:24:00.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.028+0000 7f40b7e00700 1 --2- 172.21.15.80:0/3825984659 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f409006acc0 0x7f409006d1d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:00.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.028+0000 7f40b7e00700 1 --2- 172.21.15.80:0/3825984659 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40b013c5b0 0x7f40b015c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:00.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.028+0000 7f40b7e00700 1 --2- 172.21.15.80:0/3825984659 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40b00cdde0 0x7f40b01f8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:00.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.028+0000 7f40b7e00700 1 --2- 172.21.15.80:0/3825984659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40b015b870 0x7f40b013c070 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:00.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.028+0000 7f40b7e00700 1 -- 172.21.15.80:0/3825984659 >> 172.21.15.80:0/3825984659 conn(0x7f40b006b470 msgr2=0x7f40b015ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:00.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.028+0000 7f40b7e00700 1 -- 172.21.15.80:0/3825984659 shutdown_connections 2024-05-10T04:24:00.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.028+0000 7f40b7e00700 1 -- 172.21.15.80:0/3825984659 wait complete. 2024-05-10T04:24:00.032 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-10T04:24:00.054 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-05-10T04:23:58.755216+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220284,"kb_used_data":4080,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754436,"statfs":{"total":773094113280,"available":772868542464,"internally_reserved":0,"allocated":4177920,"data_stored":2328965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.350997"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.027672+0000","last_change":"2024-05-10T04:23:55.023172+0000","last_active":"2024-05-10T04:23:55.027672+0000","last_peered":"2024-05-10T04:23:55.027672+0000","last_clean":"2024-05-10T04:23:55.027672+0000","last_became_active":"2024-05-10T04:23:55.022860+0000","last_became_peered":"2024-05-10T04:23:55.022860+0000","last_unstale":"2024-05-10T04:23:55.027672+0000","last_undegraded":"2024-05-10T04:23:55.027672+0000","last_fullsized":"2024-05-10T04:23:55.027672+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:41:30.998827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036389+0000","last_change":"2024-05-10T04:23:55.030688+0000","last_active":"2024-05-10T04:23:55.036389+0000","last_peered":"2024-05-10T04:23:55.036389+0000","last_clean":"2024-05-10T04:23:55.036389+0000","last_became_active":"2024-05-10T04:23:55.029897+0000","last_became_peered":"2024-05-10T04:23:55.029897+0000","last_unstale":"2024-05-10T04:23:55.036389+0000","last_undegraded":"2024-05-10T04:23:55.036389+0000","last_fullsized":"2024-05-10T04:23:55.036389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:01.635536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032715+0000","last_change":"2024-05-10T04:23:55.028906+0000","last_active":"2024-05-10T04:23:55.032715+0000","last_peered":"2024-05-10T04:23:55.032715+0000","last_clean":"2024-05-10T04:23:55.032715+0000","last_became_active":"2024-05-10T04:23:55.028187+0000","last_became_peered":"2024-05-10T04:23:55.028187+0000","last_unstale":"2024-05-10T04:23:55.032715+0000","last_undegraded":"2024-05-10T04:23:55.032715+0000","last_fullsized":"2024-05-10T04:23:55.032715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:14.166931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032121+0000","last_change":"2024-05-10T04:23:55.026826+0000","last_active":"2024-05-10T04:23:55.032121+0000","last_peered":"2024-05-10T04:23:55.032121+0000","last_clean":"2024-05-10T04:23:55.032121+0000","last_became_active":"2024-05-10T04:23:55.024318+0000","last_became_peered":"2024-05-10T04:23:55.024318+0000","last_unstale":"2024-05-10T04:23:55.032121+0000","last_undegraded":"2024-05-10T04:23:55.032121+0000","last_fullsized":"2024-05-10T04:23:55.032121+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:52:41.098034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036311+0000","last_change":"2024-05-10T04:23:55.023194+0000","last_active":"2024-05-10T04:23:55.036311+0000","last_peered":"2024-05-10T04:23:55.036311+0000","last_clean":"2024-05-10T04:23:55.036311+0000","last_became_active":"2024-05-10T04:23:55.022856+0000","last_became_peered":"2024-05-10T04:23:55.022856+0000","last_unstale":"2024-05-10T04:23:55.036311+0000","last_undegraded":"2024-05-10T04:23:55.036311+0000","last_fullsized":"2024-05-10T04:23:55.036311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:27:31.569256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.035992+0000","last_change":"2024-05-10T04:23:55.026661+0000","last_active":"2024-05-10T04:23:55.035992+0000","last_peered":"2024-05-10T04:23:55.035992+0000","last_clean":"2024-05-10T04:23:55.035992+0000","last_became_active":"2024-05-10T04:23:55.026365+0000","last_became_peered":"2024-05-10T04:23:55.026365+0000","last_unstale":"2024-05-10T04:23:55.035992+0000","last_undegraded":"2024-05-10T04:23:55.035992+0000","last_fullsized":"2024-05-10T04:23:55.035992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:42.289326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032407+0000","last_change":"2024-05-10T04:23:55.024369+0000","last_active":"2024-05-10T04:23:55.032407+0000","last_peered":"2024-05-10T04:23:55.032407+0000","last_clean":"2024-05-10T04:23:55.032407+0000","last_became_active":"2024-05-10T04:23:55.024088+0000","last_became_peered":"2024-05-10T04:23:55.024088+0000","last_unstale":"2024-05-10T04:23:55.032407+0000","last_undegraded":"2024-05-10T04:23:55.032407+0000","last_fullsized":"2024-05-10T04:23:55.032407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:07.507478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.031112+0000","last_change":"2024-05-10T04:23:55.022650+0000","last_active":"2024-05-10T04:23:55.031112+0000","last_peered":"2024-05-10T04:23:55.031112+0000","last_clean":"2024-05-10T04:23:55.031112+0000","last_became_active":"2024-05-10T04:23:55.022291+0000","last_became_peered":"2024-05-10T04:23:55.022291+0000","last_unstale":"2024-05-10T04:23:55.031112+0000","last_undegraded":"2024-05-10T04:23:55.031112+0000","last_fullsized":"2024-05-10T04:23:55.031112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:30:56.833846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028269+0000","last_change":"2024-05-10T04:23:55.022738+0000","last_active":"2024-05-10T04:23:55.028269+0000","last_peered":"2024-05-10T04:23:55.028269+0000","last_clean":"2024-05-10T04:23:55.028269+0000","last_became_active":"2024-05-10T04:23:55.022382+0000","last_became_peered":"2024-05-10T04:23:55.022382+0000","last_unstale":"2024-05-10T04:23:55.028269+0000","last_undegraded":"2024-05-10T04:23:55.028269+0000","last_fullsized":"2024-05-10T04:23:55.028269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:40.134491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.029642+0000","last_change":"2024-05-10T04:23:55.024631+0000","last_active":"2024-05-10T04:23:55.029642+0000","last_peered":"2024-05-10T04:23:55.029642+0000","last_clean":"2024-05-10T04:23:55.029642+0000","last_became_active":"2024-05-10T04:23:55.024349+0000","last_became_peered":"2024-05-10T04:23:55.024349+0000","last_unstale":"2024-05-10T04:23:55.029642+0000","last_undegraded":"2024-05-10T04:23:55.029642+0000","last_fullsized":"2024-05-10T04:23:55.029642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:42.289326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032717+0000","last_change":"2024-05-10T04:23:55.025581+0000","last_active":"2024-05-10T04:23:55.032717+0000","last_peered":"2024-05-10T04:23:55.032717+0000","last_clean":"2024-05-10T04:23:55.032717+0000","last_became_active":"2024-05-10T04:23:55.024478+0000","last_became_peered":"2024-05-10T04:23:55.024478+0000","last_unstale":"2024-05-10T04:23:55.032717+0000","last_undegraded":"2024-05-10T04:23:55.032717+0000","last_fullsized":"2024-05-10T04:23:55.032717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:24.023261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028709+0000","last_change":"2024-05-10T04:23:55.021083+0000","last_active":"2024-05-10T04:23:55.028709+0000","last_peered":"2024-05-10T04:23:55.028709+0000","last_clean":"2024-05-10T04:23:55.028709+0000","last_became_active":"2024-05-10T04:23:55.020786+0000","last_became_peered":"2024-05-10T04:23:55.020786+0000","last_unstale":"2024-05-10T04:23:55.028709+0000","last_undegraded":"2024-05-10T04:23:55.028709+0000","last_fullsized":"2024-05-10T04:23:55.028709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:10:02.796375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036294+0000","last_change":"2024-05-10T04:23:55.018416+0000","last_active":"2024-05-10T04:23:55.036294+0000","last_peered":"2024-05-10T04:23:55.036294+0000","last_clean":"2024-05-10T04:23:55.036294+0000","last_became_active":"2024-05-10T04:23:55.018205+0000","last_became_peered":"2024-05-10T04:23:55.018205+0000","last_unstale":"2024-05-10T04:23:55.036294+0000","last_undegraded":"2024-05-10T04:23:55.036294+0000","last_fullsized":"2024-05-10T04:23:55.036294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:11:15.929034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.038785+0000","last_change":"2024-05-10T04:23:55.031460+0000","last_active":"2024-05-10T04:23:55.038785+0000","last_peered":"2024-05-10T04:23:55.038785+0000","last_clean":"2024-05-10T04:23:55.038785+0000","last_became_active":"2024-05-10T04:23:55.031128+0000","last_became_peered":"2024-05-10T04:23:55.031128+0000","last_unstale":"2024-05-10T04:23:55.038785+0000","last_undegraded":"2024-05-10T04:23:55.038785+0000","last_fullsized":"2024-05-10T04:23:55.038785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:51:44.675640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028724+0000","last_change":"2024-05-10T04:23:55.021202+0000","last_active":"2024-05-10T04:23:55.028724+0000","last_peered":"2024-05-10T04:23:55.028724+0000","last_clean":"2024-05-10T04:23:55.028724+0000","last_became_active":"2024-05-10T04:23:55.019962+0000","last_became_peered":"2024-05-10T04:23:55.019962+0000","last_unstale":"2024-05-10T04:23:55.028724+0000","last_undegraded":"2024-05-10T04:23:55.028724+0000","last_fullsized":"2024-05-10T04:23:55.028724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:42.289326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.024476+0000","last_change":"2024-05-10T04:23:55.019043+0000","last_active":"2024-05-10T04:23:55.024476+0000","last_peered":"2024-05-10T04:23:55.024476+0000","last_clean":"2024-05-10T04:23:55.024476+0000","last_became_active":"2024-05-10T04:23:55.018771+0000","last_became_peered":"2024-05-10T04:23:55.018771+0000","last_unstale":"2024-05-10T04:23:55.024476+0000","last_undegraded":"2024-05-10T04:23:55.024476+0000","last_fullsized":"2024-05-10T04:23:55.024476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:57:21.334316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032641+0000","last_change":"2024-05-10T04:23:55.025882+0000","last_active":"2024-05-10T04:23:55.032641+0000","last_peered":"2024-05-10T04:23:55.032641+0000","last_clean":"2024-05-10T04:23:55.032641+0000","last_became_active":"2024-05-10T04:23:55.025436+0000","last_became_peered":"2024-05-10T04:23:55.025436+0000","last_unstale":"2024-05-10T04:23:55.032641+0000","last_undegraded":"2024-05-10T04:23:55.032641+0000","last_fullsized":"2024-05-10T04:23:55.032641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:22:37.238341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.035964+0000","last_change":"2024-05-10T04:23:55.026377+0000","last_active":"2024-05-10T04:23:55.035964+0000","last_peered":"2024-05-10T04:23:55.035964+0000","last_clean":"2024-05-10T04:23:55.035964+0000","last_became_active":"2024-05-10T04:23:55.026120+0000","last_became_peered":"2024-05-10T04:23:55.026120+0000","last_unstale":"2024-05-10T04:23:55.035964+0000","last_undegraded":"2024-05-10T04:23:55.035964+0000","last_fullsized":"2024-05-10T04:23:55.035964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:14:31.390175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036355+0000","last_change":"2024-05-10T04:23:55.030641+0000","last_active":"2024-05-10T04:23:55.036355+0000","last_peered":"2024-05-10T04:23:55.036355+0000","last_clean":"2024-05-10T04:23:55.036355+0000","last_became_active":"2024-05-10T04:23:55.030111+0000","last_became_peered":"2024-05-10T04:23:55.030111+0000","last_unstale":"2024-05-10T04:23:55.036355+0000","last_undegraded":"2024-05-10T04:23:55.036355+0000","last_fullsized":"2024-05-10T04:23:55.036355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:07.507478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.038630+0000","last_change":"2024-05-10T04:23:55.031599+0000","last_active":"2024-05-10T04:23:55.038630+0000","last_peered":"2024-05-10T04:23:55.038630+0000","last_clean":"2024-05-10T04:23:55.038630+0000","last_became_active":"2024-05-10T04:23:55.031290+0000","last_became_peered":"2024-05-10T04:23:55.031290+0000","last_unstale":"2024-05-10T04:23:55.038630+0000","last_undegraded":"2024-05-10T04:23:55.038630+0000","last_fullsized":"2024-05-10T04:23:55.038630+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:34.975957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.017497+0000","last_change":"2024-05-10T04:23:55.012647+0000","last_active":"2024-05-10T04:23:55.017497+0000","last_peered":"2024-05-10T04:23:55.017497+0000","last_clean":"2024-05-10T04:23:55.017497+0000","last_became_active":"2024-05-10T04:23:55.012334+0000","last_became_peered":"2024-05-10T04:23:55.012334+0000","last_unstale":"2024-05-10T04:23:55.017497+0000","last_undegraded":"2024-05-10T04:23:55.017497+0000","last_fullsized":"2024-05-10T04:23:55.017497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:40.442402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028083+0000","last_change":"2024-05-10T04:23:55.018396+0000","last_active":"2024-05-10T04:23:55.028083+0000","last_peered":"2024-05-10T04:23:55.028083+0000","last_clean":"2024-05-10T04:23:55.028083+0000","last_became_active":"2024-05-10T04:23:55.018037+0000","last_became_peered":"2024-05-10T04:23:55.018037+0000","last_unstale":"2024-05-10T04:23:55.028083+0000","last_undegraded":"2024-05-10T04:23:55.028083+0000","last_fullsized":"2024-05-10T04:23:55.028083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:57:21.334316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.020584+0000","last_change":"2024-05-10T04:23:55.014470+0000","last_active":"2024-05-10T04:23:55.020584+0000","last_peered":"2024-05-10T04:23:55.020584+0000","last_clean":"2024-05-10T04:23:55.020584+0000","last_became_active":"2024-05-10T04:23:55.014200+0000","last_became_peered":"2024-05-10T04:23:55.014200+0000","last_unstale":"2024-05-10T04:23:55.020584+0000","last_undegraded":"2024-05-10T04:23:55.020584+0000","last_fullsized":"2024-05-10T04:23:55.020584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:09:08.019512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036874+0000","last_change":"2024-05-10T04:23:55.035806+0000","last_active":"2024-05-10T04:23:55.036874+0000","last_peered":"2024-05-10T04:23:55.036874+0000","last_clean":"2024-05-10T04:23:55.036874+0000","last_became_active":"2024-05-10T04:23:55.035494+0000","last_became_peered":"2024-05-10T04:23:55.035494+0000","last_unstale":"2024-05-10T04:23:55.036874+0000","last_undegraded":"2024-05-10T04:23:55.036874+0000","last_fullsized":"2024-05-10T04:23:55.036874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:52:41.098034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.025415+0000","last_change":"2024-05-10T04:23:55.018189+0000","last_active":"2024-05-10T04:23:55.025415+0000","last_peered":"2024-05-10T04:23:55.025415+0000","last_clean":"2024-05-10T04:23:55.025415+0000","last_became_active":"2024-05-10T04:23:55.017107+0000","last_became_peered":"2024-05-10T04:23:55.017107+0000","last_unstale":"2024-05-10T04:23:55.025415+0000","last_undegraded":"2024-05-10T04:23:55.025415+0000","last_fullsized":"2024-05-10T04:23:55.025415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:32.626346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.023027+0000","last_change":"2024-05-10T04:23:55.020001+0000","last_active":"2024-05-10T04:23:55.023027+0000","last_peered":"2024-05-10T04:23:55.023027+0000","last_clean":"2024-05-10T04:23:55.023027+0000","last_became_active":"2024-05-10T04:23:55.019691+0000","last_became_peered":"2024-05-10T04:23:55.019691+0000","last_unstale":"2024-05-10T04:23:55.023027+0000","last_undegraded":"2024-05-10T04:23:55.023027+0000","last_fullsized":"2024-05-10T04:23:55.023027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:22:37.238341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.026205+0000","last_change":"2024-05-10T04:23:55.023008+0000","last_active":"2024-05-10T04:23:55.026205+0000","last_peered":"2024-05-10T04:23:55.026205+0000","last_clean":"2024-05-10T04:23:55.026205+0000","last_became_active":"2024-05-10T04:23:55.022545+0000","last_became_peered":"2024-05-10T04:23:55.022545+0000","last_unstale":"2024-05-10T04:23:55.026205+0000","last_undegraded":"2024-05-10T04:23:55.026205+0000","last_fullsized":"2024-05-10T04:23:55.026205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:10:02.796375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036301+0000","last_change":"2024-05-10T04:23:55.033633+0000","last_active":"2024-05-10T04:23:55.036301+0000","last_peered":"2024-05-10T04:23:55.036301+0000","last_clean":"2024-05-10T04:23:55.036301+0000","last_became_active":"2024-05-10T04:23:55.033319+0000","last_became_peered":"2024-05-10T04:23:55.033319+0000","last_unstale":"2024-05-10T04:23:55.036301+0000","last_undegraded":"2024-05-10T04:23:55.036301+0000","last_fullsized":"2024-05-10T04:23:55.036301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:30:56.833846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.021250+0000","last_change":"2024-05-10T04:23:55.015356+0000","last_active":"2024-05-10T04:23:55.021250+0000","last_peered":"2024-05-10T04:23:55.021250+0000","last_clean":"2024-05-10T04:23:55.021250+0000","last_became_active":"2024-05-10T04:23:55.015088+0000","last_became_peered":"2024-05-10T04:23:55.015088+0000","last_unstale":"2024-05-10T04:23:55.021250+0000","last_undegraded":"2024-05-10T04:23:55.021250+0000","last_fullsized":"2024-05-10T04:23:55.021250+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:32.626346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032462+0000","last_change":"2024-05-10T04:23:55.024580+0000","last_active":"2024-05-10T04:23:55.032462+0000","last_peered":"2024-05-10T04:23:55.032462+0000","last_clean":"2024-05-10T04:23:55.032462+0000","last_became_active":"2024-05-10T04:23:55.024227+0000","last_became_peered":"2024-05-10T04:23:55.024227+0000","last_unstale":"2024-05-10T04:23:55.032462+0000","last_undegraded":"2024-05-10T04:23:55.032462+0000","last_fullsized":"2024-05-10T04:23:55.032462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:13.820894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.035252+0000","last_change":"2024-05-10T04:23:55.031448+0000","last_active":"2024-05-10T04:23:55.035252+0000","last_peered":"2024-05-10T04:23:55.035252+0000","last_clean":"2024-05-10T04:23:55.035252+0000","last_became_active":"2024-05-10T04:23:55.031102+0000","last_became_peered":"2024-05-10T04:23:55.031102+0000","last_unstale":"2024-05-10T04:23:55.035252+0000","last_undegraded":"2024-05-10T04:23:55.035252+0000","last_fullsized":"2024-05-10T04:23:55.035252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:43.361132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.024518+0000","last_change":"2024-05-10T04:23:55.019123+0000","last_active":"2024-05-10T04:23:55.024518+0000","last_peered":"2024-05-10T04:23:55.024518+0000","last_clean":"2024-05-10T04:23:55.024518+0000","last_became_active":"2024-05-10T04:23:55.017139+0000","last_became_peered":"2024-05-10T04:23:55.017139+0000","last_unstale":"2024-05-10T04:23:55.024518+0000","last_undegraded":"2024-05-10T04:23:55.024518+0000","last_fullsized":"2024-05-10T04:23:55.024518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:34:45.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.024608+0000","last_change":"2024-05-10T04:23:55.014729+0000","last_active":"2024-05-10T04:23:55.024608+0000","last_peered":"2024-05-10T04:23:55.024608+0000","last_clean":"2024-05-10T04:23:55.024608+0000","last_became_active":"2024-05-10T04:23:55.014457+0000","last_became_peered":"2024-05-10T04:23:55.014457+0000","last_unstale":"2024-05-10T04:23:55.024608+0000","last_undegraded":"2024-05-10T04:23:55.024608+0000","last_fullsized":"2024-05-10T04:23:55.024608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:11:15.929034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.030673+0000","last_change":"2024-05-10T04:23:54.435405+0000","last_active":"2024-05-10T04:23:55.030673+0000","last_peered":"2024-05-10T04:23:55.030673+0000","last_clean":"2024-05-10T04:23:55.030673+0000","last_became_active":"2024-05-10T04:23:54.435070+0000","last_became_peered":"2024-05-10T04:23:54.435070+0000","last_unstale":"2024-05-10T04:23:55.030673+0000","last_undegraded":"2024-05-10T04:23:55.030673+0000","last_fullsized":"2024-05-10T04:23:55.030673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:04:24.597037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.035161+0000","last_change":"2024-05-10T04:23:55.030628+0000","last_active":"2024-05-10T04:23:55.035161+0000","last_peered":"2024-05-10T04:23:55.035161+0000","last_clean":"2024-05-10T04:23:55.035161+0000","last_became_active":"2024-05-10T04:23:55.030280+0000","last_became_peered":"2024-05-10T04:23:55.030280+0000","last_unstale":"2024-05-10T04:23:55.035161+0000","last_undegraded":"2024-05-10T04:23:55.035161+0000","last_fullsized":"2024-05-10T04:23:55.035161+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:34.975957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.024298+0000","last_change":"2024-05-10T04:23:54.438843+0000","last_active":"2024-05-10T04:23:55.024298+0000","last_peered":"2024-05-10T04:23:55.024298+0000","last_clean":"2024-05-10T04:23:55.024298+0000","last_became_active":"2024-05-10T04:23:54.438511+0000","last_became_peered":"2024-05-10T04:23:54.438511+0000","last_unstale":"2024-05-10T04:23:55.024298+0000","last_undegraded":"2024-05-10T04:23:55.024298+0000","last_fullsized":"2024-05-10T04:23:55.024298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:14.808820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028175+0000","last_change":"2024-05-10T04:23:55.022737+0000","last_active":"2024-05-10T04:23:55.028175+0000","last_peered":"2024-05-10T04:23:55.028175+0000","last_clean":"2024-05-10T04:23:55.028175+0000","last_became_active":"2024-05-10T04:23:55.022404+0000","last_became_peered":"2024-05-10T04:23:55.022404+0000","last_unstale":"2024-05-10T04:23:55.028175+0000","last_undegraded":"2024-05-10T04:23:55.028175+0000","last_fullsized":"2024-05-10T04:23:55.028175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:43.064685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.030372+0000","last_change":"2024-05-10T04:23:54.441907+0000","last_active":"2024-05-10T04:23:55.030372+0000","last_peered":"2024-05-10T04:23:55.030372+0000","last_clean":"2024-05-10T04:23:55.030372+0000","last_became_active":"2024-05-10T04:23:54.441656+0000","last_became_peered":"2024-05-10T04:23:54.441656+0000","last_unstale":"2024-05-10T04:23:55.030372+0000","last_undegraded":"2024-05-10T04:23:55.030372+0000","last_fullsized":"2024-05-10T04:23:55.030372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:27:30.562606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.026184+0000","last_change":"2024-05-10T04:23:55.022849+0000","last_active":"2024-05-10T04:23:55.026184+0000","last_peered":"2024-05-10T04:23:55.026184+0000","last_clean":"2024-05-10T04:23:55.026184+0000","last_became_active":"2024-05-10T04:23:55.022285+0000","last_became_peered":"2024-05-10T04:23:55.022285+0000","last_unstale":"2024-05-10T04:23:55.026184+0000","last_undegraded":"2024-05-10T04:23:55.026184+0000","last_fullsized":"2024-05-10T04:23:55.026184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:57:21.334316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028464+0000","last_change":"2024-05-10T04:23:54.441238+0000","last_active":"2024-05-10T04:23:55.028464+0000","last_peered":"2024-05-10T04:23:55.028464+0000","last_clean":"2024-05-10T04:23:55.028464+0000","last_became_active":"2024-05-10T04:23:54.440912+0000","last_became_peered":"2024-05-10T04:23:54.440912+0000","last_unstale":"2024-05-10T04:23:55.028464+0000","last_undegraded":"2024-05-10T04:23:55.028464+0000","last_fullsized":"2024-05-10T04:23:55.028464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:04:24.597037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.016907+0000","last_change":"2024-05-10T04:23:55.014500+0000","last_active":"2024-05-10T04:23:55.016907+0000","last_peered":"2024-05-10T04:23:55.016907+0000","last_clean":"2024-05-10T04:23:55.016907+0000","last_became_active":"2024-05-10T04:23:55.014179+0000","last_became_peered":"2024-05-10T04:23:55.014179+0000","last_unstale":"2024-05-10T04:23:55.016907+0000","last_undegraded":"2024-05-10T04:23:55.016907+0000","last_fullsized":"2024-05-10T04:23:55.016907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:42.620729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.023491+0000","last_change":"2024-05-10T04:23:54.437364+0000","last_active":"2024-05-10T04:23:55.023491+0000","last_peered":"2024-05-10T04:23:55.023491+0000","last_clean":"2024-05-10T04:23:55.023491+0000","last_became_active":"2024-05-10T04:23:54.436999+0000","last_became_peered":"2024-05-10T04:23:54.436999+0000","last_unstale":"2024-05-10T04:23:55.023491+0000","last_undegraded":"2024-05-10T04:23:55.023491+0000","last_fullsized":"2024-05-10T04:23:55.023491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:08:10.966132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036282+0000","last_change":"2024-05-10T04:23:55.033643+0000","last_active":"2024-05-10T04:23:55.036282+0000","last_peered":"2024-05-10T04:23:55.036282+0000","last_clean":"2024-05-10T04:23:55.036282+0000","last_became_active":"2024-05-10T04:23:55.033296+0000","last_became_peered":"2024-05-10T04:23:55.033296+0000","last_unstale":"2024-05-10T04:23:55.036282+0000","last_undegraded":"2024-05-10T04:23:55.036282+0000","last_fullsized":"2024-05-10T04:23:55.036282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:40.134491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028004+0000","last_change":"2024-05-10T04:23:54.435984+0000","last_active":"2024-05-10T04:23:55.028004+0000","last_peered":"2024-05-10T04:23:55.028004+0000","last_clean":"2024-05-10T04:23:55.028004+0000","last_became_active":"2024-05-10T04:23:54.434597+0000","last_became_peered":"2024-05-10T04:23:54.434597+0000","last_unstale":"2024-05-10T04:23:55.028004+0000","last_undegraded":"2024-05-10T04:23:55.028004+0000","last_fullsized":"2024-05-10T04:23:55.028004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:44:41.238646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028361+0000","last_change":"2024-05-10T04:23:55.019195+0000","last_active":"2024-05-10T04:23:55.028361+0000","last_peered":"2024-05-10T04:23:55.028361+0000","last_clean":"2024-05-10T04:23:55.028361+0000","last_became_active":"2024-05-10T04:23:55.018930+0000","last_became_peered":"2024-05-10T04:23:55.018930+0000","last_unstale":"2024-05-10T04:23:55.028361+0000","last_undegraded":"2024-05-10T04:23:55.028361+0000","last_fullsized":"2024-05-10T04:23:55.028361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:34.975957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.009110+0000","last_change":"2024-05-10T04:23:54.422811+0000","last_active":"2024-05-10T04:23:55.009110+0000","last_peered":"2024-05-10T04:23:55.009110+0000","last_clean":"2024-05-10T04:23:55.009110+0000","last_became_active":"2024-05-10T04:23:54.422548+0000","last_became_peered":"2024-05-10T04:23:54.422548+0000","last_unstale":"2024-05-10T04:23:55.009110+0000","last_undegraded":"2024-05-10T04:23:55.009110+0000","last_fullsized":"2024-05-10T04:23:55.009110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:41:29.992176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.029805+0000","last_change":"2024-05-10T04:23:55.024027+0000","last_active":"2024-05-10T04:23:55.029805+0000","last_peered":"2024-05-10T04:23:55.029805+0000","last_clean":"2024-05-10T04:23:55.029805+0000","last_became_active":"2024-05-10T04:23:55.023832+0000","last_became_peered":"2024-05-10T04:23:55.023832+0000","last_unstale":"2024-05-10T04:23:55.029805+0000","last_undegraded":"2024-05-10T04:23:55.029805+0000","last_fullsized":"2024-05-10T04:23:55.029805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:43.064685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.001926+0000","last_change":"2024-05-10T04:23:54.434880+0000","last_active":"2024-05-10T04:23:55.001926+0000","last_peered":"2024-05-10T04:23:55.001926+0000","last_clean":"2024-05-10T04:23:55.001926+0000","last_became_active":"2024-05-10T04:23:54.434551+0000","last_became_peered":"2024-05-10T04:23:54.434551+0000","last_unstale":"2024-05-10T04:23:55.001926+0000","last_undegraded":"2024-05-10T04:23:55.001926+0000","last_fullsized":"2024-05-10T04:23:55.001926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:04:24.597037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036340+0000","last_change":"2024-05-10T04:23:55.034356+0000","last_active":"2024-05-10T04:23:55.036340+0000","last_peered":"2024-05-10T04:23:55.036340+0000","last_clean":"2024-05-10T04:23:55.036340+0000","last_became_active":"2024-05-10T04:23:55.034038+0000","last_became_peered":"2024-05-10T04:23:55.034038+0000","last_unstale":"2024-05-10T04:23:55.036340+0000","last_undegraded":"2024-05-10T04:23:55.036340+0000","last_fullsized":"2024-05-10T04:23:55.036340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:51:44.675640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.012888+0000","last_change":"2024-05-10T04:23:54.430158+0000","last_active":"2024-05-10T04:23:55.012888+0000","last_peered":"2024-05-10T04:23:55.012888+0000","last_clean":"2024-05-10T04:23:55.012888+0000","last_became_active":"2024-05-10T04:23:54.429813+0000","last_became_peered":"2024-05-10T04:23:54.429813+0000","last_unstale":"2024-05-10T04:23:55.012888+0000","last_undegraded":"2024-05-10T04:23:55.012888+0000","last_fullsized":"2024-05-10T04:23:55.012888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:43.170628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.035903+0000","last_change":"2024-05-10T04:23:55.029472+0000","last_active":"2024-05-10T04:23:55.035903+0000","last_peered":"2024-05-10T04:23:55.035903+0000","last_clean":"2024-05-10T04:23:55.035903+0000","last_became_active":"2024-05-10T04:23:55.028385+0000","last_became_peered":"2024-05-10T04:23:55.028385+0000","last_unstale":"2024-05-10T04:23:55.035903+0000","last_undegraded":"2024-05-10T04:23:55.035903+0000","last_fullsized":"2024-05-10T04:23:55.035903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:34:45.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.000220+0000","last_change":"2024-05-10T04:23:54.424726+0000","last_active":"2024-05-10T04:23:55.000220+0000","last_peered":"2024-05-10T04:23:55.000220+0000","last_clean":"2024-05-10T04:23:55.000220+0000","last_became_active":"2024-05-10T04:23:54.424380+0000","last_became_peered":"2024-05-10T04:23:54.424380+0000","last_unstale":"2024-05-10T04:23:55.000220+0000","last_undegraded":"2024-05-10T04:23:55.000220+0000","last_fullsized":"2024-05-10T04:23:55.000220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:34.584927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.022176+0000","last_change":"2024-05-10T04:23:55.018014+0000","last_active":"2024-05-10T04:23:55.022176+0000","last_peered":"2024-05-10T04:23:55.022176+0000","last_clean":"2024-05-10T04:23:55.022176+0000","last_became_active":"2024-05-10T04:23:55.017607+0000","last_became_peered":"2024-05-10T04:23:55.017607+0000","last_unstale":"2024-05-10T04:23:55.022176+0000","last_undegraded":"2024-05-10T04:23:55.022176+0000","last_fullsized":"2024-05-10T04:23:55.022176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:13.820894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.031704+0000","last_change":"2024-05-10T04:23:54.432863+0000","last_active":"2024-05-10T04:23:55.031704+0000","last_peered":"2024-05-10T04:23:55.031704+0000","last_clean":"2024-05-10T04:23:55.031704+0000","last_became_active":"2024-05-10T04:23:54.432557+0000","last_became_peered":"2024-05-10T04:23:54.432557+0000","last_unstale":"2024-05-10T04:23:55.031704+0000","last_undegraded":"2024-05-10T04:23:55.031704+0000","last_fullsized":"2024-05-10T04:23:55.031704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:34.584927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032736+0000","last_change":"2024-05-10T04:23:55.029143+0000","last_active":"2024-05-10T04:23:55.032736+0000","last_peered":"2024-05-10T04:23:55.032736+0000","last_clean":"2024-05-10T04:23:55.032736+0000","last_became_active":"2024-05-10T04:23:55.028547+0000","last_became_peered":"2024-05-10T04:23:55.028547+0000","last_unstale":"2024-05-10T04:23:55.032736+0000","last_undegraded":"2024-05-10T04:23:55.032736+0000","last_fullsized":"2024-05-10T04:23:55.032736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:01.635536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.040135+0000","last_change":"2024-05-10T04:23:54.442365+0000","last_active":"2024-05-10T04:23:55.040135+0000","last_peered":"2024-05-10T04:23:55.040135+0000","last_clean":"2024-05-10T04:23:55.040135+0000","last_became_active":"2024-05-10T04:23:54.442108+0000","last_became_peered":"2024-05-10T04:23:54.442108+0000","last_unstale":"2024-05-10T04:23:55.040135+0000","last_undegraded":"2024-05-10T04:23:55.040135+0000","last_fullsized":"2024-05-10T04:23:55.040135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:14.808820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.031751+0000","last_change":"2024-05-10T04:23:55.025821+0000","last_active":"2024-05-10T04:23:55.031751+0000","last_peered":"2024-05-10T04:23:55.031751+0000","last_clean":"2024-05-10T04:23:55.031751+0000","last_became_active":"2024-05-10T04:23:55.025607+0000","last_became_peered":"2024-05-10T04:23:55.025607+0000","last_unstale":"2024-05-10T04:23:55.031751+0000","last_undegraded":"2024-05-10T04:23:55.031751+0000","last_fullsized":"2024-05-10T04:23:55.031751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:30:56.833846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.027116+0000","last_change":"2024-05-10T04:23:54.438479+0000","last_active":"2024-05-10T04:23:55.027116+0000","last_peered":"2024-05-10T04:23:55.027116+0000","last_clean":"2024-05-10T04:23:55.027116+0000","last_became_active":"2024-05-10T04:23:54.438122+0000","last_became_peered":"2024-05-10T04:23:54.438122+0000","last_unstale":"2024-05-10T04:23:55.027116+0000","last_undegraded":"2024-05-10T04:23:55.027116+0000","last_fullsized":"2024-05-10T04:23:55.027116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:44.965163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.035891+0000","last_change":"2024-05-10T04:23:55.030168+0000","last_active":"2024-05-10T04:23:55.035891+0000","last_peered":"2024-05-10T04:23:55.035891+0000","last_clean":"2024-05-10T04:23:55.035891+0000","last_became_active":"2024-05-10T04:23:55.029570+0000","last_became_peered":"2024-05-10T04:23:55.029570+0000","last_unstale":"2024-05-10T04:23:55.035891+0000","last_undegraded":"2024-05-10T04:23:55.035891+0000","last_fullsized":"2024-05-10T04:23:55.035891+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:42.620729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.006013+0000","last_change":"2024-05-10T04:23:54.440978+0000","last_active":"2024-05-10T04:23:55.006013+0000","last_peered":"2024-05-10T04:23:55.006013+0000","last_clean":"2024-05-10T04:23:55.006013+0000","last_became_active":"2024-05-10T04:23:54.440616+0000","last_became_peered":"2024-05-10T04:23:54.440616+0000","last_unstale":"2024-05-10T04:23:55.006013+0000","last_undegraded":"2024-05-10T04:23:55.006013+0000","last_fullsized":"2024-05-10T04:23:55.006013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:42.633229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.022174+0000","last_change":"2024-05-10T04:23:55.017497+0000","last_active":"2024-05-10T04:23:55.022174+0000","last_peered":"2024-05-10T04:23:55.022174+0000","last_clean":"2024-05-10T04:23:55.022174+0000","last_became_active":"2024-05-10T04:23:55.016765+0000","last_became_peered":"2024-05-10T04:23:55.016765+0000","last_unstale":"2024-05-10T04:23:55.022174+0000","last_undegraded":"2024-05-10T04:23:55.022174+0000","last_fullsized":"2024-05-10T04:23:55.022174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:14.166931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.009210+0000","last_change":"2024-05-10T04:23:54.430598+0000","last_active":"2024-05-10T04:23:55.009210+0000","last_peered":"2024-05-10T04:23:55.009210+0000","last_clean":"2024-05-10T04:23:55.009210+0000","last_became_active":"2024-05-10T04:23:54.429849+0000","last_became_peered":"2024-05-10T04:23:54.429849+0000","last_unstale":"2024-05-10T04:23:55.009210+0000","last_undegraded":"2024-05-10T04:23:55.009210+0000","last_fullsized":"2024-05-10T04:23:55.009210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:56:02.099585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.035179+0000","last_change":"2024-05-10T04:23:55.030943+0000","last_active":"2024-05-10T04:23:55.035179+0000","last_peered":"2024-05-10T04:23:55.035179+0000","last_clean":"2024-05-10T04:23:55.035179+0000","last_became_active":"2024-05-10T04:23:55.029747+0000","last_became_peered":"2024-05-10T04:23:55.029747+0000","last_unstale":"2024-05-10T04:23:55.035179+0000","last_undegraded":"2024-05-10T04:23:55.035179+0000","last_fullsized":"2024-05-10T04:23:55.035179+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:27:31.569256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.031939+0000","last_change":"2024-05-10T04:23:54.433857+0000","last_active":"2024-05-10T04:23:55.031939+0000","last_peered":"2024-05-10T04:23:55.031939+0000","last_clean":"2024-05-10T04:23:55.031939+0000","last_became_active":"2024-05-10T04:23:54.433483+0000","last_became_peered":"2024-05-10T04:23:54.433483+0000","last_unstale":"2024-05-10T04:23:55.031939+0000","last_undegraded":"2024-05-10T04:23:55.031939+0000","last_fullsized":"2024-05-10T04:23:55.031939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:34.584927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028317+0000","last_change":"2024-05-10T04:23:55.020071+0000","last_active":"2024-05-10T04:23:55.028317+0000","last_peered":"2024-05-10T04:23:55.028317+0000","last_clean":"2024-05-10T04:23:55.028317+0000","last_became_active":"2024-05-10T04:23:55.019738+0000","last_became_peered":"2024-05-10T04:23:55.019738+0000","last_unstale":"2024-05-10T04:23:55.028317+0000","last_undegraded":"2024-05-10T04:23:55.028317+0000","last_fullsized":"2024-05-10T04:23:55.028317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:11:15.929034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036573+0000","last_change":"2024-05-10T04:23:54.433319+0000","last_active":"2024-05-10T04:23:55.036573+0000","last_peered":"2024-05-10T04:23:55.036573+0000","last_clean":"2024-05-10T04:23:55.036573+0000","last_became_active":"2024-05-10T04:23:54.432909+0000","last_became_peered":"2024-05-10T04:23:54.432909+0000","last_unstale":"2024-05-10T04:23:55.036573+0000","last_undegraded":"2024-05-10T04:23:55.036573+0000","last_fullsized":"2024-05-10T04:23:55.036573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:14.808820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.035118+0000","last_change":"2024-05-10T04:23:55.031127+0000","last_active":"2024-05-10T04:23:55.035118+0000","last_peered":"2024-05-10T04:23:55.035118+0000","last_clean":"2024-05-10T04:23:55.035118+0000","last_became_active":"2024-05-10T04:23:55.030831+0000","last_became_peered":"2024-05-10T04:23:55.030831+0000","last_unstale":"2024-05-10T04:23:55.035118+0000","last_undegraded":"2024-05-10T04:23:55.035118+0000","last_fullsized":"2024-05-10T04:23:55.035118+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:42.620729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028382+0000","last_change":"2024-05-10T04:23:54.439113+0000","last_active":"2024-05-10T04:23:55.028382+0000","last_peered":"2024-05-10T04:23:55.028382+0000","last_clean":"2024-05-10T04:23:55.028382+0000","last_became_active":"2024-05-10T04:23:54.438826+0000","last_became_peered":"2024-05-10T04:23:54.438826+0000","last_unstale":"2024-05-10T04:23:55.028382+0000","last_undegraded":"2024-05-10T04:23:55.028382+0000","last_fullsized":"2024-05-10T04:23:55.028382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:17:46.737420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.027104+0000","last_change":"2024-05-10T04:23:55.021630+0000","last_active":"2024-05-10T04:23:55.027104+0000","last_peered":"2024-05-10T04:23:55.027104+0000","last_clean":"2024-05-10T04:23:55.027104+0000","last_became_active":"2024-05-10T04:23:55.021371+0000","last_became_peered":"2024-05-10T04:23:55.021371+0000","last_unstale":"2024-05-10T04:23:55.027104+0000","last_undegraded":"2024-05-10T04:23:55.027104+0000","last_fullsized":"2024-05-10T04:23:55.027104+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:40.134491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.029164+0000","last_change":"2024-05-10T04:23:54.438297+0000","last_active":"2024-05-10T04:23:55.029164+0000","last_peered":"2024-05-10T04:23:55.029164+0000","last_clean":"2024-05-10T04:23:55.029164+0000","last_became_active":"2024-05-10T04:23:54.437990+0000","last_became_peered":"2024-05-10T04:23:54.437990+0000","last_unstale":"2024-05-10T04:23:55.029164+0000","last_undegraded":"2024-05-10T04:23:55.029164+0000","last_fullsized":"2024-05-10T04:23:55.029164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:37.431346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036221+0000","last_change":"2024-05-10T04:23:55.018575+0000","last_active":"2024-05-10T04:23:55.036221+0000","last_peered":"2024-05-10T04:23:55.036221+0000","last_clean":"2024-05-10T04:23:55.036221+0000","last_became_active":"2024-05-10T04:23:55.018263+0000","last_became_peered":"2024-05-10T04:23:55.018263+0000","last_unstale":"2024-05-10T04:23:55.036221+0000","last_undegraded":"2024-05-10T04:23:55.036221+0000","last_fullsized":"2024-05-10T04:23:55.036221+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:41:30.998827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.002810+0000","last_change":"2024-05-10T04:23:54.437319+0000","last_active":"2024-05-10T04:23:55.002810+0000","last_peered":"2024-05-10T04:23:55.002810+0000","last_clean":"2024-05-10T04:23:55.002810+0000","last_became_active":"2024-05-10T04:23:54.436920+0000","last_became_peered":"2024-05-10T04:23:54.436920+0000","last_unstale":"2024-05-10T04:23:55.002810+0000","last_undegraded":"2024-05-10T04:23:55.002810+0000","last_fullsized":"2024-05-10T04:23:55.002810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:13:52.236033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036252+0000","last_change":"2024-05-10T04:23:55.019828+0000","last_active":"2024-05-10T04:23:55.036252+0000","last_peered":"2024-05-10T04:23:55.036252+0000","last_clean":"2024-05-10T04:23:55.036252+0000","last_became_active":"2024-05-10T04:23:55.019633+0000","last_became_peered":"2024-05-10T04:23:55.019633+0000","last_unstale":"2024-05-10T04:23:55.036252+0000","last_undegraded":"2024-05-10T04:23:55.036252+0000","last_fullsized":"2024-05-10T04:23:55.036252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:40.442402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.027511+0000","last_change":"2024-05-10T04:23:54.435629+0000","last_active":"2024-05-10T04:23:55.027511+0000","last_peered":"2024-05-10T04:23:55.027511+0000","last_clean":"2024-05-10T04:23:55.027511+0000","last_became_active":"2024-05-10T04:23:54.435323+0000","last_became_peered":"2024-05-10T04:23:54.435323+0000","last_unstale":"2024-05-10T04:23:55.027511+0000","last_undegraded":"2024-05-10T04:23:55.027511+0000","last_fullsized":"2024-05-10T04:23:55.027511+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:42.633229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036752+0000","last_change":"2024-05-10T04:23:55.029326+0000","last_active":"2024-05-10T04:23:55.036752+0000","last_peered":"2024-05-10T04:23:55.036752+0000","last_clean":"2024-05-10T04:23:55.036752+0000","last_became_active":"2024-05-10T04:23:55.029030+0000","last_became_peered":"2024-05-10T04:23:55.029030+0000","last_unstale":"2024-05-10T04:23:55.036752+0000","last_undegraded":"2024-05-10T04:23:55.036752+0000","last_fullsized":"2024-05-10T04:23:55.036752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:56:03.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.010248+0000","last_change":"2024-05-10T04:23:54.442066+0000","last_active":"2024-05-10T04:23:55.010248+0000","last_peered":"2024-05-10T04:23:55.010248+0000","last_clean":"2024-05-10T04:23:55.010248+0000","last_became_active":"2024-05-10T04:23:54.441684+0000","last_became_peered":"2024-05-10T04:23:54.441684+0000","last_unstale":"2024-05-10T04:23:55.010248+0000","last_undegraded":"2024-05-10T04:23:55.010248+0000","last_fullsized":"2024-05-10T04:23:55.010248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:44.965163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.038587+0000","last_change":"2024-05-10T04:23:55.030163+0000","last_active":"2024-05-10T04:23:55.038587+0000","last_peered":"2024-05-10T04:23:55.038587+0000","last_clean":"2024-05-10T04:23:55.038587+0000","last_became_active":"2024-05-10T04:23:55.026471+0000","last_became_peered":"2024-05-10T04:23:55.026471+0000","last_unstale":"2024-05-10T04:23:55.038587+0000","last_undegraded":"2024-05-10T04:23:55.038587+0000","last_fullsized":"2024-05-10T04:23:55.038587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:35.591577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.002071+0000","last_change":"2024-05-10T04:23:54.443750+0000","last_active":"2024-05-10T04:23:55.002071+0000","last_peered":"2024-05-10T04:23:55.002071+0000","last_clean":"2024-05-10T04:23:55.002071+0000","last_became_active":"2024-05-10T04:23:54.443506+0000","last_became_peered":"2024-05-10T04:23:54.443506+0000","last_unstale":"2024-05-10T04:23:55.002071+0000","last_undegraded":"2024-05-10T04:23:55.002071+0000","last_fullsized":"2024-05-10T04:23:55.002071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:40.181792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032611+0000","last_change":"2024-05-10T04:23:55.024620+0000","last_active":"2024-05-10T04:23:55.032611+0000","last_peered":"2024-05-10T04:23:55.032611+0000","last_clean":"2024-05-10T04:23:55.032611+0000","last_became_active":"2024-05-10T04:23:55.024314+0000","last_became_peered":"2024-05-10T04:23:55.024314+0000","last_unstale":"2024-05-10T04:23:55.032611+0000","last_undegraded":"2024-05-10T04:23:55.032611+0000","last_fullsized":"2024-05-10T04:23:55.032611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:14:31.390175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.010699+0000","last_change":"2024-05-10T04:23:54.433626+0000","last_active":"2024-05-10T04:23:55.010699+0000","last_peered":"2024-05-10T04:23:55.010699+0000","last_clean":"2024-05-10T04:23:55.010699+0000","last_became_active":"2024-05-10T04:23:54.433178+0000","last_became_peered":"2024-05-10T04:23:54.433178+0000","last_unstale":"2024-05-10T04:23:55.010699+0000","last_undegraded":"2024-05-10T04:23:55.010699+0000","last_fullsized":"2024-05-10T04:23:55.010699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:43.170628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.038743+0000","last_change":"2024-05-10T04:23:55.033304+0000","last_active":"2024-05-10T04:23:55.038743+0000","last_peered":"2024-05-10T04:23:55.038743+0000","last_clean":"2024-05-10T04:23:55.038743+0000","last_became_active":"2024-05-10T04:23:55.032833+0000","last_became_peered":"2024-05-10T04:23:55.032833+0000","last_unstale":"2024-05-10T04:23:55.038743+0000","last_undegraded":"2024-05-10T04:23:55.038743+0000","last_fullsized":"2024-05-10T04:23:55.038743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:09:08.019512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.033338+0000","last_change":"2024-05-10T04:23:54.436519+0000","last_active":"2024-05-10T04:23:55.033338+0000","last_peered":"2024-05-10T04:23:55.033338+0000","last_clean":"2024-05-10T04:23:55.033338+0000","last_became_active":"2024-05-10T04:23:54.435721+0000","last_became_peered":"2024-05-10T04:23:54.435721+0000","last_unstale":"2024-05-10T04:23:55.033338+0000","last_undegraded":"2024-05-10T04:23:55.033338+0000","last_fullsized":"2024-05-10T04:23:55.033338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:40.181792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032553+0000","last_change":"2024-05-10T04:23:55.027193+0000","last_active":"2024-05-10T04:23:55.032553+0000","last_peered":"2024-05-10T04:23:55.032553+0000","last_clean":"2024-05-10T04:23:55.032553+0000","last_became_active":"2024-05-10T04:23:55.026406+0000","last_became_peered":"2024-05-10T04:23:55.026406+0000","last_unstale":"2024-05-10T04:23:55.032553+0000","last_undegraded":"2024-05-10T04:23:55.032553+0000","last_fullsized":"2024-05-10T04:23:55.032553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:34:45.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.000322+0000","last_change":"2024-05-10T04:23:54.441784+0000","last_active":"2024-05-10T04:23:55.000322+0000","last_peered":"2024-05-10T04:23:55.000322+0000","last_clean":"2024-05-10T04:23:55.000322+0000","last_became_active":"2024-05-10T04:23:54.441452+0000","last_became_peered":"2024-05-10T04:23:54.441452+0000","last_unstale":"2024-05-10T04:23:55.000322+0000","last_undegraded":"2024-05-10T04:23:55.000322+0000","last_fullsized":"2024-05-10T04:23:55.000322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:40.181792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032142+0000","last_change":"2024-05-10T04:23:55.027898+0000","last_active":"2024-05-10T04:23:55.032142+0000","last_peered":"2024-05-10T04:23:55.032142+0000","last_clean":"2024-05-10T04:23:55.032142+0000","last_became_active":"2024-05-10T04:23:55.027556+0000","last_became_peered":"2024-05-10T04:23:55.027556+0000","last_unstale":"2024-05-10T04:23:55.032142+0000","last_undegraded":"2024-05-10T04:23:55.032142+0000","last_fullsized":"2024-05-10T04:23:55.032142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:40.442402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.011767+0000","last_change":"2024-05-10T04:23:54.435099+0000","last_active":"2024-05-10T04:23:55.011767+0000","last_peered":"2024-05-10T04:23:55.011767+0000","last_clean":"2024-05-10T04:23:55.011767+0000","last_became_active":"2024-05-10T04:23:54.432875+0000","last_became_peered":"2024-05-10T04:23:54.432875+0000","last_unstale":"2024-05-10T04:23:55.011767+0000","last_undegraded":"2024-05-10T04:23:55.011767+0000","last_fullsized":"2024-05-10T04:23:55.011767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:34.584927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032271+0000","last_change":"2024-05-10T04:23:55.029025+0000","last_active":"2024-05-10T04:23:55.032271+0000","last_peered":"2024-05-10T04:23:55.032271+0000","last_clean":"2024-05-10T04:23:55.032271+0000","last_became_active":"2024-05-10T04:23:55.028716+0000","last_became_peered":"2024-05-10T04:23:55.028716+0000","last_unstale":"2024-05-10T04:23:55.032271+0000","last_undegraded":"2024-05-10T04:23:55.032271+0000","last_fullsized":"2024-05-10T04:23:55.032271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:56:03.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:54.999346+0000","last_change":"2024-05-10T04:23:54.431614+0000","last_active":"2024-05-10T04:23:54.999346+0000","last_peered":"2024-05-10T04:23:54.999346+0000","last_clean":"2024-05-10T04:23:54.999346+0000","last_became_active":"2024-05-10T04:23:54.430499+0000","last_became_peered":"2024-05-10T04:23:54.430499+0000","last_unstale":"2024-05-10T04:23:54.999346+0000","last_undegraded":"2024-05-10T04:23:54.999346+0000","last_fullsized":"2024-05-10T04:23:54.999346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:03:19.628470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028149+0000","last_change":"2024-05-10T04:23:55.022457+0000","last_active":"2024-05-10T04:23:55.028149+0000","last_peered":"2024-05-10T04:23:55.028149+0000","last_clean":"2024-05-10T04:23:55.028149+0000","last_became_active":"2024-05-10T04:23:55.021609+0000","last_became_peered":"2024-05-10T04:23:55.021609+0000","last_unstale":"2024-05-10T04:23:55.028149+0000","last_undegraded":"2024-05-10T04:23:55.028149+0000","last_fullsized":"2024-05-10T04:23:55.028149+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:34.975957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.005911+0000","last_change":"2024-05-10T04:23:54.438246+0000","last_active":"2024-05-10T04:23:55.005911+0000","last_peered":"2024-05-10T04:23:55.005911+0000","last_clean":"2024-05-10T04:23:55.005911+0000","last_became_active":"2024-05-10T04:23:54.436229+0000","last_became_peered":"2024-05-10T04:23:54.436229+0000","last_unstale":"2024-05-10T04:23:55.005911+0000","last_undegraded":"2024-05-10T04:23:55.005911+0000","last_fullsized":"2024-05-10T04:23:55.005911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:03:19.628470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036158+0000","last_change":"2024-05-10T04:23:55.028888+0000","last_active":"2024-05-10T04:23:55.036158+0000","last_peered":"2024-05-10T04:23:55.036158+0000","last_clean":"2024-05-10T04:23:55.036158+0000","last_became_active":"2024-05-10T04:23:55.028616+0000","last_became_peered":"2024-05-10T04:23:55.028616+0000","last_unstale":"2024-05-10T04:23:55.036158+0000","last_undegraded":"2024-05-10T04:23:55.036158+0000","last_fullsized":"2024-05-10T04:23:55.036158+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:14.166931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.002129+0000","last_change":"2024-05-10T04:23:54.435189+0000","last_active":"2024-05-10T04:23:55.002129+0000","last_peered":"2024-05-10T04:23:55.002129+0000","last_clean":"2024-05-10T04:23:55.002129+0000","last_became_active":"2024-05-10T04:23:54.434804+0000","last_became_peered":"2024-05-10T04:23:54.434804+0000","last_unstale":"2024-05-10T04:23:55.002129+0000","last_undegraded":"2024-05-10T04:23:55.002129+0000","last_fullsized":"2024-05-10T04:23:55.002129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:22.888123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.023277+0000","last_change":"2024-05-10T04:23:55.014667+0000","last_active":"2024-05-10T04:23:55.023277+0000","last_peered":"2024-05-10T04:23:55.023277+0000","last_clean":"2024-05-10T04:23:55.023277+0000","last_became_active":"2024-05-10T04:23:55.014369+0000","last_became_peered":"2024-05-10T04:23:55.014369+0000","last_unstale":"2024-05-10T04:23:55.023277+0000","last_undegraded":"2024-05-10T04:23:55.023277+0000","last_fullsized":"2024-05-10T04:23:55.023277+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:09:08.019512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.009272+0000","last_change":"2024-05-10T04:23:54.430333+0000","last_active":"2024-05-10T04:23:55.009272+0000","last_peered":"2024-05-10T04:23:55.009272+0000","last_clean":"2024-05-10T04:23:55.009272+0000","last_became_active":"2024-05-10T04:23:54.429745+0000","last_became_peered":"2024-05-10T04:23:54.429745+0000","last_unstale":"2024-05-10T04:23:55.009272+0000","last_undegraded":"2024-05-10T04:23:55.009272+0000","last_fullsized":"2024-05-10T04:23:55.009272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:42.354481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032582+0000","last_change":"2024-05-10T04:23:55.025033+0000","last_active":"2024-05-10T04:23:55.032582+0000","last_peered":"2024-05-10T04:23:55.032582+0000","last_clean":"2024-05-10T04:23:55.032582+0000","last_became_active":"2024-05-10T04:23:55.024691+0000","last_became_peered":"2024-05-10T04:23:55.024691+0000","last_unstale":"2024-05-10T04:23:55.032582+0000","last_undegraded":"2024-05-10T04:23:55.032582+0000","last_fullsized":"2024-05-10T04:23:55.032582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:51:44.675640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.011139+0000","last_change":"2024-05-10T04:23:54.439432+0000","last_active":"2024-05-10T04:23:55.011139+0000","last_peered":"2024-05-10T04:23:55.011139+0000","last_clean":"2024-05-10T04:23:55.011139+0000","last_became_active":"2024-05-10T04:23:54.439105+0000","last_became_peered":"2024-05-10T04:23:54.439105+0000","last_unstale":"2024-05-10T04:23:55.011139+0000","last_undegraded":"2024-05-10T04:23:55.011139+0000","last_fullsized":"2024-05-10T04:23:55.011139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:17:46.737420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-10T04:23:54.430518+0000","last_change":"2024-05-10T04:22:27.829537+0000","last_active":"2024-05-10T04:23:54.430518+0000","last_peered":"2024-05-10T04:23:54.430518+0000","last_clean":"2024-05-10T04:23:54.430518+0000","last_became_active":"2024-05-10T04:22:27.828179+0000","last_became_peered":"2024-05-10T04:22:27.828179+0000","last_unstale":"2024-05-10T04:23:54.430518+0000","last_undegraded":"2024-05-10T04:23:54.430518+0000","last_fullsized":"2024-05-10T04:23:54.430518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_clean_scrub_stamp":"2024-05-10T04:22:26.813824+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:23.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":729180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.69999999999999996}]},{"osd":1,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.81699999999999995}]},{"osd":2,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.73199999999999998}]},{"osd":3,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.875},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.80200000000000005}]},{"osd":4,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.93200000000000005}]},{"osd":5,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.89800000000000002}]},{"osd":6,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":1.0129999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.74199999999999999}]},{"osd":2,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.82799999999999996}]},{"osd":3,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.621}]},{"osd":4,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.68000000000000005}]},{"osd":7,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.86199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":147173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":3.347,"5min":3.347,"15min":3.347},"last":0.60199999999999998}]},{"osd":2,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":3.4929999999999999,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.629,"5min":3.629,"15min":3.629},"last":0.63800000000000001}]},{"osd":4,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.92500000000000004}]},{"osd":5,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.78900000000000003}]},{"osd":6,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":3.2890000000000001,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.83999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":966656,"data_stored":735955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.36799999999999999}]},{"osd":3,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.436},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.93600000000000005}]},{"osd":5,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.98499999999999999}]},{"osd":6,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.89900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":145657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":6.2450000000000001,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":5.883,"5min":5.883,"15min":5.883},"last":0.312}]},{"osd":1,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":4.1440000000000001,"5min":4.1440000000000001,"15min":4.1440000000000001},"last":0.38},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.9480000000000004,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.438}]},{"osd":3,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":3.452,"5min":3.452,"15min":3.452},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":3.3809999999999998,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.628}]},{"osd":5,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.3279999999999998,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":3.3330000000000002,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":3.419,"5min":3.419,"15min":3.419},"last":0.72199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":147173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.505},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":3.6829999999999998,"5min":3.6829999999999998,"15min":3.6829999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.58399999999999996}]},{"osd":2,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":3.7240000000000002,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.0010000000000003,"5min":4.0010000000000003,"15min":4.0010000000000003},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":4.024,"5min":4.024,"15min":4.024},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.74199999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.69999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.626},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":0.59699999999999998}]},{"osd":1,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.751}]},{"osd":3,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.7080000000000002,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":0.72299999999999998}]},{"osd":5,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.70199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:23:30 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri May 10 04:23:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri May 10 04:23:30 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":2.577,"5min":2.577,"15min":2.577},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Fri May 10 04:23:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.622},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.73499999999999999}]},{"osd":4,"last update":"Fri May 10 04:23:30 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.6320000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":0.70999999999999996}]},{"osd":6,"last update":"Fri May 10 04:23:30 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri May 10 04:23:30 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":4.0700000000000003,"5min":4.0700000000000003,"15min":4.0700000000000003},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.68799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:24:00.060 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:24:00.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.352+0000 7f7dce200700 1 Processor -- start 2024-05-10T04:24:00.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.352+0000 7f7dce200700 1 -- start start 2024-05-10T04:24:00.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.354+0000 7f7dce200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7dc815b870 0x7f7dc815c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:00.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.354+0000 7f7dce200700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc80cf360 con 0x7f7dc80cdde0 2024-05-10T04:24:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.354+0000 7f7dce200700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc80ce750 con 0x7f7dc80b31d0 2024-05-10T04:24:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.354+0000 7f7dce200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc815c730 con 0x7f7dc815b870 2024-05-10T04:24:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.354+0000 7f7dc6a00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7dc80cdde0 0x7f7dc80b2ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49184/0 (socket says 172.21.15.80:49184) 2024-05-10T04:24:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.354+0000 7f7dc6a00700 1 -- 172.21.15.80:0/1678424871 learned_addr learned my addr 172.21.15.80:0/1678424871 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:24:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.354+0000 7f7dc7400700 1 --2- 172.21.15.80:0/1678424871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7dc815b870 0x7f7dc815c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.354+0000 7f7dc6000700 1 -- 172.21.15.80:0/1678424871 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223825474 0 0) 0x7f7dc80cf360 con 0x7f7dc80cdde0 2024-05-10T04:24:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.354+0000 7f7dc6000700 1 -- 172.21.15.80:0/1678424871 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dac0035b0 con 0x7f7dc80cdde0 2024-05-10T04:24:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc6000700 1 -- 172.21.15.80:0/1678424871 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817383788 0 0) 0x7f7dc80ce750 con 0x7f7dc80b31d0 2024-05-10T04:24:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc6000700 1 -- 172.21.15.80:0/1678424871 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dc80cf360 con 0x7f7dc80b31d0 2024-05-10T04:24:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc6000700 1 -- 172.21.15.80:0/1678424871 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 139428226 0 0) 0x7f7dac0035b0 con 0x7f7dc80cdde0 2024-05-10T04:24:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc6000700 1 -- 172.21.15.80:0/1678424871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7dc815b870 msgr2=0x7f7dc815c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:24:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc6000700 1 --2- 172.21.15.80:0/1678424871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7dc815b870 0x7f7dc815c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc6000700 1 -- 172.21.15.80:0/1678424871 >> v1:172.21.15.106:6789/0 conn(0x7f7dc80b31d0 legacy=0x7f7dc806d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc6000700 1 -- 172.21.15.80:0/1678424871 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc80cea30 con 0x7f7dc80cdde0 2024-05-10T04:24:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc6000700 1 -- 172.21.15.80:0/1678424871 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7f7db40015f0 con 0x7f7dc80cdde0 2024-05-10T04:24:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc6000700 1 -- 172.21.15.80:0/1678424871 >> v1:172.21.15.80:6789/0 conn(0x7f7dc80cdde0 legacy=0x7f7dc80b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc6000700 1 --2- 172.21.15.80:0/1678424871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7dac003bc0 0x7f7dac004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc6000700 1 --2- 172.21.15.80:0/1678424871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dac004850 0x7f7dac004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc6000700 1 --2- 172.21.15.80:0/1678424871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7dac0051f0 0x7f7dac00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc6000700 1 -- 172.21.15.80:0/1678424871 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc815c730 con 0x7f7dac004850 2024-05-10T04:24:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc6000700 1 -- 172.21.15.80:0/1678424871 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac00e350 con 0x7f7dac0051f0 2024-05-10T04:24:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc6000700 1 -- 172.21.15.80:0/1678424871 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac00e510 con 0x7f7dac003bc0 2024-05-10T04:24:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc7400700 1 --2- 172.21.15.80:0/1678424871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7dc815b870 0x7f7dc815c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:24:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc6a00700 1 --2- 172.21.15.80:0/1678424871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dac004850 0x7f7dac004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc7e00700 1 --2- 172.21.15.80:0/1678424871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7dac0051f0 0x7f7dac00dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.355+0000 7f7dc7400700 1 --2- 172.21.15.80:0/1678424871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7dac003bc0 0x7f7dac004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:00.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.356+0000 7f7dc6a00700 1 -- 172.21.15.80:0/1678424871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7dac003bc0 msgr2=0x7f7dac004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:24:00.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.356+0000 7f7dc6a00700 1 --2- 172.21.15.80:0/1678424871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7dac003bc0 0x7f7dac004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:00.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.356+0000 7f7dc6a00700 1 -- 172.21.15.80:0/1678424871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7dac0051f0 msgr2=0x7f7dac00dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:24:00.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.356+0000 7f7dc6a00700 1 --2- 172.21.15.80:0/1678424871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7dac0051f0 0x7f7dac00dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:00.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.356+0000 7f7dc6a00700 1 -- 172.21.15.80:0/1678424871 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac0035b0 con 0x7f7dac004850 2024-05-10T04:24:00.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.356+0000 7f7dc6a00700 1 --2- 172.21.15.80:0/1678424871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dac004850 0x7f7dac004c60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7db4007fd0 tx=0x7f7dac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f029dbf2d90b51 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:00.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.356+0000 7f7dc6000700 1 -- 172.21.15.80:0/1678424871 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db400cc50 con 0x7f7dac004850 2024-05-10T04:24:00.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.356+0000 7f7dc6000700 1 -- 172.21.15.80:0/1678424871 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db400cdb0 con 0x7f7dac004850 2024-05-10T04:24:00.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.356+0000 7f7dc6000700 1 -- 172.21.15.80:0/1678424871 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db4005ba0 con 0x7f7dac004850 2024-05-10T04:24:00.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.357+0000 7f7dce200700 1 -- 172.21.15.80:0/1678424871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dac004850 msgr2=0x7f7dac004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:00.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.357+0000 7f7dce200700 1 --2- 172.21.15.80:0/1678424871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dac004850 0x7f7dac004c60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7db4007fd0 tx=0x7f7dac005880 comp rx=0 tx=0).stop 2024-05-10T04:24:00.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.357+0000 7f7dc7e00700 1 -- 172.21.15.80:0/1678424871 reap_dead start 2024-05-10T04:24:00.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.357+0000 7f7dce200700 1 -- 172.21.15.80:0/1678424871 shutdown_connections 2024-05-10T04:24:00.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.357+0000 7f7dce200700 1 -- 172.21.15.80:0/1678424871 >> 172.21.15.80:0/1678424871 conn(0x7f7dc806b470 msgr2=0x7f7dc80b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:00.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.357+0000 7f7dce200700 1 -- 172.21.15.80:0/1678424871 shutdown_connections 2024-05-10T04:24:00.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.357+0000 7f7dce200700 1 -- 172.21.15.80:0/1678424871 wait complete. 2024-05-10T04:24:00.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.359+0000 7f7dce200700 1 Processor -- start 2024-05-10T04:24:00.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.359+0000 7f7dce200700 1 -- start start 2024-05-10T04:24:00.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.361+0000 7f7dce200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7dac004850 0x7f7dc80a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:00.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.361+0000 7f7dce200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7dc8140300 0x7f7dc815cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:00.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.361+0000 7f7dce200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dc8140710 0x7f7dc815d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:00.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.361+0000 7f7dce200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80ae5e0 con 0x7f7dc8140710 2024-05-10T04:24:00.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.361+0000 7f7dce200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80a9280 con 0x7f7dc8140300 2024-05-10T04:24:00.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.361+0000 7f7dce200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80aa0e0 con 0x7f7dac004850 2024-05-10T04:24:00.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.361+0000 7f7dc7e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dc8140710 0x7f7dc815d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:00.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.361+0000 7f7dc7e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dc8140710 0x7f7dc815d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59890/0 (socket says 172.21.15.80:59890) 2024-05-10T04:24:00.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.361+0000 7f7dc7e00700 1 -- 172.21.15.80:0/354970704 learned_addr learned my addr 172.21.15.80:0/354970704 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:24:00.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.361+0000 7f7dc7400700 1 --2- 172.21.15.80:0/354970704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7dac004850 0x7f7dc80a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:00.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.361+0000 7f7dc6a00700 1 --2- 172.21.15.80:0/354970704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7dc8140300 0x7f7dc815cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:00.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.361+0000 7f7dc7e00700 1 -- 172.21.15.80:0/354970704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7dac004850 msgr2=0x7f7dc80a8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:00.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.361+0000 7f7dc7e00700 1 --2- 172.21.15.80:0/354970704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7dac004850 0x7f7dc80a8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:00.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.361+0000 7f7dc7e00700 1 -- 172.21.15.80:0/354970704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7dc8140300 msgr2=0x7f7dc815cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:00.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.361+0000 7f7dc7e00700 1 --2- 172.21.15.80:0/354970704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7dc8140300 0x7f7dc815cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:00.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.361+0000 7f7dc7e00700 1 -- 172.21.15.80:0/354970704 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc80a8fc0 con 0x7f7dc8140710 2024-05-10T04:24:00.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.361+0000 7f7dc6a00700 1 --2- 172.21.15.80:0/354970704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7dc8140300 0x7f7dc815cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:24:00.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.362+0000 7f7dc7e00700 1 --2- 172.21.15.80:0/354970704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dc8140710 0x7f7dc815d270 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7dc806f6b0 tx=0x7f7dc000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:00.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.362+0000 7f7dbf400700 1 -- 172.21.15.80:0/354970704 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0003c10 con 0x7f7dc8140710 2024-05-10T04:24:00.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.362+0000 7f7dbf400700 1 -- 172.21.15.80:0/354970704 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc0003d70 con 0x7f7dc8140710 2024-05-10T04:24:00.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.362+0000 7f7dbf400700 1 -- 172.21.15.80:0/354970704 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0005310 con 0x7f7dc8140710 2024-05-10T04:24:00.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.362+0000 7f7dce200700 1 -- 172.21.15.80:0/354970704 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc80a94d0 con 0x7f7dc8140710 2024-05-10T04:24:00.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.362+0000 7f7dce200700 1 -- 172.21.15.80:0/354970704 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc80a9a90 con 0x7f7dc8140710 2024-05-10T04:24:00.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.363+0000 7f7dce200700 1 -- 172.21.15.80:0/354970704 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc8074af0 con 0x7f7dc8140710 2024-05-10T04:24:00.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.364+0000 7f7dbf400700 1 -- 172.21.15.80:0/354970704 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7dc0005470 con 0x7f7dc8140710 2024-05-10T04:24:00.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.365+0000 7f7dbf400700 1 --2- 172.21.15.80:0/354970704 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7da806acc0 0x7f7da806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:00.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.365+0000 7f7dbf400700 1 -- 172.21.15.80:0/354970704 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dc00893f0 con 0x7f7dc8140710 2024-05-10T04:24:00.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.366+0000 7f7dc7400700 1 --2- 172.21.15.80:0/354970704 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7da806acc0 0x7f7da806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:00.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.367+0000 7f7dc7400700 1 --2- 172.21.15.80:0/354970704 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7da806acc0 0x7f7da806d1d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7db8009160 tx=0x7f7db8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:00.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.370+0000 7f7dbf400700 1 -- 172.21.15.80:0/354970704 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7dc00544a0 con 0x7f7dc8140710 2024-05-10T04:24:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.572+0000 7f7dce200700 1 -- 172.21.15.80:0/354970704 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7dc80ceff0 con 0x7f7da806acc0 2024-05-10T04:24:00.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.581+0000 7f7dbf400700 1 -- 172.21.15.80:0/354970704 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288539 (secure 0 0 0) 0x7f7db80098b0 con 0x7f7da806acc0 2024-05-10T04:24:00.587 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:24:00.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.586+0000 7f7dce200700 1 -- 172.21.15.80:0/354970704 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7da806acc0 msgr2=0x7f7da806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:00.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.586+0000 7f7dce200700 1 --2- 172.21.15.80:0/354970704 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7da806acc0 0x7f7da806d1d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7db8009160 tx=0x7f7db8008040 comp rx=0 tx=0).stop 2024-05-10T04:24:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.586+0000 7f7dce200700 1 -- 172.21.15.80:0/354970704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dc8140710 msgr2=0x7f7dc815d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.586+0000 7f7dce200700 1 --2- 172.21.15.80:0/354970704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dc8140710 0x7f7dc815d270 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7dc806f6b0 tx=0x7f7dc000ef20 comp rx=0 tx=0).stop 2024-05-10T04:24:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.586+0000 7f7dce200700 1 -- 172.21.15.80:0/354970704 shutdown_connections 2024-05-10T04:24:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.586+0000 7f7dce200700 1 --2- 172.21.15.80:0/354970704 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7da806acc0 0x7f7da806d1d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.586+0000 7f7dce200700 1 --2- 172.21.15.80:0/354970704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dc8140710 0x7f7dc815d270 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.586+0000 7f7dce200700 1 --2- 172.21.15.80:0/354970704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7dac004850 0x7f7dc80a8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.586+0000 7f7dce200700 1 --2- 172.21.15.80:0/354970704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7dc8140300 0x7f7dc815cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.586+0000 7f7dce200700 1 -- 172.21.15.80:0/354970704 >> 172.21.15.80:0/354970704 conn(0x7f7dc806b470 msgr2=0x7f7dc806d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.586+0000 7f7dce200700 1 -- 172.21.15.80:0/354970704 shutdown_connections 2024-05-10T04:24:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.586+0000 7f7dce200700 1 -- 172.21.15.80:0/354970704 wait complete. 2024-05-10T04:24:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-10T04:24:00.615 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-05-10T04:23:58.755216+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220284,"kb_used_data":4080,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754436,"statfs":{"total":773094113280,"available":772868542464,"internally_reserved":0,"allocated":4177920,"data_stored":2328965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.350997"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.027672+0000","last_change":"2024-05-10T04:23:55.023172+0000","last_active":"2024-05-10T04:23:55.027672+0000","last_peered":"2024-05-10T04:23:55.027672+0000","last_clean":"2024-05-10T04:23:55.027672+0000","last_became_active":"2024-05-10T04:23:55.022860+0000","last_became_peered":"2024-05-10T04:23:55.022860+0000","last_unstale":"2024-05-10T04:23:55.027672+0000","last_undegraded":"2024-05-10T04:23:55.027672+0000","last_fullsized":"2024-05-10T04:23:55.027672+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:41:30.998827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036389+0000","last_change":"2024-05-10T04:23:55.030688+0000","last_active":"2024-05-10T04:23:55.036389+0000","last_peered":"2024-05-10T04:23:55.036389+0000","last_clean":"2024-05-10T04:23:55.036389+0000","last_became_active":"2024-05-10T04:23:55.029897+0000","last_became_peered":"2024-05-10T04:23:55.029897+0000","last_unstale":"2024-05-10T04:23:55.036389+0000","last_undegraded":"2024-05-10T04:23:55.036389+0000","last_fullsized":"2024-05-10T04:23:55.036389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:01.635536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032715+0000","last_change":"2024-05-10T04:23:55.028906+0000","last_active":"2024-05-10T04:23:55.032715+0000","last_peered":"2024-05-10T04:23:55.032715+0000","last_clean":"2024-05-10T04:23:55.032715+0000","last_became_active":"2024-05-10T04:23:55.028187+0000","last_became_peered":"2024-05-10T04:23:55.028187+0000","last_unstale":"2024-05-10T04:23:55.032715+0000","last_undegraded":"2024-05-10T04:23:55.032715+0000","last_fullsized":"2024-05-10T04:23:55.032715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:14.166931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032121+0000","last_change":"2024-05-10T04:23:55.026826+0000","last_active":"2024-05-10T04:23:55.032121+0000","last_peered":"2024-05-10T04:23:55.032121+0000","last_clean":"2024-05-10T04:23:55.032121+0000","last_became_active":"2024-05-10T04:23:55.024318+0000","last_became_peered":"2024-05-10T04:23:55.024318+0000","last_unstale":"2024-05-10T04:23:55.032121+0000","last_undegraded":"2024-05-10T04:23:55.032121+0000","last_fullsized":"2024-05-10T04:23:55.032121+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:52:41.098034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036311+0000","last_change":"2024-05-10T04:23:55.023194+0000","last_active":"2024-05-10T04:23:55.036311+0000","last_peered":"2024-05-10T04:23:55.036311+0000","last_clean":"2024-05-10T04:23:55.036311+0000","last_became_active":"2024-05-10T04:23:55.022856+0000","last_became_peered":"2024-05-10T04:23:55.022856+0000","last_unstale":"2024-05-10T04:23:55.036311+0000","last_undegraded":"2024-05-10T04:23:55.036311+0000","last_fullsized":"2024-05-10T04:23:55.036311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:27:31.569256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.035992+0000","last_change":"2024-05-10T04:23:55.026661+0000","last_active":"2024-05-10T04:23:55.035992+0000","last_peered":"2024-05-10T04:23:55.035992+0000","last_clean":"2024-05-10T04:23:55.035992+0000","last_became_active":"2024-05-10T04:23:55.026365+0000","last_became_peered":"2024-05-10T04:23:55.026365+0000","last_unstale":"2024-05-10T04:23:55.035992+0000","last_undegraded":"2024-05-10T04:23:55.035992+0000","last_fullsized":"2024-05-10T04:23:55.035992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:42.289326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032407+0000","last_change":"2024-05-10T04:23:55.024369+0000","last_active":"2024-05-10T04:23:55.032407+0000","last_peered":"2024-05-10T04:23:55.032407+0000","last_clean":"2024-05-10T04:23:55.032407+0000","last_became_active":"2024-05-10T04:23:55.024088+0000","last_became_peered":"2024-05-10T04:23:55.024088+0000","last_unstale":"2024-05-10T04:23:55.032407+0000","last_undegraded":"2024-05-10T04:23:55.032407+0000","last_fullsized":"2024-05-10T04:23:55.032407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:07.507478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.031112+0000","last_change":"2024-05-10T04:23:55.022650+0000","last_active":"2024-05-10T04:23:55.031112+0000","last_peered":"2024-05-10T04:23:55.031112+0000","last_clean":"2024-05-10T04:23:55.031112+0000","last_became_active":"2024-05-10T04:23:55.022291+0000","last_became_peered":"2024-05-10T04:23:55.022291+0000","last_unstale":"2024-05-10T04:23:55.031112+0000","last_undegraded":"2024-05-10T04:23:55.031112+0000","last_fullsized":"2024-05-10T04:23:55.031112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:30:56.833846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028269+0000","last_change":"2024-05-10T04:23:55.022738+0000","last_active":"2024-05-10T04:23:55.028269+0000","last_peered":"2024-05-10T04:23:55.028269+0000","last_clean":"2024-05-10T04:23:55.028269+0000","last_became_active":"2024-05-10T04:23:55.022382+0000","last_became_peered":"2024-05-10T04:23:55.022382+0000","last_unstale":"2024-05-10T04:23:55.028269+0000","last_undegraded":"2024-05-10T04:23:55.028269+0000","last_fullsized":"2024-05-10T04:23:55.028269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:40.134491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.029642+0000","last_change":"2024-05-10T04:23:55.024631+0000","last_active":"2024-05-10T04:23:55.029642+0000","last_peered":"2024-05-10T04:23:55.029642+0000","last_clean":"2024-05-10T04:23:55.029642+0000","last_became_active":"2024-05-10T04:23:55.024349+0000","last_became_peered":"2024-05-10T04:23:55.024349+0000","last_unstale":"2024-05-10T04:23:55.029642+0000","last_undegraded":"2024-05-10T04:23:55.029642+0000","last_fullsized":"2024-05-10T04:23:55.029642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:42.289326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032717+0000","last_change":"2024-05-10T04:23:55.025581+0000","last_active":"2024-05-10T04:23:55.032717+0000","last_peered":"2024-05-10T04:23:55.032717+0000","last_clean":"2024-05-10T04:23:55.032717+0000","last_became_active":"2024-05-10T04:23:55.024478+0000","last_became_peered":"2024-05-10T04:23:55.024478+0000","last_unstale":"2024-05-10T04:23:55.032717+0000","last_undegraded":"2024-05-10T04:23:55.032717+0000","last_fullsized":"2024-05-10T04:23:55.032717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:24.023261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028709+0000","last_change":"2024-05-10T04:23:55.021083+0000","last_active":"2024-05-10T04:23:55.028709+0000","last_peered":"2024-05-10T04:23:55.028709+0000","last_clean":"2024-05-10T04:23:55.028709+0000","last_became_active":"2024-05-10T04:23:55.020786+0000","last_became_peered":"2024-05-10T04:23:55.020786+0000","last_unstale":"2024-05-10T04:23:55.028709+0000","last_undegraded":"2024-05-10T04:23:55.028709+0000","last_fullsized":"2024-05-10T04:23:55.028709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:10:02.796375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036294+0000","last_change":"2024-05-10T04:23:55.018416+0000","last_active":"2024-05-10T04:23:55.036294+0000","last_peered":"2024-05-10T04:23:55.036294+0000","last_clean":"2024-05-10T04:23:55.036294+0000","last_became_active":"2024-05-10T04:23:55.018205+0000","last_became_peered":"2024-05-10T04:23:55.018205+0000","last_unstale":"2024-05-10T04:23:55.036294+0000","last_undegraded":"2024-05-10T04:23:55.036294+0000","last_fullsized":"2024-05-10T04:23:55.036294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:11:15.929034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.038785+0000","last_change":"2024-05-10T04:23:55.031460+0000","last_active":"2024-05-10T04:23:55.038785+0000","last_peered":"2024-05-10T04:23:55.038785+0000","last_clean":"2024-05-10T04:23:55.038785+0000","last_became_active":"2024-05-10T04:23:55.031128+0000","last_became_peered":"2024-05-10T04:23:55.031128+0000","last_unstale":"2024-05-10T04:23:55.038785+0000","last_undegraded":"2024-05-10T04:23:55.038785+0000","last_fullsized":"2024-05-10T04:23:55.038785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:51:44.675640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028724+0000","last_change":"2024-05-10T04:23:55.021202+0000","last_active":"2024-05-10T04:23:55.028724+0000","last_peered":"2024-05-10T04:23:55.028724+0000","last_clean":"2024-05-10T04:23:55.028724+0000","last_became_active":"2024-05-10T04:23:55.019962+0000","last_became_peered":"2024-05-10T04:23:55.019962+0000","last_unstale":"2024-05-10T04:23:55.028724+0000","last_undegraded":"2024-05-10T04:23:55.028724+0000","last_fullsized":"2024-05-10T04:23:55.028724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:42.289326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.024476+0000","last_change":"2024-05-10T04:23:55.019043+0000","last_active":"2024-05-10T04:23:55.024476+0000","last_peered":"2024-05-10T04:23:55.024476+0000","last_clean":"2024-05-10T04:23:55.024476+0000","last_became_active":"2024-05-10T04:23:55.018771+0000","last_became_peered":"2024-05-10T04:23:55.018771+0000","last_unstale":"2024-05-10T04:23:55.024476+0000","last_undegraded":"2024-05-10T04:23:55.024476+0000","last_fullsized":"2024-05-10T04:23:55.024476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:57:21.334316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032641+0000","last_change":"2024-05-10T04:23:55.025882+0000","last_active":"2024-05-10T04:23:55.032641+0000","last_peered":"2024-05-10T04:23:55.032641+0000","last_clean":"2024-05-10T04:23:55.032641+0000","last_became_active":"2024-05-10T04:23:55.025436+0000","last_became_peered":"2024-05-10T04:23:55.025436+0000","last_unstale":"2024-05-10T04:23:55.032641+0000","last_undegraded":"2024-05-10T04:23:55.032641+0000","last_fullsized":"2024-05-10T04:23:55.032641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:22:37.238341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.035964+0000","last_change":"2024-05-10T04:23:55.026377+0000","last_active":"2024-05-10T04:23:55.035964+0000","last_peered":"2024-05-10T04:23:55.035964+0000","last_clean":"2024-05-10T04:23:55.035964+0000","last_became_active":"2024-05-10T04:23:55.026120+0000","last_became_peered":"2024-05-10T04:23:55.026120+0000","last_unstale":"2024-05-10T04:23:55.035964+0000","last_undegraded":"2024-05-10T04:23:55.035964+0000","last_fullsized":"2024-05-10T04:23:55.035964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:14:31.390175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036355+0000","last_change":"2024-05-10T04:23:55.030641+0000","last_active":"2024-05-10T04:23:55.036355+0000","last_peered":"2024-05-10T04:23:55.036355+0000","last_clean":"2024-05-10T04:23:55.036355+0000","last_became_active":"2024-05-10T04:23:55.030111+0000","last_became_peered":"2024-05-10T04:23:55.030111+0000","last_unstale":"2024-05-10T04:23:55.036355+0000","last_undegraded":"2024-05-10T04:23:55.036355+0000","last_fullsized":"2024-05-10T04:23:55.036355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:07.507478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.038630+0000","last_change":"2024-05-10T04:23:55.031599+0000","last_active":"2024-05-10T04:23:55.038630+0000","last_peered":"2024-05-10T04:23:55.038630+0000","last_clean":"2024-05-10T04:23:55.038630+0000","last_became_active":"2024-05-10T04:23:55.031290+0000","last_became_peered":"2024-05-10T04:23:55.031290+0000","last_unstale":"2024-05-10T04:23:55.038630+0000","last_undegraded":"2024-05-10T04:23:55.038630+0000","last_fullsized":"2024-05-10T04:23:55.038630+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:34.975957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.017497+0000","last_change":"2024-05-10T04:23:55.012647+0000","last_active":"2024-05-10T04:23:55.017497+0000","last_peered":"2024-05-10T04:23:55.017497+0000","last_clean":"2024-05-10T04:23:55.017497+0000","last_became_active":"2024-05-10T04:23:55.012334+0000","last_became_peered":"2024-05-10T04:23:55.012334+0000","last_unstale":"2024-05-10T04:23:55.017497+0000","last_undegraded":"2024-05-10T04:23:55.017497+0000","last_fullsized":"2024-05-10T04:23:55.017497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:40.442402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028083+0000","last_change":"2024-05-10T04:23:55.018396+0000","last_active":"2024-05-10T04:23:55.028083+0000","last_peered":"2024-05-10T04:23:55.028083+0000","last_clean":"2024-05-10T04:23:55.028083+0000","last_became_active":"2024-05-10T04:23:55.018037+0000","last_became_peered":"2024-05-10T04:23:55.018037+0000","last_unstale":"2024-05-10T04:23:55.028083+0000","last_undegraded":"2024-05-10T04:23:55.028083+0000","last_fullsized":"2024-05-10T04:23:55.028083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:57:21.334316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.020584+0000","last_change":"2024-05-10T04:23:55.014470+0000","last_active":"2024-05-10T04:23:55.020584+0000","last_peered":"2024-05-10T04:23:55.020584+0000","last_clean":"2024-05-10T04:23:55.020584+0000","last_became_active":"2024-05-10T04:23:55.014200+0000","last_became_peered":"2024-05-10T04:23:55.014200+0000","last_unstale":"2024-05-10T04:23:55.020584+0000","last_undegraded":"2024-05-10T04:23:55.020584+0000","last_fullsized":"2024-05-10T04:23:55.020584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:09:08.019512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036874+0000","last_change":"2024-05-10T04:23:55.035806+0000","last_active":"2024-05-10T04:23:55.036874+0000","last_peered":"2024-05-10T04:23:55.036874+0000","last_clean":"2024-05-10T04:23:55.036874+0000","last_became_active":"2024-05-10T04:23:55.035494+0000","last_became_peered":"2024-05-10T04:23:55.035494+0000","last_unstale":"2024-05-10T04:23:55.036874+0000","last_undegraded":"2024-05-10T04:23:55.036874+0000","last_fullsized":"2024-05-10T04:23:55.036874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:52:41.098034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.025415+0000","last_change":"2024-05-10T04:23:55.018189+0000","last_active":"2024-05-10T04:23:55.025415+0000","last_peered":"2024-05-10T04:23:55.025415+0000","last_clean":"2024-05-10T04:23:55.025415+0000","last_became_active":"2024-05-10T04:23:55.017107+0000","last_became_peered":"2024-05-10T04:23:55.017107+0000","last_unstale":"2024-05-10T04:23:55.025415+0000","last_undegraded":"2024-05-10T04:23:55.025415+0000","last_fullsized":"2024-05-10T04:23:55.025415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:32.626346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.023027+0000","last_change":"2024-05-10T04:23:55.020001+0000","last_active":"2024-05-10T04:23:55.023027+0000","last_peered":"2024-05-10T04:23:55.023027+0000","last_clean":"2024-05-10T04:23:55.023027+0000","last_became_active":"2024-05-10T04:23:55.019691+0000","last_became_peered":"2024-05-10T04:23:55.019691+0000","last_unstale":"2024-05-10T04:23:55.023027+0000","last_undegraded":"2024-05-10T04:23:55.023027+0000","last_fullsized":"2024-05-10T04:23:55.023027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:22:37.238341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.026205+0000","last_change":"2024-05-10T04:23:55.023008+0000","last_active":"2024-05-10T04:23:55.026205+0000","last_peered":"2024-05-10T04:23:55.026205+0000","last_clean":"2024-05-10T04:23:55.026205+0000","last_became_active":"2024-05-10T04:23:55.022545+0000","last_became_peered":"2024-05-10T04:23:55.022545+0000","last_unstale":"2024-05-10T04:23:55.026205+0000","last_undegraded":"2024-05-10T04:23:55.026205+0000","last_fullsized":"2024-05-10T04:23:55.026205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:10:02.796375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036301+0000","last_change":"2024-05-10T04:23:55.033633+0000","last_active":"2024-05-10T04:23:55.036301+0000","last_peered":"2024-05-10T04:23:55.036301+0000","last_clean":"2024-05-10T04:23:55.036301+0000","last_became_active":"2024-05-10T04:23:55.033319+0000","last_became_peered":"2024-05-10T04:23:55.033319+0000","last_unstale":"2024-05-10T04:23:55.036301+0000","last_undegraded":"2024-05-10T04:23:55.036301+0000","last_fullsized":"2024-05-10T04:23:55.036301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:30:56.833846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.021250+0000","last_change":"2024-05-10T04:23:55.015356+0000","last_active":"2024-05-10T04:23:55.021250+0000","last_peered":"2024-05-10T04:23:55.021250+0000","last_clean":"2024-05-10T04:23:55.021250+0000","last_became_active":"2024-05-10T04:23:55.015088+0000","last_became_peered":"2024-05-10T04:23:55.015088+0000","last_unstale":"2024-05-10T04:23:55.021250+0000","last_undegraded":"2024-05-10T04:23:55.021250+0000","last_fullsized":"2024-05-10T04:23:55.021250+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:32.626346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032462+0000","last_change":"2024-05-10T04:23:55.024580+0000","last_active":"2024-05-10T04:23:55.032462+0000","last_peered":"2024-05-10T04:23:55.032462+0000","last_clean":"2024-05-10T04:23:55.032462+0000","last_became_active":"2024-05-10T04:23:55.024227+0000","last_became_peered":"2024-05-10T04:23:55.024227+0000","last_unstale":"2024-05-10T04:23:55.032462+0000","last_undegraded":"2024-05-10T04:23:55.032462+0000","last_fullsized":"2024-05-10T04:23:55.032462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:13.820894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.035252+0000","last_change":"2024-05-10T04:23:55.031448+0000","last_active":"2024-05-10T04:23:55.035252+0000","last_peered":"2024-05-10T04:23:55.035252+0000","last_clean":"2024-05-10T04:23:55.035252+0000","last_became_active":"2024-05-10T04:23:55.031102+0000","last_became_peered":"2024-05-10T04:23:55.031102+0000","last_unstale":"2024-05-10T04:23:55.035252+0000","last_undegraded":"2024-05-10T04:23:55.035252+0000","last_fullsized":"2024-05-10T04:23:55.035252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:43.361132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.024518+0000","last_change":"2024-05-10T04:23:55.019123+0000","last_active":"2024-05-10T04:23:55.024518+0000","last_peered":"2024-05-10T04:23:55.024518+0000","last_clean":"2024-05-10T04:23:55.024518+0000","last_became_active":"2024-05-10T04:23:55.017139+0000","last_became_peered":"2024-05-10T04:23:55.017139+0000","last_unstale":"2024-05-10T04:23:55.024518+0000","last_undegraded":"2024-05-10T04:23:55.024518+0000","last_fullsized":"2024-05-10T04:23:55.024518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:34:45.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.024608+0000","last_change":"2024-05-10T04:23:55.014729+0000","last_active":"2024-05-10T04:23:55.024608+0000","last_peered":"2024-05-10T04:23:55.024608+0000","last_clean":"2024-05-10T04:23:55.024608+0000","last_became_active":"2024-05-10T04:23:55.014457+0000","last_became_peered":"2024-05-10T04:23:55.014457+0000","last_unstale":"2024-05-10T04:23:55.024608+0000","last_undegraded":"2024-05-10T04:23:55.024608+0000","last_fullsized":"2024-05-10T04:23:55.024608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:11:15.929034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.030673+0000","last_change":"2024-05-10T04:23:54.435405+0000","last_active":"2024-05-10T04:23:55.030673+0000","last_peered":"2024-05-10T04:23:55.030673+0000","last_clean":"2024-05-10T04:23:55.030673+0000","last_became_active":"2024-05-10T04:23:54.435070+0000","last_became_peered":"2024-05-10T04:23:54.435070+0000","last_unstale":"2024-05-10T04:23:55.030673+0000","last_undegraded":"2024-05-10T04:23:55.030673+0000","last_fullsized":"2024-05-10T04:23:55.030673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:04:24.597037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.035161+0000","last_change":"2024-05-10T04:23:55.030628+0000","last_active":"2024-05-10T04:23:55.035161+0000","last_peered":"2024-05-10T04:23:55.035161+0000","last_clean":"2024-05-10T04:23:55.035161+0000","last_became_active":"2024-05-10T04:23:55.030280+0000","last_became_peered":"2024-05-10T04:23:55.030280+0000","last_unstale":"2024-05-10T04:23:55.035161+0000","last_undegraded":"2024-05-10T04:23:55.035161+0000","last_fullsized":"2024-05-10T04:23:55.035161+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:34.975957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.024298+0000","last_change":"2024-05-10T04:23:54.438843+0000","last_active":"2024-05-10T04:23:55.024298+0000","last_peered":"2024-05-10T04:23:55.024298+0000","last_clean":"2024-05-10T04:23:55.024298+0000","last_became_active":"2024-05-10T04:23:54.438511+0000","last_became_peered":"2024-05-10T04:23:54.438511+0000","last_unstale":"2024-05-10T04:23:55.024298+0000","last_undegraded":"2024-05-10T04:23:55.024298+0000","last_fullsized":"2024-05-10T04:23:55.024298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:14.808820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028175+0000","last_change":"2024-05-10T04:23:55.022737+0000","last_active":"2024-05-10T04:23:55.028175+0000","last_peered":"2024-05-10T04:23:55.028175+0000","last_clean":"2024-05-10T04:23:55.028175+0000","last_became_active":"2024-05-10T04:23:55.022404+0000","last_became_peered":"2024-05-10T04:23:55.022404+0000","last_unstale":"2024-05-10T04:23:55.028175+0000","last_undegraded":"2024-05-10T04:23:55.028175+0000","last_fullsized":"2024-05-10T04:23:55.028175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:43.064685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.030372+0000","last_change":"2024-05-10T04:23:54.441907+0000","last_active":"2024-05-10T04:23:55.030372+0000","last_peered":"2024-05-10T04:23:55.030372+0000","last_clean":"2024-05-10T04:23:55.030372+0000","last_became_active":"2024-05-10T04:23:54.441656+0000","last_became_peered":"2024-05-10T04:23:54.441656+0000","last_unstale":"2024-05-10T04:23:55.030372+0000","last_undegraded":"2024-05-10T04:23:55.030372+0000","last_fullsized":"2024-05-10T04:23:55.030372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:27:30.562606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.026184+0000","last_change":"2024-05-10T04:23:55.022849+0000","last_active":"2024-05-10T04:23:55.026184+0000","last_peered":"2024-05-10T04:23:55.026184+0000","last_clean":"2024-05-10T04:23:55.026184+0000","last_became_active":"2024-05-10T04:23:55.022285+0000","last_became_peered":"2024-05-10T04:23:55.022285+0000","last_unstale":"2024-05-10T04:23:55.026184+0000","last_undegraded":"2024-05-10T04:23:55.026184+0000","last_fullsized":"2024-05-10T04:23:55.026184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:57:21.334316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028464+0000","last_change":"2024-05-10T04:23:54.441238+0000","last_active":"2024-05-10T04:23:55.028464+0000","last_peered":"2024-05-10T04:23:55.028464+0000","last_clean":"2024-05-10T04:23:55.028464+0000","last_became_active":"2024-05-10T04:23:54.440912+0000","last_became_peered":"2024-05-10T04:23:54.440912+0000","last_unstale":"2024-05-10T04:23:55.028464+0000","last_undegraded":"2024-05-10T04:23:55.028464+0000","last_fullsized":"2024-05-10T04:23:55.028464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:04:24.597037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.016907+0000","last_change":"2024-05-10T04:23:55.014500+0000","last_active":"2024-05-10T04:23:55.016907+0000","last_peered":"2024-05-10T04:23:55.016907+0000","last_clean":"2024-05-10T04:23:55.016907+0000","last_became_active":"2024-05-10T04:23:55.014179+0000","last_became_peered":"2024-05-10T04:23:55.014179+0000","last_unstale":"2024-05-10T04:23:55.016907+0000","last_undegraded":"2024-05-10T04:23:55.016907+0000","last_fullsized":"2024-05-10T04:23:55.016907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:42.620729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.023491+0000","last_change":"2024-05-10T04:23:54.437364+0000","last_active":"2024-05-10T04:23:55.023491+0000","last_peered":"2024-05-10T04:23:55.023491+0000","last_clean":"2024-05-10T04:23:55.023491+0000","last_became_active":"2024-05-10T04:23:54.436999+0000","last_became_peered":"2024-05-10T04:23:54.436999+0000","last_unstale":"2024-05-10T04:23:55.023491+0000","last_undegraded":"2024-05-10T04:23:55.023491+0000","last_fullsized":"2024-05-10T04:23:55.023491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:08:10.966132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036282+0000","last_change":"2024-05-10T04:23:55.033643+0000","last_active":"2024-05-10T04:23:55.036282+0000","last_peered":"2024-05-10T04:23:55.036282+0000","last_clean":"2024-05-10T04:23:55.036282+0000","last_became_active":"2024-05-10T04:23:55.033296+0000","last_became_peered":"2024-05-10T04:23:55.033296+0000","last_unstale":"2024-05-10T04:23:55.036282+0000","last_undegraded":"2024-05-10T04:23:55.036282+0000","last_fullsized":"2024-05-10T04:23:55.036282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:40.134491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028004+0000","last_change":"2024-05-10T04:23:54.435984+0000","last_active":"2024-05-10T04:23:55.028004+0000","last_peered":"2024-05-10T04:23:55.028004+0000","last_clean":"2024-05-10T04:23:55.028004+0000","last_became_active":"2024-05-10T04:23:54.434597+0000","last_became_peered":"2024-05-10T04:23:54.434597+0000","last_unstale":"2024-05-10T04:23:55.028004+0000","last_undegraded":"2024-05-10T04:23:55.028004+0000","last_fullsized":"2024-05-10T04:23:55.028004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:44:41.238646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028361+0000","last_change":"2024-05-10T04:23:55.019195+0000","last_active":"2024-05-10T04:23:55.028361+0000","last_peered":"2024-05-10T04:23:55.028361+0000","last_clean":"2024-05-10T04:23:55.028361+0000","last_became_active":"2024-05-10T04:23:55.018930+0000","last_became_peered":"2024-05-10T04:23:55.018930+0000","last_unstale":"2024-05-10T04:23:55.028361+0000","last_undegraded":"2024-05-10T04:23:55.028361+0000","last_fullsized":"2024-05-10T04:23:55.028361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:34.975957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.009110+0000","last_change":"2024-05-10T04:23:54.422811+0000","last_active":"2024-05-10T04:23:55.009110+0000","last_peered":"2024-05-10T04:23:55.009110+0000","last_clean":"2024-05-10T04:23:55.009110+0000","last_became_active":"2024-05-10T04:23:54.422548+0000","last_became_peered":"2024-05-10T04:23:54.422548+0000","last_unstale":"2024-05-10T04:23:55.009110+0000","last_undegraded":"2024-05-10T04:23:55.009110+0000","last_fullsized":"2024-05-10T04:23:55.009110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:41:29.992176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.029805+0000","last_change":"2024-05-10T04:23:55.024027+0000","last_active":"2024-05-10T04:23:55.029805+0000","last_peered":"2024-05-10T04:23:55.029805+0000","last_clean":"2024-05-10T04:23:55.029805+0000","last_became_active":"2024-05-10T04:23:55.023832+0000","last_became_peered":"2024-05-10T04:23:55.023832+0000","last_unstale":"2024-05-10T04:23:55.029805+0000","last_undegraded":"2024-05-10T04:23:55.029805+0000","last_fullsized":"2024-05-10T04:23:55.029805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:43.064685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.001926+0000","last_change":"2024-05-10T04:23:54.434880+0000","last_active":"2024-05-10T04:23:55.001926+0000","last_peered":"2024-05-10T04:23:55.001926+0000","last_clean":"2024-05-10T04:23:55.001926+0000","last_became_active":"2024-05-10T04:23:54.434551+0000","last_became_peered":"2024-05-10T04:23:54.434551+0000","last_unstale":"2024-05-10T04:23:55.001926+0000","last_undegraded":"2024-05-10T04:23:55.001926+0000","last_fullsized":"2024-05-10T04:23:55.001926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:04:24.597037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036340+0000","last_change":"2024-05-10T04:23:55.034356+0000","last_active":"2024-05-10T04:23:55.036340+0000","last_peered":"2024-05-10T04:23:55.036340+0000","last_clean":"2024-05-10T04:23:55.036340+0000","last_became_active":"2024-05-10T04:23:55.034038+0000","last_became_peered":"2024-05-10T04:23:55.034038+0000","last_unstale":"2024-05-10T04:23:55.036340+0000","last_undegraded":"2024-05-10T04:23:55.036340+0000","last_fullsized":"2024-05-10T04:23:55.036340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:51:44.675640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.012888+0000","last_change":"2024-05-10T04:23:54.430158+0000","last_active":"2024-05-10T04:23:55.012888+0000","last_peered":"2024-05-10T04:23:55.012888+0000","last_clean":"2024-05-10T04:23:55.012888+0000","last_became_active":"2024-05-10T04:23:54.429813+0000","last_became_peered":"2024-05-10T04:23:54.429813+0000","last_unstale":"2024-05-10T04:23:55.012888+0000","last_undegraded":"2024-05-10T04:23:55.012888+0000","last_fullsized":"2024-05-10T04:23:55.012888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:43.170628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.035903+0000","last_change":"2024-05-10T04:23:55.029472+0000","last_active":"2024-05-10T04:23:55.035903+0000","last_peered":"2024-05-10T04:23:55.035903+0000","last_clean":"2024-05-10T04:23:55.035903+0000","last_became_active":"2024-05-10T04:23:55.028385+0000","last_became_peered":"2024-05-10T04:23:55.028385+0000","last_unstale":"2024-05-10T04:23:55.035903+0000","last_undegraded":"2024-05-10T04:23:55.035903+0000","last_fullsized":"2024-05-10T04:23:55.035903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:34:45.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.000220+0000","last_change":"2024-05-10T04:23:54.424726+0000","last_active":"2024-05-10T04:23:55.000220+0000","last_peered":"2024-05-10T04:23:55.000220+0000","last_clean":"2024-05-10T04:23:55.000220+0000","last_became_active":"2024-05-10T04:23:54.424380+0000","last_became_peered":"2024-05-10T04:23:54.424380+0000","last_unstale":"2024-05-10T04:23:55.000220+0000","last_undegraded":"2024-05-10T04:23:55.000220+0000","last_fullsized":"2024-05-10T04:23:55.000220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:34.584927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.022176+0000","last_change":"2024-05-10T04:23:55.018014+0000","last_active":"2024-05-10T04:23:55.022176+0000","last_peered":"2024-05-10T04:23:55.022176+0000","last_clean":"2024-05-10T04:23:55.022176+0000","last_became_active":"2024-05-10T04:23:55.017607+0000","last_became_peered":"2024-05-10T04:23:55.017607+0000","last_unstale":"2024-05-10T04:23:55.022176+0000","last_undegraded":"2024-05-10T04:23:55.022176+0000","last_fullsized":"2024-05-10T04:23:55.022176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:13.820894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.031704+0000","last_change":"2024-05-10T04:23:54.432863+0000","last_active":"2024-05-10T04:23:55.031704+0000","last_peered":"2024-05-10T04:23:55.031704+0000","last_clean":"2024-05-10T04:23:55.031704+0000","last_became_active":"2024-05-10T04:23:54.432557+0000","last_became_peered":"2024-05-10T04:23:54.432557+0000","last_unstale":"2024-05-10T04:23:55.031704+0000","last_undegraded":"2024-05-10T04:23:55.031704+0000","last_fullsized":"2024-05-10T04:23:55.031704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:34.584927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032736+0000","last_change":"2024-05-10T04:23:55.029143+0000","last_active":"2024-05-10T04:23:55.032736+0000","last_peered":"2024-05-10T04:23:55.032736+0000","last_clean":"2024-05-10T04:23:55.032736+0000","last_became_active":"2024-05-10T04:23:55.028547+0000","last_became_peered":"2024-05-10T04:23:55.028547+0000","last_unstale":"2024-05-10T04:23:55.032736+0000","last_undegraded":"2024-05-10T04:23:55.032736+0000","last_fullsized":"2024-05-10T04:23:55.032736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:01.635536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.040135+0000","last_change":"2024-05-10T04:23:54.442365+0000","last_active":"2024-05-10T04:23:55.040135+0000","last_peered":"2024-05-10T04:23:55.040135+0000","last_clean":"2024-05-10T04:23:55.040135+0000","last_became_active":"2024-05-10T04:23:54.442108+0000","last_became_peered":"2024-05-10T04:23:54.442108+0000","last_unstale":"2024-05-10T04:23:55.040135+0000","last_undegraded":"2024-05-10T04:23:55.040135+0000","last_fullsized":"2024-05-10T04:23:55.040135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:14.808820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.031751+0000","last_change":"2024-05-10T04:23:55.025821+0000","last_active":"2024-05-10T04:23:55.031751+0000","last_peered":"2024-05-10T04:23:55.031751+0000","last_clean":"2024-05-10T04:23:55.031751+0000","last_became_active":"2024-05-10T04:23:55.025607+0000","last_became_peered":"2024-05-10T04:23:55.025607+0000","last_unstale":"2024-05-10T04:23:55.031751+0000","last_undegraded":"2024-05-10T04:23:55.031751+0000","last_fullsized":"2024-05-10T04:23:55.031751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:30:56.833846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.027116+0000","last_change":"2024-05-10T04:23:54.438479+0000","last_active":"2024-05-10T04:23:55.027116+0000","last_peered":"2024-05-10T04:23:55.027116+0000","last_clean":"2024-05-10T04:23:55.027116+0000","last_became_active":"2024-05-10T04:23:54.438122+0000","last_became_peered":"2024-05-10T04:23:54.438122+0000","last_unstale":"2024-05-10T04:23:55.027116+0000","last_undegraded":"2024-05-10T04:23:55.027116+0000","last_fullsized":"2024-05-10T04:23:55.027116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:44.965163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.035891+0000","last_change":"2024-05-10T04:23:55.030168+0000","last_active":"2024-05-10T04:23:55.035891+0000","last_peered":"2024-05-10T04:23:55.035891+0000","last_clean":"2024-05-10T04:23:55.035891+0000","last_became_active":"2024-05-10T04:23:55.029570+0000","last_became_peered":"2024-05-10T04:23:55.029570+0000","last_unstale":"2024-05-10T04:23:55.035891+0000","last_undegraded":"2024-05-10T04:23:55.035891+0000","last_fullsized":"2024-05-10T04:23:55.035891+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:42.620729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.006013+0000","last_change":"2024-05-10T04:23:54.440978+0000","last_active":"2024-05-10T04:23:55.006013+0000","last_peered":"2024-05-10T04:23:55.006013+0000","last_clean":"2024-05-10T04:23:55.006013+0000","last_became_active":"2024-05-10T04:23:54.440616+0000","last_became_peered":"2024-05-10T04:23:54.440616+0000","last_unstale":"2024-05-10T04:23:55.006013+0000","last_undegraded":"2024-05-10T04:23:55.006013+0000","last_fullsized":"2024-05-10T04:23:55.006013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:42.633229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.022174+0000","last_change":"2024-05-10T04:23:55.017497+0000","last_active":"2024-05-10T04:23:55.022174+0000","last_peered":"2024-05-10T04:23:55.022174+0000","last_clean":"2024-05-10T04:23:55.022174+0000","last_became_active":"2024-05-10T04:23:55.016765+0000","last_became_peered":"2024-05-10T04:23:55.016765+0000","last_unstale":"2024-05-10T04:23:55.022174+0000","last_undegraded":"2024-05-10T04:23:55.022174+0000","last_fullsized":"2024-05-10T04:23:55.022174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:14.166931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.009210+0000","last_change":"2024-05-10T04:23:54.430598+0000","last_active":"2024-05-10T04:23:55.009210+0000","last_peered":"2024-05-10T04:23:55.009210+0000","last_clean":"2024-05-10T04:23:55.009210+0000","last_became_active":"2024-05-10T04:23:54.429849+0000","last_became_peered":"2024-05-10T04:23:54.429849+0000","last_unstale":"2024-05-10T04:23:55.009210+0000","last_undegraded":"2024-05-10T04:23:55.009210+0000","last_fullsized":"2024-05-10T04:23:55.009210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:56:02.099585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.035179+0000","last_change":"2024-05-10T04:23:55.030943+0000","last_active":"2024-05-10T04:23:55.035179+0000","last_peered":"2024-05-10T04:23:55.035179+0000","last_clean":"2024-05-10T04:23:55.035179+0000","last_became_active":"2024-05-10T04:23:55.029747+0000","last_became_peered":"2024-05-10T04:23:55.029747+0000","last_unstale":"2024-05-10T04:23:55.035179+0000","last_undegraded":"2024-05-10T04:23:55.035179+0000","last_fullsized":"2024-05-10T04:23:55.035179+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:27:31.569256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.031939+0000","last_change":"2024-05-10T04:23:54.433857+0000","last_active":"2024-05-10T04:23:55.031939+0000","last_peered":"2024-05-10T04:23:55.031939+0000","last_clean":"2024-05-10T04:23:55.031939+0000","last_became_active":"2024-05-10T04:23:54.433483+0000","last_became_peered":"2024-05-10T04:23:54.433483+0000","last_unstale":"2024-05-10T04:23:55.031939+0000","last_undegraded":"2024-05-10T04:23:55.031939+0000","last_fullsized":"2024-05-10T04:23:55.031939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:34.584927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028317+0000","last_change":"2024-05-10T04:23:55.020071+0000","last_active":"2024-05-10T04:23:55.028317+0000","last_peered":"2024-05-10T04:23:55.028317+0000","last_clean":"2024-05-10T04:23:55.028317+0000","last_became_active":"2024-05-10T04:23:55.019738+0000","last_became_peered":"2024-05-10T04:23:55.019738+0000","last_unstale":"2024-05-10T04:23:55.028317+0000","last_undegraded":"2024-05-10T04:23:55.028317+0000","last_fullsized":"2024-05-10T04:23:55.028317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:11:15.929034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036573+0000","last_change":"2024-05-10T04:23:54.433319+0000","last_active":"2024-05-10T04:23:55.036573+0000","last_peered":"2024-05-10T04:23:55.036573+0000","last_clean":"2024-05-10T04:23:55.036573+0000","last_became_active":"2024-05-10T04:23:54.432909+0000","last_became_peered":"2024-05-10T04:23:54.432909+0000","last_unstale":"2024-05-10T04:23:55.036573+0000","last_undegraded":"2024-05-10T04:23:55.036573+0000","last_fullsized":"2024-05-10T04:23:55.036573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:14.808820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.035118+0000","last_change":"2024-05-10T04:23:55.031127+0000","last_active":"2024-05-10T04:23:55.035118+0000","last_peered":"2024-05-10T04:23:55.035118+0000","last_clean":"2024-05-10T04:23:55.035118+0000","last_became_active":"2024-05-10T04:23:55.030831+0000","last_became_peered":"2024-05-10T04:23:55.030831+0000","last_unstale":"2024-05-10T04:23:55.035118+0000","last_undegraded":"2024-05-10T04:23:55.035118+0000","last_fullsized":"2024-05-10T04:23:55.035118+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:49:42.620729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028382+0000","last_change":"2024-05-10T04:23:54.439113+0000","last_active":"2024-05-10T04:23:55.028382+0000","last_peered":"2024-05-10T04:23:55.028382+0000","last_clean":"2024-05-10T04:23:55.028382+0000","last_became_active":"2024-05-10T04:23:54.438826+0000","last_became_peered":"2024-05-10T04:23:54.438826+0000","last_unstale":"2024-05-10T04:23:55.028382+0000","last_undegraded":"2024-05-10T04:23:55.028382+0000","last_fullsized":"2024-05-10T04:23:55.028382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:17:46.737420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.027104+0000","last_change":"2024-05-10T04:23:55.021630+0000","last_active":"2024-05-10T04:23:55.027104+0000","last_peered":"2024-05-10T04:23:55.027104+0000","last_clean":"2024-05-10T04:23:55.027104+0000","last_became_active":"2024-05-10T04:23:55.021371+0000","last_became_peered":"2024-05-10T04:23:55.021371+0000","last_unstale":"2024-05-10T04:23:55.027104+0000","last_undegraded":"2024-05-10T04:23:55.027104+0000","last_fullsized":"2024-05-10T04:23:55.027104+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:40.134491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.029164+0000","last_change":"2024-05-10T04:23:54.438297+0000","last_active":"2024-05-10T04:23:55.029164+0000","last_peered":"2024-05-10T04:23:55.029164+0000","last_clean":"2024-05-10T04:23:55.029164+0000","last_became_active":"2024-05-10T04:23:54.437990+0000","last_became_peered":"2024-05-10T04:23:54.437990+0000","last_unstale":"2024-05-10T04:23:55.029164+0000","last_undegraded":"2024-05-10T04:23:55.029164+0000","last_fullsized":"2024-05-10T04:23:55.029164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:37.431346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036221+0000","last_change":"2024-05-10T04:23:55.018575+0000","last_active":"2024-05-10T04:23:55.036221+0000","last_peered":"2024-05-10T04:23:55.036221+0000","last_clean":"2024-05-10T04:23:55.036221+0000","last_became_active":"2024-05-10T04:23:55.018263+0000","last_became_peered":"2024-05-10T04:23:55.018263+0000","last_unstale":"2024-05-10T04:23:55.036221+0000","last_undegraded":"2024-05-10T04:23:55.036221+0000","last_fullsized":"2024-05-10T04:23:55.036221+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:41:30.998827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.002810+0000","last_change":"2024-05-10T04:23:54.437319+0000","last_active":"2024-05-10T04:23:55.002810+0000","last_peered":"2024-05-10T04:23:55.002810+0000","last_clean":"2024-05-10T04:23:55.002810+0000","last_became_active":"2024-05-10T04:23:54.436920+0000","last_became_peered":"2024-05-10T04:23:54.436920+0000","last_unstale":"2024-05-10T04:23:55.002810+0000","last_undegraded":"2024-05-10T04:23:55.002810+0000","last_fullsized":"2024-05-10T04:23:55.002810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:13:52.236033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036252+0000","last_change":"2024-05-10T04:23:55.019828+0000","last_active":"2024-05-10T04:23:55.036252+0000","last_peered":"2024-05-10T04:23:55.036252+0000","last_clean":"2024-05-10T04:23:55.036252+0000","last_became_active":"2024-05-10T04:23:55.019633+0000","last_became_peered":"2024-05-10T04:23:55.019633+0000","last_unstale":"2024-05-10T04:23:55.036252+0000","last_undegraded":"2024-05-10T04:23:55.036252+0000","last_fullsized":"2024-05-10T04:23:55.036252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:40.442402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.027511+0000","last_change":"2024-05-10T04:23:54.435629+0000","last_active":"2024-05-10T04:23:55.027511+0000","last_peered":"2024-05-10T04:23:55.027511+0000","last_clean":"2024-05-10T04:23:55.027511+0000","last_became_active":"2024-05-10T04:23:54.435323+0000","last_became_peered":"2024-05-10T04:23:54.435323+0000","last_unstale":"2024-05-10T04:23:55.027511+0000","last_undegraded":"2024-05-10T04:23:55.027511+0000","last_fullsized":"2024-05-10T04:23:55.027511+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:42.633229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036752+0000","last_change":"2024-05-10T04:23:55.029326+0000","last_active":"2024-05-10T04:23:55.036752+0000","last_peered":"2024-05-10T04:23:55.036752+0000","last_clean":"2024-05-10T04:23:55.036752+0000","last_became_active":"2024-05-10T04:23:55.029030+0000","last_became_peered":"2024-05-10T04:23:55.029030+0000","last_unstale":"2024-05-10T04:23:55.036752+0000","last_undegraded":"2024-05-10T04:23:55.036752+0000","last_fullsized":"2024-05-10T04:23:55.036752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:56:03.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.010248+0000","last_change":"2024-05-10T04:23:54.442066+0000","last_active":"2024-05-10T04:23:55.010248+0000","last_peered":"2024-05-10T04:23:55.010248+0000","last_clean":"2024-05-10T04:23:55.010248+0000","last_became_active":"2024-05-10T04:23:54.441684+0000","last_became_peered":"2024-05-10T04:23:54.441684+0000","last_unstale":"2024-05-10T04:23:55.010248+0000","last_undegraded":"2024-05-10T04:23:55.010248+0000","last_fullsized":"2024-05-10T04:23:55.010248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:44.965163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.038587+0000","last_change":"2024-05-10T04:23:55.030163+0000","last_active":"2024-05-10T04:23:55.038587+0000","last_peered":"2024-05-10T04:23:55.038587+0000","last_clean":"2024-05-10T04:23:55.038587+0000","last_became_active":"2024-05-10T04:23:55.026471+0000","last_became_peered":"2024-05-10T04:23:55.026471+0000","last_unstale":"2024-05-10T04:23:55.038587+0000","last_undegraded":"2024-05-10T04:23:55.038587+0000","last_fullsized":"2024-05-10T04:23:55.038587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:35.591577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.002071+0000","last_change":"2024-05-10T04:23:54.443750+0000","last_active":"2024-05-10T04:23:55.002071+0000","last_peered":"2024-05-10T04:23:55.002071+0000","last_clean":"2024-05-10T04:23:55.002071+0000","last_became_active":"2024-05-10T04:23:54.443506+0000","last_became_peered":"2024-05-10T04:23:54.443506+0000","last_unstale":"2024-05-10T04:23:55.002071+0000","last_undegraded":"2024-05-10T04:23:55.002071+0000","last_fullsized":"2024-05-10T04:23:55.002071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:40.181792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032611+0000","last_change":"2024-05-10T04:23:55.024620+0000","last_active":"2024-05-10T04:23:55.032611+0000","last_peered":"2024-05-10T04:23:55.032611+0000","last_clean":"2024-05-10T04:23:55.032611+0000","last_became_active":"2024-05-10T04:23:55.024314+0000","last_became_peered":"2024-05-10T04:23:55.024314+0000","last_unstale":"2024-05-10T04:23:55.032611+0000","last_undegraded":"2024-05-10T04:23:55.032611+0000","last_fullsized":"2024-05-10T04:23:55.032611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:14:31.390175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.010699+0000","last_change":"2024-05-10T04:23:54.433626+0000","last_active":"2024-05-10T04:23:55.010699+0000","last_peered":"2024-05-10T04:23:55.010699+0000","last_clean":"2024-05-10T04:23:55.010699+0000","last_became_active":"2024-05-10T04:23:54.433178+0000","last_became_peered":"2024-05-10T04:23:54.433178+0000","last_unstale":"2024-05-10T04:23:55.010699+0000","last_undegraded":"2024-05-10T04:23:55.010699+0000","last_fullsized":"2024-05-10T04:23:55.010699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:43.170628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.038743+0000","last_change":"2024-05-10T04:23:55.033304+0000","last_active":"2024-05-10T04:23:55.038743+0000","last_peered":"2024-05-10T04:23:55.038743+0000","last_clean":"2024-05-10T04:23:55.038743+0000","last_became_active":"2024-05-10T04:23:55.032833+0000","last_became_peered":"2024-05-10T04:23:55.032833+0000","last_unstale":"2024-05-10T04:23:55.038743+0000","last_undegraded":"2024-05-10T04:23:55.038743+0000","last_fullsized":"2024-05-10T04:23:55.038743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:09:08.019512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.033338+0000","last_change":"2024-05-10T04:23:54.436519+0000","last_active":"2024-05-10T04:23:55.033338+0000","last_peered":"2024-05-10T04:23:55.033338+0000","last_clean":"2024-05-10T04:23:55.033338+0000","last_became_active":"2024-05-10T04:23:54.435721+0000","last_became_peered":"2024-05-10T04:23:54.435721+0000","last_unstale":"2024-05-10T04:23:55.033338+0000","last_undegraded":"2024-05-10T04:23:55.033338+0000","last_fullsized":"2024-05-10T04:23:55.033338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:40.181792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032553+0000","last_change":"2024-05-10T04:23:55.027193+0000","last_active":"2024-05-10T04:23:55.032553+0000","last_peered":"2024-05-10T04:23:55.032553+0000","last_clean":"2024-05-10T04:23:55.032553+0000","last_became_active":"2024-05-10T04:23:55.026406+0000","last_became_peered":"2024-05-10T04:23:55.026406+0000","last_unstale":"2024-05-10T04:23:55.032553+0000","last_undegraded":"2024-05-10T04:23:55.032553+0000","last_fullsized":"2024-05-10T04:23:55.032553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:34:45.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.000322+0000","last_change":"2024-05-10T04:23:54.441784+0000","last_active":"2024-05-10T04:23:55.000322+0000","last_peered":"2024-05-10T04:23:55.000322+0000","last_clean":"2024-05-10T04:23:55.000322+0000","last_became_active":"2024-05-10T04:23:54.441452+0000","last_became_peered":"2024-05-10T04:23:54.441452+0000","last_unstale":"2024-05-10T04:23:55.000322+0000","last_undegraded":"2024-05-10T04:23:55.000322+0000","last_fullsized":"2024-05-10T04:23:55.000322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:40.181792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032142+0000","last_change":"2024-05-10T04:23:55.027898+0000","last_active":"2024-05-10T04:23:55.032142+0000","last_peered":"2024-05-10T04:23:55.032142+0000","last_clean":"2024-05-10T04:23:55.032142+0000","last_became_active":"2024-05-10T04:23:55.027556+0000","last_became_peered":"2024-05-10T04:23:55.027556+0000","last_unstale":"2024-05-10T04:23:55.032142+0000","last_undegraded":"2024-05-10T04:23:55.032142+0000","last_fullsized":"2024-05-10T04:23:55.032142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:40.442402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.011767+0000","last_change":"2024-05-10T04:23:54.435099+0000","last_active":"2024-05-10T04:23:55.011767+0000","last_peered":"2024-05-10T04:23:55.011767+0000","last_clean":"2024-05-10T04:23:55.011767+0000","last_became_active":"2024-05-10T04:23:54.432875+0000","last_became_peered":"2024-05-10T04:23:54.432875+0000","last_unstale":"2024-05-10T04:23:55.011767+0000","last_undegraded":"2024-05-10T04:23:55.011767+0000","last_fullsized":"2024-05-10T04:23:55.011767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:34.584927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032271+0000","last_change":"2024-05-10T04:23:55.029025+0000","last_active":"2024-05-10T04:23:55.032271+0000","last_peered":"2024-05-10T04:23:55.032271+0000","last_clean":"2024-05-10T04:23:55.032271+0000","last_became_active":"2024-05-10T04:23:55.028716+0000","last_became_peered":"2024-05-10T04:23:55.028716+0000","last_unstale":"2024-05-10T04:23:55.032271+0000","last_undegraded":"2024-05-10T04:23:55.032271+0000","last_fullsized":"2024-05-10T04:23:55.032271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:56:03.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:54.999346+0000","last_change":"2024-05-10T04:23:54.431614+0000","last_active":"2024-05-10T04:23:54.999346+0000","last_peered":"2024-05-10T04:23:54.999346+0000","last_clean":"2024-05-10T04:23:54.999346+0000","last_became_active":"2024-05-10T04:23:54.430499+0000","last_became_peered":"2024-05-10T04:23:54.430499+0000","last_unstale":"2024-05-10T04:23:54.999346+0000","last_undegraded":"2024-05-10T04:23:54.999346+0000","last_fullsized":"2024-05-10T04:23:54.999346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:03:19.628470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.028149+0000","last_change":"2024-05-10T04:23:55.022457+0000","last_active":"2024-05-10T04:23:55.028149+0000","last_peered":"2024-05-10T04:23:55.028149+0000","last_clean":"2024-05-10T04:23:55.028149+0000","last_became_active":"2024-05-10T04:23:55.021609+0000","last_became_peered":"2024-05-10T04:23:55.021609+0000","last_unstale":"2024-05-10T04:23:55.028149+0000","last_undegraded":"2024-05-10T04:23:55.028149+0000","last_fullsized":"2024-05-10T04:23:55.028149+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:34.975957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.005911+0000","last_change":"2024-05-10T04:23:54.438246+0000","last_active":"2024-05-10T04:23:55.005911+0000","last_peered":"2024-05-10T04:23:55.005911+0000","last_clean":"2024-05-10T04:23:55.005911+0000","last_became_active":"2024-05-10T04:23:54.436229+0000","last_became_peered":"2024-05-10T04:23:54.436229+0000","last_unstale":"2024-05-10T04:23:55.005911+0000","last_undegraded":"2024-05-10T04:23:55.005911+0000","last_fullsized":"2024-05-10T04:23:55.005911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:03:19.628470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.036158+0000","last_change":"2024-05-10T04:23:55.028888+0000","last_active":"2024-05-10T04:23:55.036158+0000","last_peered":"2024-05-10T04:23:55.036158+0000","last_clean":"2024-05-10T04:23:55.036158+0000","last_became_active":"2024-05-10T04:23:55.028616+0000","last_became_peered":"2024-05-10T04:23:55.028616+0000","last_unstale":"2024-05-10T04:23:55.036158+0000","last_undegraded":"2024-05-10T04:23:55.036158+0000","last_fullsized":"2024-05-10T04:23:55.036158+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:14.166931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.002129+0000","last_change":"2024-05-10T04:23:54.435189+0000","last_active":"2024-05-10T04:23:55.002129+0000","last_peered":"2024-05-10T04:23:55.002129+0000","last_clean":"2024-05-10T04:23:55.002129+0000","last_became_active":"2024-05-10T04:23:54.434804+0000","last_became_peered":"2024-05-10T04:23:54.434804+0000","last_unstale":"2024-05-10T04:23:55.002129+0000","last_undegraded":"2024-05-10T04:23:55.002129+0000","last_fullsized":"2024-05-10T04:23:55.002129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:22.888123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.023277+0000","last_change":"2024-05-10T04:23:55.014667+0000","last_active":"2024-05-10T04:23:55.023277+0000","last_peered":"2024-05-10T04:23:55.023277+0000","last_clean":"2024-05-10T04:23:55.023277+0000","last_became_active":"2024-05-10T04:23:55.014369+0000","last_became_peered":"2024-05-10T04:23:55.014369+0000","last_unstale":"2024-05-10T04:23:55.023277+0000","last_undegraded":"2024-05-10T04:23:55.023277+0000","last_fullsized":"2024-05-10T04:23:55.023277+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:09:08.019512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.009272+0000","last_change":"2024-05-10T04:23:54.430333+0000","last_active":"2024-05-10T04:23:55.009272+0000","last_peered":"2024-05-10T04:23:55.009272+0000","last_clean":"2024-05-10T04:23:55.009272+0000","last_became_active":"2024-05-10T04:23:54.429745+0000","last_became_peered":"2024-05-10T04:23:54.429745+0000","last_unstale":"2024-05-10T04:23:55.009272+0000","last_undegraded":"2024-05-10T04:23:55.009272+0000","last_fullsized":"2024-05-10T04:23:55.009272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:42.354481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.032582+0000","last_change":"2024-05-10T04:23:55.025033+0000","last_active":"2024-05-10T04:23:55.032582+0000","last_peered":"2024-05-10T04:23:55.032582+0000","last_clean":"2024-05-10T04:23:55.032582+0000","last_became_active":"2024-05-10T04:23:55.024691+0000","last_became_peered":"2024-05-10T04:23:55.024691+0000","last_unstale":"2024-05-10T04:23:55.032582+0000","last_undegraded":"2024-05-10T04:23:55.032582+0000","last_fullsized":"2024-05-10T04:23:55.032582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:54.403503+0000","last_clean_scrub_stamp":"2024-05-10T04:23:54.403503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:51:44.675640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:23:55.011139+0000","last_change":"2024-05-10T04:23:54.439432+0000","last_active":"2024-05-10T04:23:55.011139+0000","last_peered":"2024-05-10T04:23:55.011139+0000","last_clean":"2024-05-10T04:23:55.011139+0000","last_became_active":"2024-05-10T04:23:54.439105+0000","last_became_peered":"2024-05-10T04:23:54.439105+0000","last_unstale":"2024-05-10T04:23:55.011139+0000","last_undegraded":"2024-05-10T04:23:55.011139+0000","last_fullsized":"2024-05-10T04:23:55.011139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:23:53.396852+0000","last_clean_scrub_stamp":"2024-05-10T04:23:53.396852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:17:46.737420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-10T04:23:54.430518+0000","last_change":"2024-05-10T04:22:27.829537+0000","last_active":"2024-05-10T04:23:54.430518+0000","last_peered":"2024-05-10T04:23:54.430518+0000","last_clean":"2024-05-10T04:23:54.430518+0000","last_became_active":"2024-05-10T04:22:27.828179+0000","last_became_peered":"2024-05-10T04:22:27.828179+0000","last_unstale":"2024-05-10T04:23:54.430518+0000","last_undegraded":"2024-05-10T04:23:54.430518+0000","last_fullsized":"2024-05-10T04:23:54.430518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_clean_scrub_stamp":"2024-05-10T04:22:26.813824+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:23.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":729180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.69999999999999996}]},{"osd":1,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.81699999999999995}]},{"osd":2,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.73199999999999998}]},{"osd":3,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.875},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.80200000000000005}]},{"osd":4,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.93200000000000005}]},{"osd":5,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.89800000000000002}]},{"osd":6,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":1.0129999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.74199999999999999}]},{"osd":2,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.82799999999999996}]},{"osd":3,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.621}]},{"osd":4,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.68000000000000005}]},{"osd":7,"last update":"Fri May 10 04:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.86199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":147173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":3.347,"5min":3.347,"15min":3.347},"last":0.60199999999999998}]},{"osd":2,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":3.4929999999999999,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.629,"5min":3.629,"15min":3.629},"last":0.63800000000000001}]},{"osd":4,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.92500000000000004}]},{"osd":5,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.78900000000000003}]},{"osd":6,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":3.2890000000000001,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.83999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":966656,"data_stored":735955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.36799999999999999}]},{"osd":3,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.436},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.93600000000000005}]},{"osd":5,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.98499999999999999}]},{"osd":6,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.89900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":145657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":6.2450000000000001,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":5.883,"5min":5.883,"15min":5.883},"last":0.312}]},{"osd":1,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":4.1440000000000001,"5min":4.1440000000000001,"15min":4.1440000000000001},"last":0.38},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.9480000000000004,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.438}]},{"osd":3,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":3.452,"5min":3.452,"15min":3.452},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":3.3809999999999998,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.628}]},{"osd":5,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.3279999999999998,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":3.3330000000000002,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri May 10 04:23:25 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":3.419,"5min":3.419,"15min":3.419},"last":0.72199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":147173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.505},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":3.6829999999999998,"5min":3.6829999999999998,"15min":3.6829999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.58399999999999996}]},{"osd":2,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":3.7240000000000002,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.0010000000000003,"5min":4.0010000000000003,"15min":4.0010000000000003},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":4.024,"5min":4.024,"15min":4.024},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.74199999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.69999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.626},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":0.59699999999999998}]},{"osd":1,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.751}]},{"osd":3,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.7080000000000002,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":0.72299999999999998}]},{"osd":5,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri May 10 04:23:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.70199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:23:30 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri May 10 04:23:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri May 10 04:23:30 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":2.577,"5min":2.577,"15min":2.577},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Fri May 10 04:23:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.622},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.73499999999999999}]},{"osd":4,"last update":"Fri May 10 04:23:30 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.6320000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":0.70999999999999996}]},{"osd":6,"last update":"Fri May 10 04:23:30 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri May 10 04:23:30 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":4.0700000000000003,"5min":4.0700000000000003,"15min":4.0700000000000003},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.68799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:24:00.619 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-10T04:24:00.620 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-10T04:24:00.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.923+0000 7fcb36a00700 1 Processor -- start 2024-05-10T04:24:00.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.924+0000 7fcb36a00700 1 -- start start 2024-05-10T04:24:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.926+0000 7fcb36a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcb3006c2f0 0x7fcb3006c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.926+0000 7fcb36a00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3006cf70 con 0x7fcb300b3280 2024-05-10T04:24:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.926+0000 7fcb36a00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3006d250 con 0x7fcb300b5d00 2024-05-10T04:24:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.926+0000 7fcb36a00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb300d28b0 con 0x7fcb3006c2f0 2024-05-10T04:24:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.926+0000 7fcb2fe00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcb300b3280 0x7fcb300d3390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49188/0 (socket says 172.21.15.80:49188) 2024-05-10T04:24:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.926+0000 7fcb2fe00700 1 -- 172.21.15.80:0/3881902971 learned_addr learned my addr 172.21.15.80:0/3881902971 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:24:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.926+0000 7fcb34a00700 1 --2- 172.21.15.80:0/3881902971 >> v2:172.21.15.80:3300/0 conn(0x7fcb3006c2f0 0x7fcb3006c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.926+0000 7fcb2ea00700 1 -- 172.21.15.80:0/3881902971 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642828548 0 0) 0x7fcb3006cf70 con 0x7fcb300b3280 2024-05-10T04:24:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.926+0000 7fcb2ea00700 1 -- 172.21.15.80:0/3881902971 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb140035b0 con 0x7fcb300b3280 2024-05-10T04:24:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.927+0000 7fcb34a00700 1 -- 172.21.15.80:0/3881902971 >> v1:172.21.15.106:6789/0 conn(0x7fcb300b5d00 legacy=0x7fcb300b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.927+0000 7fcb34a00700 1 -- 172.21.15.80:0/3881902971 >> v1:172.21.15.80:6789/0 conn(0x7fcb300b3280 legacy=0x7fcb300d3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.927+0000 7fcb34a00700 1 -- 172.21.15.80:0/3881902971 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb300d2b90 con 0x7fcb3006c2f0 2024-05-10T04:24:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.927+0000 7fcb34a00700 1 --2- 172.21.15.80:0/3881902971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb3006c2f0 0x7fcb3006c700 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009d90 tx=0x7fcb2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b983a45afd2adec9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.927+0000 7fcb2ea00700 1 -- 172.21.15.80:0/3881902971 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800e070 con 0x7fcb3006c2f0 2024-05-10T04:24:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.927+0000 7fcb2ea00700 1 -- 172.21.15.80:0/3881902971 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2800bb20 con 0x7fcb3006c2f0 2024-05-10T04:24:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.927+0000 7fcb2ea00700 1 -- 172.21.15.80:0/3881902971 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800be90 con 0x7fcb3006c2f0 2024-05-10T04:24:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.928+0000 7fcb36a00700 1 -- 172.21.15.80:0/3881902971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb3006c2f0 msgr2=0x7fcb3006c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.928+0000 7fcb36a00700 1 --2- 172.21.15.80:0/3881902971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb3006c2f0 0x7fcb3006c700 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009d90 tx=0x7fcb2800b330 comp rx=0 tx=0).stop 2024-05-10T04:24:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.928+0000 7fcb36a00700 1 -- 172.21.15.80:0/3881902971 shutdown_connections 2024-05-10T04:24:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.928+0000 7fcb36a00700 1 --2- 172.21.15.80:0/3881902971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb3006c2f0 0x7fcb3006c700 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.928+0000 7fcb36a00700 1 -- 172.21.15.80:0/3881902971 >> 172.21.15.80:0/3881902971 conn(0x7fcb300d40a0 msgr2=0x7fcb300d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.928+0000 7fcb36a00700 1 -- 172.21.15.80:0/3881902971 shutdown_connections 2024-05-10T04:24:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.928+0000 7fcb36a00700 1 -- 172.21.15.80:0/3881902971 wait complete. 2024-05-10T04:24:00.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.930+0000 7fcb36a00700 1 Processor -- start 2024-05-10T04:24:00.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.930+0000 7fcb36a00700 1 -- start start 2024-05-10T04:24:00.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb36a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb3006c2f0 0x7fcb300ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:00.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb36a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb300b3280 0x7fcb3015bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:00.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb36a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb300b5d00 0x7fcb300cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:00.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb36a00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300cdc90 con 0x7fcb3006c2f0 2024-05-10T04:24:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb36a00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300ca670 con 0x7fcb300b3280 2024-05-10T04:24:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb36a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300ccae0 con 0x7fcb300b5d00 2024-05-10T04:24:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb2fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb3006c2f0 0x7fcb300ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb2fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb3006c2f0 0x7fcb300ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59898/0 (socket says 172.21.15.80:59898) 2024-05-10T04:24:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb2fe00700 1 -- 172.21.15.80:0/2239023517 learned_addr learned my addr 172.21.15.80:0/2239023517 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:24:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb2f400700 1 --2- 172.21.15.80:0/2239023517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb300b3280 0x7fcb3015bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb34a00700 1 --2- 172.21.15.80:0/2239023517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb300b5d00 0x7fcb300cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb2fe00700 1 -- 172.21.15.80:0/2239023517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb300b5d00 msgr2=0x7fcb300cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb2fe00700 1 --2- 172.21.15.80:0/2239023517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb300b5d00 0x7fcb300cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb2fe00700 1 -- 172.21.15.80:0/2239023517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb300b3280 msgr2=0x7fcb3015bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb2fe00700 1 --2- 172.21.15.80:0/2239023517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb300b3280 0x7fcb3015bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb2fe00700 1 -- 172.21.15.80:0/2239023517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28009a70 con 0x7fcb3006c2f0 2024-05-10T04:24:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb34a00700 1 --2- 172.21.15.80:0/2239023517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb300b5d00 0x7fcb300cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:24:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.932+0000 7fcb2f400700 1 --2- 172.21.15.80:0/2239023517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb300b3280 0x7fcb3015bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:24:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.933+0000 7fcb2fe00700 1 --2- 172.21.15.80:0/2239023517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb3006c2f0 0x7fcb300ca130 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000c500 tx=0x7fcb2000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.933+0000 7fcb27e00700 1 -- 172.21.15.80:0/2239023517 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb20005d70 con 0x7fcb3006c2f0 2024-05-10T04:24:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.933+0000 7fcb27e00700 1 -- 172.21.15.80:0/2239023517 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb200070d0 con 0x7fcb3006c2f0 2024-05-10T04:24:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.933+0000 7fcb36a00700 1 -- 172.21.15.80:0/2239023517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3015c6a0 con 0x7fcb3006c2f0 2024-05-10T04:24:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.933+0000 7fcb27e00700 1 -- 172.21.15.80:0/2239023517 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb20007440 con 0x7fcb3006c2f0 2024-05-10T04:24:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.933+0000 7fcb36a00700 1 -- 172.21.15.80:0/2239023517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3015cbd0 con 0x7fcb3006c2f0 2024-05-10T04:24:00.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.934+0000 7fcb36a00700 1 -- 172.21.15.80:0/2239023517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb300732b0 con 0x7fcb3006c2f0 2024-05-10T04:24:00.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.935+0000 7fcb27e00700 1 -- 172.21.15.80:0/2239023517 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcb200075a0 con 0x7fcb3006c2f0 2024-05-10T04:24:00.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.936+0000 7fcb27e00700 1 --2- 172.21.15.80:0/2239023517 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcb1006ac90 0x7fcb1006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:00.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.936+0000 7fcb27e00700 1 -- 172.21.15.80:0/2239023517 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb20088870 con 0x7fcb3006c2f0 2024-05-10T04:24:00.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.936+0000 7fcb2f400700 1 --2- 172.21.15.80:0/2239023517 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcb1006ac90 0x7fcb1006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:00.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.937+0000 7fcb2f400700 1 --2- 172.21.15.80:0/2239023517 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcb1006ac90 0x7fcb1006d1a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcb300b84c0 tx=0x7fcb1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:00.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:00.941+0000 7fcb27e00700 1 -- 172.21.15.80:0/2239023517 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcb20053a60 con 0x7fcb3006c2f0 2024-05-10T04:24:01.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.227+0000 7fcb36a00700 1 -- 172.21.15.80:0/2239023517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fcb30074af0 con 0x7fcb3006c2f0 2024-05-10T04:24:01.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.232+0000 7fcb27e00700 1 -- 172.21.15.80:0/2239023517 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7fcb20057080 con 0x7fcb3006c2f0 2024-05-10T04:24:01.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.235+0000 7fcb36a00700 1 -- 172.21.15.80:0/2239023517 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcb1006ac90 msgr2=0x7fcb1006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:01.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.235+0000 7fcb36a00700 1 --2- 172.21.15.80:0/2239023517 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcb1006ac90 0x7fcb1006d1a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcb300b84c0 tx=0x7fcb1c009040 comp rx=0 tx=0).stop 2024-05-10T04:24:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.235+0000 7fcb36a00700 1 -- 172.21.15.80:0/2239023517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb3006c2f0 msgr2=0x7fcb300ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.235+0000 7fcb36a00700 1 --2- 172.21.15.80:0/2239023517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb3006c2f0 0x7fcb300ca130 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000c500 tx=0x7fcb2000c8c0 comp rx=0 tx=0).stop 2024-05-10T04:24:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.235+0000 7fcb36a00700 1 -- 172.21.15.80:0/2239023517 shutdown_connections 2024-05-10T04:24:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.235+0000 7fcb36a00700 1 --2- 172.21.15.80:0/2239023517 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcb1006ac90 0x7fcb1006d1a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.235+0000 7fcb36a00700 1 --2- 172.21.15.80:0/2239023517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb3006c2f0 0x7fcb300ca130 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.235+0000 7fcb36a00700 1 --2- 172.21.15.80:0/2239023517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb300b5d00 0x7fcb300cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.235+0000 7fcb36a00700 1 --2- 172.21.15.80:0/2239023517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb300b3280 0x7fcb3015bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.235+0000 7fcb36a00700 1 -- 172.21.15.80:0/2239023517 >> 172.21.15.80:0/2239023517 conn(0x7fcb300d40a0 msgr2=0x7fcb300d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.235+0000 7fcb36a00700 1 -- 172.21.15.80:0/2239023517 shutdown_connections 2024-05-10T04:24:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.235+0000 7fcb36a00700 1 -- 172.21.15.80:0/2239023517 wait complete. 2024-05-10T04:24:01.238 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2024-05-10T04:24:01.263 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:24:01.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.523+0000 7ff858000700 1 Processor -- start 2024-05-10T04:24:01.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.524+0000 7ff858000700 1 -- start start 2024-05-10T04:24:01.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.526+0000 7ff858000700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff85006b340 0x7ff8500b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:01.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.526+0000 7ff858000700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8500b20e0 con 0x7ff8500cb0e0 2024-05-10T04:24:01.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.526+0000 7ff858000700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85015e8b0 con 0x7ff8500b6270 2024-05-10T04:24:01.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.526+0000 7ff858000700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8500b13c0 con 0x7ff85006b340 2024-05-10T04:24:01.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.526+0000 7ff855600700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff8500cb0e0 0x7ff85006ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49198/0 (socket says 172.21.15.80:49198) 2024-05-10T04:24:01.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.526+0000 7ff855600700 1 -- 172.21.15.80:0/499487915 learned_addr learned my addr 172.21.15.80:0/499487915 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:24:01.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.526+0000 7ff854c00700 1 --2- 172.21.15.80:0/499487915 >> v2:172.21.15.106:3300/0 conn(0x7ff85006b340 0x7ff8500b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:01.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.526+0000 7ff84fe00700 1 -- 172.21.15.80:0/499487915 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222135928 0 0) 0x7ff8500b20e0 con 0x7ff8500cb0e0 2024-05-10T04:24:01.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.526+0000 7ff84fe00700 1 -- 172.21.15.80:0/499487915 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8380035b0 con 0x7ff8500cb0e0 2024-05-10T04:24:01.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.526+0000 7ff84fe00700 1 -- 172.21.15.80:0/499487915 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150086169 0 0) 0x7ff85015e8b0 con 0x7ff8500b6270 2024-05-10T04:24:01.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.526+0000 7ff84fe00700 1 -- 172.21.15.80:0/499487915 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8500b20e0 con 0x7ff8500b6270 2024-05-10T04:24:01.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.527+0000 7ff854c00700 1 -- 172.21.15.80:0/499487915 >> v1:172.21.15.106:6789/0 conn(0x7ff8500b6270 legacy=0x7ff850161fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:01.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.527+0000 7ff84fe00700 1 -- 172.21.15.80:0/499487915 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 183192450 0 0) 0x7ff8380035b0 con 0x7ff8500cb0e0 2024-05-10T04:24:01.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.527+0000 7ff854c00700 1 -- 172.21.15.80:0/499487915 >> v1:172.21.15.80:6789/0 conn(0x7ff8500cb0e0 legacy=0x7ff85006ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:01.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.527+0000 7ff854c00700 1 -- 172.21.15.80:0/499487915 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8500d1970 con 0x7ff85006b340 2024-05-10T04:24:01.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.527+0000 7ff854c00700 1 --2- 172.21.15.80:0/499487915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff85006b340 0x7ff8500b5cb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009840 tx=0x7ff83c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d60b575fad00cdcc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:01.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.527+0000 7ff84fe00700 1 -- 172.21.15.80:0/499487915 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff844001670 con 0x7ff85006b340 2024-05-10T04:24:01.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.527+0000 7ff84fe00700 1 -- 172.21.15.80:0/499487915 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c004030 con 0x7ff85006b340 2024-05-10T04:24:01.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.527+0000 7ff84fe00700 1 -- 172.21.15.80:0/499487915 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0043c0 con 0x7ff85006b340 2024-05-10T04:24:01.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.528+0000 7ff858000700 1 -- 172.21.15.80:0/499487915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff85006b340 msgr2=0x7ff8500b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:01.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.528+0000 7ff858000700 1 --2- 172.21.15.80:0/499487915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff85006b340 0x7ff8500b5cb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009840 tx=0x7ff83c009b50 comp rx=0 tx=0).stop 2024-05-10T04:24:01.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.528+0000 7ff858000700 1 -- 172.21.15.80:0/499487915 shutdown_connections 2024-05-10T04:24:01.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.528+0000 7ff858000700 1 --2- 172.21.15.80:0/499487915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff85006b340 0x7ff8500b5cb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:01.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.528+0000 7ff858000700 1 -- 172.21.15.80:0/499487915 >> 172.21.15.80:0/499487915 conn(0x7ff8500d0a90 msgr2=0x7ff8500d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:01.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.528+0000 7ff858000700 1 -- 172.21.15.80:0/499487915 shutdown_connections 2024-05-10T04:24:01.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.528+0000 7ff858000700 1 -- 172.21.15.80:0/499487915 wait complete. 2024-05-10T04:24:01.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.530+0000 7ff858000700 1 Processor -- start 2024-05-10T04:24:01.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.531+0000 7ff858000700 1 -- start start 2024-05-10T04:24:01.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.532+0000 7ff858000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8500b6270 0x7ff8501f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:01.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.532+0000 7ff858000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8500cb0e0 0x7ff8500c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:01.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.532+0000 7ff858000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff85015eaa0 0x7ff85014cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:01.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.532+0000 7ff858000700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500c7b40 con 0x7ff8500cb0e0 2024-05-10T04:24:01.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.532+0000 7ff858000700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500c9820 con 0x7ff85015eaa0 2024-05-10T04:24:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.532+0000 7ff858000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8501f4b80 con 0x7ff8500b6270 2024-05-10T04:24:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.532+0000 7ff854c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8500cb0e0 0x7ff8500c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.532+0000 7ff854c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8500cb0e0 0x7ff8500c8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59912/0 (socket says 172.21.15.80:59912) 2024-05-10T04:24:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.532+0000 7ff854c00700 1 -- 172.21.15.80:0/3509937104 learned_addr learned my addr 172.21.15.80:0/3509937104 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:24:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.532+0000 7ff855600700 1 --2- 172.21.15.80:0/3509937104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8500b6270 0x7ff8501f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.532+0000 7ff856000700 1 --2- 172.21.15.80:0/3509937104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff85015eaa0 0x7ff85014cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.533+0000 7ff854c00700 1 -- 172.21.15.80:0/3509937104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8500b6270 msgr2=0x7ff8501f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.533+0000 7ff854c00700 1 --2- 172.21.15.80:0/3509937104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8500b6270 0x7ff8501f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.533+0000 7ff854c00700 1 -- 172.21.15.80:0/3509937104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff85015eaa0 msgr2=0x7ff85014cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.533+0000 7ff854c00700 1 --2- 172.21.15.80:0/3509937104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff85015eaa0 0x7ff85014cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.533+0000 7ff854c00700 1 -- 172.21.15.80:0/3509937104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c0094a0 con 0x7ff8500cb0e0 2024-05-10T04:24:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.533+0000 7ff854c00700 1 --2- 172.21.15.80:0/3509937104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8500cb0e0 0x7ff8500c8f20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00a010 tx=0x7ff83c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:01.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.533+0000 7ff84d600700 1 -- 172.21.15.80:0/3509937104 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c003db0 con 0x7ff8500cb0e0 2024-05-10T04:24:01.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.533+0000 7ff84d600700 1 -- 172.21.15.80:0/3509937104 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c01f070 con 0x7ff8500cb0e0 2024-05-10T04:24:01.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.533+0000 7ff858000700 1 -- 172.21.15.80:0/3509937104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8500c7de0 con 0x7ff8500cb0e0 2024-05-10T04:24:01.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.533+0000 7ff84d600700 1 -- 172.21.15.80:0/3509937104 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c011870 con 0x7ff8500cb0e0 2024-05-10T04:24:01.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.533+0000 7ff858000700 1 -- 172.21.15.80:0/3509937104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8501f50b0 con 0x7ff8500cb0e0 2024-05-10T04:24:01.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.535+0000 7ff858000700 1 -- 172.21.15.80:0/3509937104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8500c7f70 con 0x7ff8500cb0e0 2024-05-10T04:24:01.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.535+0000 7ff84d600700 1 -- 172.21.15.80:0/3509937104 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff83c021030 con 0x7ff8500cb0e0 2024-05-10T04:24:01.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.536+0000 7ff84d600700 1 --2- 172.21.15.80:0/3509937104 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff83006acc0 0x7ff83006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:01.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.536+0000 7ff84d600700 1 -- 172.21.15.80:0/3509937104 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff83c08a9a0 con 0x7ff8500cb0e0 2024-05-10T04:24:01.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.537+0000 7ff855600700 1 --2- 172.21.15.80:0/3509937104 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff83006acc0 0x7ff83006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:01.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.537+0000 7ff855600700 1 --2- 172.21.15.80:0/3509937104 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff83006acc0 0x7ff83006d1d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff844000fd0 tx=0x7ff8440014d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:01.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.541+0000 7ff84d600700 1 -- 172.21.15.80:0/3509937104 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff83c055c00 con 0x7ff8500cb0e0 2024-05-10T04:24:01.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.789+0000 7ff858000700 1 -- 172.21.15.80:0/3509937104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff850074af0 con 0x7ff8500cb0e0 2024-05-10T04:24:01.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.790+0000 7ff84d600700 1 -- 172.21.15.80:0/3509937104 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4734 (secure 0 0 0) 0x7ff83c059220 con 0x7ff8500cb0e0 2024-05-10T04:24:01.791 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:24:01.791 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6834/607016626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":607016626},{"type":"v1","addr":"172.21.15.80:6834","nonce":607016626}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4981,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1819064685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1819064685},{"type":"v1","addr":"172.21.15.106:6836","nonce":1819064685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4984,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3006235418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3006235418},{"type":"v1","addr":"172.21.15.106:6837","nonce":3006235418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:23:54.993823+0000","modified":"2024-05-10T04:23:58.429131+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6835/707679728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":707679728},{"type":"v1","addr":"172.21.15.80:6835","nonce":707679728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-10T04:24:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.792+0000 7ff858000700 1 -- 172.21.15.80:0/3509937104 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff83006acc0 msgr2=0x7ff83006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.792+0000 7ff858000700 1 --2- 172.21.15.80:0/3509937104 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff83006acc0 0x7ff83006d1d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff844000fd0 tx=0x7ff8440014d0 comp rx=0 tx=0).stop 2024-05-10T04:24:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.792+0000 7ff858000700 1 -- 172.21.15.80:0/3509937104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8500cb0e0 msgr2=0x7ff8500c8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.792+0000 7ff858000700 1 --2- 172.21.15.80:0/3509937104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8500cb0e0 0x7ff8500c8f20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00a010 tx=0x7ff83c004750 comp rx=0 tx=0).stop 2024-05-10T04:24:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.793+0000 7ff858000700 1 -- 172.21.15.80:0/3509937104 shutdown_connections 2024-05-10T04:24:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.793+0000 7ff858000700 1 --2- 172.21.15.80:0/3509937104 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff83006acc0 0x7ff83006d1d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.793+0000 7ff858000700 1 --2- 172.21.15.80:0/3509937104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff85015eaa0 0x7ff85014cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.793+0000 7ff858000700 1 --2- 172.21.15.80:0/3509937104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8500b6270 0x7ff8501f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.793+0000 7ff858000700 1 --2- 172.21.15.80:0/3509937104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8500cb0e0 0x7ff8500c8f20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.793+0000 7ff858000700 1 -- 172.21.15.80:0/3509937104 >> 172.21.15.80:0/3509937104 conn(0x7ff8500d0a90 msgr2=0x7ff850161f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.793+0000 7ff858000700 1 -- 172.21.15.80:0/3509937104 shutdown_connections 2024-05-10T04:24:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:01.793+0000 7ff858000700 1 -- 172.21.15.80:0/3509937104 wait complete. 2024-05-10T04:24:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 16 2024-05-10T04:24:02.225 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T04:23:54.993823+0000', 'modified': '2024-05-10T04:23:58.429131+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5067}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5067': {'gid': 5067, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.80:6835/707679728', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6833', 'nonce': 707679728}, {'type': 'v1', 'addr': '172.21.15.80:6835', 'nonce': 707679728}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-10T04:24:02.226 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T04:24:02.226 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-10T04:24:02.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.491+0000 7f18b3800700 1 Processor -- start 2024-05-10T04:24:02.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.491+0000 7f18b3800700 1 -- start start 2024-05-10T04:24:02.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.493+0000 7f18b3800700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f18ac162150 0x7f18ac15e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.493+0000 7f18b3800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ac0d2c00 con 0x7f18ac0cf4d0 2024-05-10T04:24:02.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.493+0000 7f18b3800700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ac162630 con 0x7f18ac06c160 2024-05-10T04:24:02.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.493+0000 7f18b3800700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ac162910 con 0x7f18ac162150 2024-05-10T04:24:02.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.493+0000 7f18abe00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f18ac0cf4d0 0x7f18ac0b73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49214/0 (socket says 172.21.15.80:49214) 2024-05-10T04:24:02.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.493+0000 7f18abe00700 1 -- 172.21.15.80:0/4242123384 learned_addr learned my addr 172.21.15.80:0/4242123384 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:24:02.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.494+0000 7f18b0e00700 1 --2- 172.21.15.80:0/4242123384 >> v2:172.21.15.106:3300/0 conn(0x7f18ac162150 0x7f18ac15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.494+0000 7f18ab400700 1 -- 172.21.15.80:0/4242123384 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012231501 0 0) 0x7f18ac0d2c00 con 0x7f18ac0cf4d0 2024-05-10T04:24:02.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.494+0000 7f18ab400700 1 -- 172.21.15.80:0/4242123384 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18940035b0 con 0x7f18ac0cf4d0 2024-05-10T04:24:02.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.494+0000 7f18b0e00700 1 -- 172.21.15.80:0/4242123384 >> v1:172.21.15.106:6789/0 conn(0x7f18ac06c160 legacy=0x7f18ac06c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:02.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.494+0000 7f18b0e00700 1 -- 172.21.15.80:0/4242123384 >> v1:172.21.15.80:6789/0 conn(0x7f18ac0cf4d0 legacy=0x7f18ac0b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:02.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.494+0000 7f18b0e00700 1 -- 172.21.15.80:0/4242123384 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac162bf0 con 0x7f18ac162150 2024-05-10T04:24:02.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.494+0000 7f18b0e00700 1 --2- 172.21.15.80:0/4242123384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ac162150 0x7f18ac15e610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009870 tx=0x7f18a0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2296a2e515192f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:02.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.495+0000 7f18ab400700 1 -- 172.21.15.80:0/4242123384 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0011830 con 0x7f18ac162150 2024-05-10T04:24:02.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.495+0000 7f18ab400700 1 -- 172.21.15.80:0/4242123384 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a0011990 con 0x7f18ac162150 2024-05-10T04:24:02.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.495+0000 7f18ab400700 1 -- 172.21.15.80:0/4242123384 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0011d20 con 0x7f18ac162150 2024-05-10T04:24:02.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.495+0000 7f18b3800700 1 -- 172.21.15.80:0/4242123384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ac162150 msgr2=0x7f18ac15e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:02.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.495+0000 7f18b3800700 1 --2- 172.21.15.80:0/4242123384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ac162150 0x7f18ac15e610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009870 tx=0x7f18a0009b80 comp rx=0 tx=0).stop 2024-05-10T04:24:02.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.495+0000 7f18b3800700 1 -- 172.21.15.80:0/4242123384 shutdown_connections 2024-05-10T04:24:02.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.495+0000 7f18b3800700 1 --2- 172.21.15.80:0/4242123384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ac162150 0x7f18ac15e610 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.495+0000 7f18b3800700 1 -- 172.21.15.80:0/4242123384 >> 172.21.15.80:0/4242123384 conn(0x7f18ac0d3e10 msgr2=0x7f18ac0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:02.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.496+0000 7f18b3800700 1 -- 172.21.15.80:0/4242123384 shutdown_connections 2024-05-10T04:24:02.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.496+0000 7f18b3800700 1 -- 172.21.15.80:0/4242123384 wait complete. 2024-05-10T04:24:02.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.498+0000 7f18b3800700 1 Processor -- start 2024-05-10T04:24:02.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.498+0000 7f18b3800700 1 -- start start 2024-05-10T04:24:02.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.499+0000 7f18b3800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18ac06c160 0x7f18ac14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.499+0000 7f18b3800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18ac0cf4d0 0x7f18ac15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.499+0000 7f18b3800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ac162150 0x7f18ac160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.499+0000 7f18b3800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac160500 con 0x7f18ac0cf4d0 2024-05-10T04:24:02.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.499+0000 7f18b3800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac154cb0 con 0x7f18ac162150 2024-05-10T04:24:02.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.499+0000 7f18b3800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac15f630 con 0x7f18ac06c160 2024-05-10T04:24:02.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.500+0000 7f18abe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18ac0cf4d0 0x7f18ac15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.500+0000 7f18abe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18ac0cf4d0 0x7f18ac15ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59918/0 (socket says 172.21.15.80:59918) 2024-05-10T04:24:02.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.500+0000 7f18abe00700 1 -- 172.21.15.80:0/2344168878 learned_addr learned my addr 172.21.15.80:0/2344168878 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:24:02.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.500+0000 7f18b0e00700 1 --2- 172.21.15.80:0/2344168878 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18ac06c160 0x7f18ac14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.500+0000 7f18b1800700 1 --2- 172.21.15.80:0/2344168878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ac162150 0x7f18ac160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.500+0000 7f18abe00700 1 -- 172.21.15.80:0/2344168878 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18ac06c160 msgr2=0x7f18ac14f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:02.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.500+0000 7f18abe00700 1 --2- 172.21.15.80:0/2344168878 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18ac06c160 0x7f18ac14f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.500+0000 7f18abe00700 1 -- 172.21.15.80:0/2344168878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ac162150 msgr2=0x7f18ac160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:02.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.500+0000 7f18abe00700 1 --2- 172.21.15.80:0/2344168878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ac162150 0x7f18ac160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.500+0000 7f18abe00700 1 -- 172.21.15.80:0/2344168878 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00094a0 con 0x7f18ac0cf4d0 2024-05-10T04:24:02.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.500+0000 7f18b0e00700 1 --2- 172.21.15.80:0/2344168878 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18ac06c160 0x7f18ac14f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:24:02.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.500+0000 7f18abe00700 1 --2- 172.21.15.80:0/2344168878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18ac0cf4d0 0x7f18ac15ebe0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1898005910 tx=0x7f189800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:02.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.501+0000 7f18a8c00700 1 -- 172.21.15.80:0/2344168878 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898005d70 con 0x7f18ac0cf4d0 2024-05-10T04:24:02.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.501+0000 7f18a8c00700 1 -- 172.21.15.80:0/2344168878 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18980070d0 con 0x7f18ac0cf4d0 2024-05-10T04:24:02.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.501+0000 7f18b3800700 1 -- 172.21.15.80:0/2344168878 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ac15f880 con 0x7f18ac0cf4d0 2024-05-10T04:24:02.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.501+0000 7f18a8c00700 1 -- 172.21.15.80:0/2344168878 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898007440 con 0x7f18ac0cf4d0 2024-05-10T04:24:02.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.501+0000 7f18b3800700 1 -- 172.21.15.80:0/2344168878 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ac15fe40 con 0x7f18ac0cf4d0 2024-05-10T04:24:02.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.504+0000 7f18a8c00700 1 -- 172.21.15.80:0/2344168878 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f18980075a0 con 0x7f18ac0cf4d0 2024-05-10T04:24:02.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.505+0000 7f18a8c00700 1 --2- 172.21.15.80:0/2344168878 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f188c06ac90 0x7f188c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.505+0000 7f18a8c00700 1 -- 172.21.15.80:0/2344168878 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1898088760 con 0x7f18ac0cf4d0 2024-05-10T04:24:02.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.505+0000 7f18b0e00700 1 --2- 172.21.15.80:0/2344168878 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f188c06ac90 0x7f188c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.506+0000 7f18b0e00700 1 --2- 172.21.15.80:0/2344168878 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f188c06ac90 0x7f188c06d1a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009870 tx=0x7f18a0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:02.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.507+0000 7f18cb642b80 1 Processor -- start 2024-05-10T04:24:02.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.507+0000 7f18cb642b80 1 -- start start 2024-05-10T04:24:02.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.508+0000 7f18cb642b80 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9f5410 0x564d0a9d9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.508+0000 7f18cb642b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9d96c0 0x564d0a9aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.508+0000 7f18cb642b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 0x564d0a9aef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.508+0000 7f18cb642b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d0a8d5100 con 0x564d0a9d96c0 2024-05-10T04:24:02.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.508+0000 7f18cb642b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d0a8d2ac0 con 0x564d0a9d9ad0 2024-05-10T04:24:02.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.508+0000 7f18cb642b80 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d0a8ce3b0 con 0x564d0a9f5410 2024-05-10T04:24:02.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.509+0000 7f18abe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9d96c0 0x564d0a9aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.509+0000 7f18abe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9d96c0 0x564d0a9aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59934/0 (socket says 172.21.15.80:59934) 2024-05-10T04:24:02.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.509+0000 7f18abe00700 1 -- 172.21.15.80:0/2100043311 learned_addr learned my addr 172.21.15.80:0/2100043311 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:24:02.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.509+0000 7f18b0e00700 1 --2- 172.21.15.80:0/2100043311 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9f5410 0x564d0a9d9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.509+0000 7f18b1800700 1 --2- 172.21.15.80:0/2100043311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 0x564d0a9aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.509+0000 7f18abe00700 1 -- 172.21.15.80:0/2100043311 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9f5410 msgr2=0x564d0a9d9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:24:02.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.509+0000 7f18abe00700 1 --2- 172.21.15.80:0/2100043311 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9f5410 0x564d0a9d9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.509+0000 7f18abe00700 1 -- 172.21.15.80:0/2100043311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 msgr2=0x564d0a9aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:24:02.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.509+0000 7f18abe00700 1 --2- 172.21.15.80:0/2100043311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 0x564d0a9aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.509+0000 7f18abe00700 1 -- 172.21.15.80:0/2100043311 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d0a74f360 con 0x564d0a9d96c0 2024-05-10T04:24:02.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.509+0000 7f18abe00700 1 --2- 172.21.15.80:0/2100043311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9d96c0 0x564d0a9aea20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f189805f420 tx=0x7f1898057250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0f91904000d7e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:02.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.509+0000 7f189d600700 1 -- 172.21.15.80:0/2100043311 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189805b170 con 0x564d0a9d96c0 2024-05-10T04:24:02.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.509+0000 7f189d600700 1 -- 172.21.15.80:0/2100043311 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189805b390 con 0x564d0a9d96c0 2024-05-10T04:24:02.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.509+0000 7f189d600700 1 -- 172.21.15.80:0/2100043311 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189805f950 con 0x564d0a9d96c0 2024-05-10T04:24:02.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.510+0000 7f18cb642b80 1 -- 172.21.15.80:0/2100043311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9d96c0 msgr2=0x564d0a9aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:02.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.510+0000 7f18cb642b80 1 --2- 172.21.15.80:0/2100043311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9d96c0 0x564d0a9aea20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f189805f420 tx=0x7f1898057250 comp rx=0 tx=0).stop 2024-05-10T04:24:02.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.510+0000 7f18cb642b80 1 -- 172.21.15.80:0/2100043311 shutdown_connections 2024-05-10T04:24:02.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.510+0000 7f18cb642b80 1 --2- 172.21.15.80:0/2100043311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 0x564d0a9aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.510+0000 7f18cb642b80 1 --2- 172.21.15.80:0/2100043311 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9f5410 0x564d0a9d9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.510+0000 7f18cb642b80 1 --2- 172.21.15.80:0/2100043311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9d96c0 0x564d0a9aea20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.510+0000 7f18cb642b80 1 -- 172.21.15.80:0/2100043311 >> 172.21.15.80:0/2100043311 conn(0x564d0a910a10 msgr2=0x564d0a9f3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.510+0000 7f18cb642b80 1 -- 172.21.15.80:0/2100043311 shutdown_connections 2024-05-10T04:24:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.510+0000 7f18cb642b80 1 -- 172.21.15.80:0/2100043311 wait complete. 2024-05-10T04:24:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.511+0000 7f18cb642b80 1 -- start start 2024-05-10T04:24:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.512+0000 7f18cb642b80 1 Processor -- start 2024-05-10T04:24:02.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.513+0000 7f18cb642b80 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9d96c0 0x564d0a9f27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.513+0000 7f18cb642b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 0x564d0a9f3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.513+0000 7f18cb642b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0a9eec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.513+0000 7f18cb642b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d0a86a510 con 0x564d0a9f5410 2024-05-10T04:24:02.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.513+0000 7f18cb642b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d0a86a1b0 con 0x564d0a9d9ad0 2024-05-10T04:24:02.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.513+0000 7f18cb642b80 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d0a751650 con 0x564d0a9d96c0 2024-05-10T04:24:02.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.513+0000 7f18cb642b80 10 client.0 _ll_register_callbacks cb 0x564d0a873ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T04:24:02.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.513+0000 7f18b1800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0a9eec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.513+0000 7f18b1800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0a9eec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59940/0 (socket says 172.21.15.80:59940) 2024-05-10T04:24:02.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.513+0000 7f18b1800700 1 -- 172.21.15.80:0/109030965 learned_addr learned my addr 172.21.15.80:0/109030965 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:24:02.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.514+0000 7f18abe00700 1 --2- 172.21.15.80:0/109030965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 0x564d0a9f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.514+0000 7f18b0e00700 1 --2- 172.21.15.80:0/109030965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9d96c0 0x564d0a9f27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.514+0000 7f18b1800700 1 -- 172.21.15.80:0/109030965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9d96c0 msgr2=0x564d0a9f27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:24:02.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.514+0000 7f18b1800700 1 --2- 172.21.15.80:0/109030965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9d96c0 0x564d0a9f27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.514+0000 7f18b1800700 1 -- 172.21.15.80:0/109030965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 msgr2=0x564d0a9f3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:24:02.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.514+0000 7f18b1800700 1 --2- 172.21.15.80:0/109030965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 0x564d0a9f3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.514+0000 7f18b1800700 1 -- 172.21.15.80:0/109030965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ac15fe40 con 0x564d0a9f5410 2024-05-10T04:24:02.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.514+0000 7f18b0e00700 1 --2- 172.21.15.80:0/109030965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9d96c0 0x564d0a9f27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:24:02.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.514+0000 7f18b1800700 1 --2- 172.21.15.80:0/109030965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0a9eec30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f18a40021e0 tx=0x7f18a4005330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc9e9573ac64c7c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:02.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.514+0000 7f1892000700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-05-10T04:24:02.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.514+0000 7f1892000700 1 -- 172.21.15.80:0/109030965 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4013570 con 0x564d0a9f5410 2024-05-10T04:24:02.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.514+0000 7f1892000700 1 -- 172.21.15.80:0/109030965 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18a40136d0 con 0x564d0a9f5410 2024-05-10T04:24:02.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.514+0000 7f18cb642b80 1 -- 172.21.15.80:0/109030965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d0a827220 con 0x564d0a9f5410 2024-05-10T04:24:02.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.514+0000 7f1892000700 1 -- 172.21.15.80:0/109030965 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18a4003de0 con 0x564d0a9f5410 2024-05-10T04:24:02.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.515+0000 7f18cb642b80 10 client.5250 fetch_fsmap learned FSMap version 16 2024-05-10T04:24:02.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.515+0000 7f18cb642b80 1 -- 172.21.15.80:0/109030965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564d0a6fbb10 con 0x564d0a9f5410 2024-05-10T04:24:02.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.515+0000 7f1892000700 1 -- 172.21.15.80:0/109030965 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d0a827220 con 0x564d0a9f5410 2024-05-10T04:24:02.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.515+0000 7f1892000700 1 -- 172.21.15.80:0/109030965 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f18a40138d0 con 0x564d0a9f5410 2024-05-10T04:24:02.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.515+0000 7f18cb642b80 10 client.5250 fetch_fsmap finished waiting for FSMap version 16 2024-05-10T04:24:02.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.515+0000 7f18cb642b80 10 client.5250 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T04:24:02.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.515+0000 7f18cb642b80 20 client.5250 populate_metadata read hostname 'smithi080' 2024-05-10T04:24:02.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.515+0000 7f18cb642b80 1 --2- 172.21.15.80:0/109030965 >> [v2:172.21.15.80:6833/707679728,v1:172.21.15.80:6835/707679728] conn(0x564d0a9f7a70 0x564d0a9ebfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.515+0000 7f18cb642b80 4 client.5250 mds_command: new command op to 5067 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T04:24:02.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.515+0000 7f18cb642b80 1 -- 172.21.15.80:0/109030965 --> [v2:172.21.15.80:6833/707679728,v1:172.21.15.80:6835/707679728] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d0a97d700 con 0x564d0a9f7a70 2024-05-10T04:24:02.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.515+0000 7f18b0e00700 1 --2- 172.21.15.80:0/109030965 >> [v2:172.21.15.80:6833/707679728,v1:172.21.15.80:6835/707679728] conn(0x564d0a9f7a70 0x564d0a9ebfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.516+0000 7f18b0e00700 1 --2- 172.21.15.80:0/109030965 >> [v2:172.21.15.80:6833/707679728,v1:172.21.15.80:6835/707679728] conn(0x564d0a9f7a70 0x564d0a9ebfd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b26cd8774647fa4 server_cookie=b54e2d52e9cd5a28 in_seq=0 out_seq=0 2024-05-10T04:24:02.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.516+0000 7f1892000700 10 client.5250 ms_handle_connect on v2:172.21.15.80:6833/707679728 2024-05-10T04:24:02.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.516+0000 7f1892000700 1 -- 172.21.15.80:0/109030965 <== mds.0 v2:172.21.15.80:6833/707679728 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564d0a97d700 con 0x564d0a9f7a70 2024-05-10T04:24:02.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.517+0000 7f1892000700 10 client.5250 handle_command_reply: tid=0 2024-05-10T04:24:02.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.517+0000 7f18cb642b80 1 client.5250 shutdown 2024-05-10T04:24:02.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.517+0000 7f18cb642b80 1 -- 172.21.15.80:0/109030965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 msgr2=0x564d0a9eec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:02.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.517+0000 7f18cb642b80 1 --2- 172.21.15.80:0/109030965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0a9eec30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f18a40021e0 tx=0x7f18a4005330 comp rx=0 tx=0).stop 2024-05-10T04:24:02.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.517+0000 7f18cb642b80 1 -- 172.21.15.80:0/109030965 shutdown_connections 2024-05-10T04:24:02.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.517+0000 7f18cb642b80 1 --2- 172.21.15.80:0/109030965 >> [v2:172.21.15.80:6833/707679728,v1:172.21.15.80:6835/707679728] conn(0x564d0a9f7a70 0x564d0a9ebfd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.517+0000 7f18cb642b80 1 --2- 172.21.15.80:0/109030965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0a9eec30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.517+0000 7f18cb642b80 1 --2- 172.21.15.80:0/109030965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9d96c0 0x564d0a9f27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.517+0000 7f1892000700 0 client.5250 ms_handle_reset on v2:172.21.15.80:6833/707679728 2024-05-10T04:24:02.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.517+0000 7f18cb642b80 1 --2- 172.21.15.80:0/109030965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 0x564d0a9f3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.517+0000 7f18cb642b80 1 -- 172.21.15.80:0/109030965 >> 172.21.15.80:0/109030965 conn(0x564d0a910a10 msgr2=0x564d0a9a8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:02.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.517+0000 7f18cb642b80 1 -- 172.21.15.80:0/109030965 shutdown_connections 2024-05-10T04:24:02.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.517+0000 7f18cb642b80 1 -- 172.21.15.80:0/109030965 wait complete. 2024-05-10T04:24:02.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.517+0000 7f18cb642b80 20 client.5250 trim_cache size 0 max 16384 2024-05-10T04:24:02.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.536+0000 7f18cb642b80 1 Processor -- start 2024-05-10T04:24:02.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.536+0000 7f18cb642b80 1 -- start start 2024-05-10T04:24:02.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.537+0000 7f18cb642b80 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9d96c0 0x564d0a9aa480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.537+0000 7f18cb642b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 0x564d0a9ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.538+0000 7f18cb642b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0a9aed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.538+0000 7f18cb642b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d0a9ee510 con 0x564d0a9f5410 2024-05-10T04:24:02.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.538+0000 7f18cb642b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d0a9d0a40 con 0x564d0a9d9ad0 2024-05-10T04:24:02.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.538+0000 7f18cb642b80 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d0a9d93c0 con 0x564d0a9d96c0 2024-05-10T04:24:02.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.538+0000 7f18b1800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0a9aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.538+0000 7f18b1800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0a9aed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59956/0 (socket says 172.21.15.80:59956) 2024-05-10T04:24:02.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.538+0000 7f18b1800700 1 -- 172.21.15.80:0/3564895412 learned_addr learned my addr 172.21.15.80:0/3564895412 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:24:02.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.538+0000 7f18b1800700 1 -- 172.21.15.80:0/3564895412 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9d96c0 msgr2=0x564d0a9aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:24:02.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.538+0000 7f18b1800700 1 --2- 172.21.15.80:0/3564895412 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9d96c0 0x564d0a9aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.538+0000 7f18b1800700 1 -- 172.21.15.80:0/3564895412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 msgr2=0x564d0a9ae7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:24:02.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.538+0000 7f18b1800700 1 --2- 172.21.15.80:0/3564895412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 0x564d0a9ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.538+0000 7f18b1800700 1 -- 172.21.15.80:0/3564895412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d0a894510 con 0x564d0a9f5410 2024-05-10T04:24:02.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.538+0000 7f18b1800700 1 --2- 172.21.15.80:0/3564895412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0a9aed20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f18a4013ea0 tx=0x7f18a400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b22519387aabeae server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:02.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.539+0000 7f189e000700 1 -- 172.21.15.80:0/3564895412 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4003d40 con 0x564d0a9f5410 2024-05-10T04:24:02.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.539+0000 7f189e000700 1 -- 172.21.15.80:0/3564895412 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a4014400 con 0x564d0a9f5410 2024-05-10T04:24:02.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.539+0000 7f189e000700 1 -- 172.21.15.80:0/3564895412 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4014790 con 0x564d0a9f5410 2024-05-10T04:24:02.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.539+0000 7f18cb642b80 1 -- 172.21.15.80:0/3564895412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 msgr2=0x564d0a9aed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:02.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.539+0000 7f18cb642b80 1 --2- 172.21.15.80:0/3564895412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0a9aed20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f18a4013ea0 tx=0x7f18a400e000 comp rx=0 tx=0).stop 2024-05-10T04:24:02.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.539+0000 7f18cb642b80 1 -- 172.21.15.80:0/3564895412 shutdown_connections 2024-05-10T04:24:02.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.539+0000 7f18cb642b80 1 --2- 172.21.15.80:0/3564895412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0a9aed20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.539+0000 7f18cb642b80 1 --2- 172.21.15.80:0/3564895412 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9d96c0 0x564d0a9aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.539+0000 7f18cb642b80 1 --2- 172.21.15.80:0/3564895412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 0x564d0a9ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.539+0000 7f18cb642b80 1 -- 172.21.15.80:0/3564895412 >> 172.21.15.80:0/3564895412 conn(0x564d0a910a10 msgr2=0x564d0a9a5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:02.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.540+0000 7f18cb642b80 1 -- 172.21.15.80:0/3564895412 shutdown_connections 2024-05-10T04:24:02.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.540+0000 7f18cb642b80 1 -- 172.21.15.80:0/3564895412 wait complete. 2024-05-10T04:24:02.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.540+0000 7f18cb642b80 1 -- start start 2024-05-10T04:24:02.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.541+0000 7f18cb642b80 1 Processor -- start 2024-05-10T04:24:02.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.542+0000 7f18cb642b80 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9d96c0 0x564d0a9e9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.542+0000 7f18cb642b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 0x564d0aa5c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.542+0000 7f18cb642b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0aa5d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.542+0000 7f18cb642b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d0aa5d040 con 0x564d0a9f5410 2024-05-10T04:24:02.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.542+0000 7f18cb642b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d0a9dcdc0 con 0x564d0a9d9ad0 2024-05-10T04:24:02.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.542+0000 7f18cb642b80 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d0a9ea740 con 0x564d0a9d96c0 2024-05-10T04:24:02.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.542+0000 7f18cb642b80 10 client.0 _ll_register_callbacks cb 0x7f18a4001e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T04:24:02.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.542+0000 7f18b1800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0aa5d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.543+0000 7f18b1800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0aa5d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59966/0 (socket says 172.21.15.80:59966) 2024-05-10T04:24:02.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.543+0000 7f18b1800700 1 -- 172.21.15.80:0/2762030264 learned_addr learned my addr 172.21.15.80:0/2762030264 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:24:02.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.543+0000 7f18abe00700 1 --2- 172.21.15.80:0/2762030264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 0x564d0aa5c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.543+0000 7f18b0e00700 1 --2- 172.21.15.80:0/2762030264 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9d96c0 0x564d0a9e9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.543+0000 7f18b1800700 1 -- 172.21.15.80:0/2762030264 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9d96c0 msgr2=0x564d0a9e9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:24:02.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.543+0000 7f18b1800700 1 --2- 172.21.15.80:0/2762030264 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9d96c0 0x564d0a9e9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.543+0000 7f18b1800700 1 -- 172.21.15.80:0/2762030264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 msgr2=0x564d0aa5c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:24:02.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.543+0000 7f18b1800700 1 --2- 172.21.15.80:0/2762030264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 0x564d0aa5c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.543+0000 7f18b1800700 1 -- 172.21.15.80:0/2762030264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d0a6fbb10 con 0x564d0a9f5410 2024-05-10T04:24:02.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.543+0000 7f18b1800700 1 --2- 172.21.15.80:0/2762030264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0aa5d460 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f18a4013fd0 tx=0x7f18a4001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d35022f11725670 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:02.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.543+0000 7f1892000700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-05-10T04:24:02.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.543+0000 7f1892000700 1 -- 172.21.15.80:0/2762030264 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4001ec0 con 0x564d0a9f5410 2024-05-10T04:24:02.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.543+0000 7f1892000700 1 -- 172.21.15.80:0/2762030264 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18a4014570 con 0x564d0a9f5410 2024-05-10T04:24:02.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.544+0000 7f18cb642b80 1 -- 172.21.15.80:0/2762030264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f189805b390 con 0x564d0a9f5410 2024-05-10T04:24:02.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.544+0000 7f1892000700 1 -- 172.21.15.80:0/2762030264 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18a4002020 con 0x564d0a9f5410 2024-05-10T04:24:02.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.544+0000 7f18cb642b80 10 client.5256 fetch_fsmap learned FSMap version 16 2024-05-10T04:24:02.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.544+0000 7f18cb642b80 1 -- 172.21.15.80:0/2762030264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564d0a753c80 con 0x564d0a9f5410 2024-05-10T04:24:02.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.544+0000 7f1892000700 1 -- 172.21.15.80:0/2762030264 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189805b390 con 0x564d0a9f5410 2024-05-10T04:24:02.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.544+0000 7f1892000700 1 -- 172.21.15.80:0/2762030264 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f18a4014730 con 0x564d0a9f5410 2024-05-10T04:24:02.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.544+0000 7f18cb642b80 10 client.5256 fetch_fsmap finished waiting for FSMap version 16 2024-05-10T04:24:02.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.544+0000 7f18cb642b80 10 client.5256 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T04:24:02.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.544+0000 7f18cb642b80 20 client.5256 populate_metadata read hostname 'smithi080' 2024-05-10T04:24:02.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.544+0000 7f18cb642b80 1 --2- 172.21.15.80:0/2762030264 >> [v2:172.21.15.80:6833/707679728,v1:172.21.15.80:6835/707679728] conn(0x564d0a9dc5a0 0x564d0a9ed540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.544+0000 7f18cb642b80 4 client.5256 mds_command: new command op to 5067 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T04:24:02.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.544+0000 7f18cb642b80 1 -- 172.21.15.80:0/2762030264 --> [v2:172.21.15.80:6833/707679728,v1:172.21.15.80:6835/707679728] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564d0a8c6e70 con 0x564d0a9dc5a0 2024-05-10T04:24:02.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.544+0000 7f18b0e00700 1 --2- 172.21.15.80:0/2762030264 >> [v2:172.21.15.80:6833/707679728,v1:172.21.15.80:6835/707679728] conn(0x564d0a9dc5a0 0x564d0a9ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.545+0000 7f1892000700 10 client.5256 ms_handle_connect on v2:172.21.15.80:6833/707679728 2024-05-10T04:24:02.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.545+0000 7f18b0e00700 1 --2- 172.21.15.80:0/2762030264 >> [v2:172.21.15.80:6833/707679728,v1:172.21.15.80:6835/707679728] conn(0x564d0a9dc5a0 0x564d0a9ed540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebfc2409bd570b71 server_cookie=47eaaf57e19207ce in_seq=0 out_seq=0 2024-05-10T04:24:02.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.545+0000 7f1892000700 1 -- 172.21.15.80:0/2762030264 <== mds.0 v2:172.21.15.80:6833/707679728 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x564d0a8c6e70 con 0x564d0a9dc5a0 2024-05-10T04:24:02.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.545+0000 7f1892000700 10 client.5256 handle_command_reply: tid=0 2024-05-10T04:24:02.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.545+0000 7f18cb642b80 1 client.5256 shutdown 2024-05-10T04:24:02.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.545+0000 7f18cb642b80 1 -- 172.21.15.80:0/2762030264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 msgr2=0x564d0aa5d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:02.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.545+0000 7f18cb642b80 1 --2- 172.21.15.80:0/2762030264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0aa5d460 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f18a4013fd0 tx=0x7f18a4001400 comp rx=0 tx=0).stop 2024-05-10T04:24:02.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.545+0000 7f18cb642b80 1 -- 172.21.15.80:0/2762030264 shutdown_connections 2024-05-10T04:24:02.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.545+0000 7f18cb642b80 1 --2- 172.21.15.80:0/2762030264 >> [v2:172.21.15.80:6833/707679728,v1:172.21.15.80:6835/707679728] conn(0x564d0a9dc5a0 0x564d0a9ed540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.545+0000 7f18cb642b80 1 --2- 172.21.15.80:0/2762030264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d0a9f5410 0x564d0aa5d460 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.545+0000 7f18cb642b80 1 --2- 172.21.15.80:0/2762030264 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564d0a9d96c0 0x564d0a9e9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.545+0000 7f1892000700 0 client.5256 ms_handle_reset on v2:172.21.15.80:6833/707679728 2024-05-10T04:24:02.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.545+0000 7f18cb642b80 1 --2- 172.21.15.80:0/2762030264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564d0a9d9ad0 0x564d0aa5c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.545+0000 7f18cb642b80 1 -- 172.21.15.80:0/2762030264 >> 172.21.15.80:0/2762030264 conn(0x564d0a910a10 msgr2=0x564d0a9a5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:02.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.546+0000 7f18cb642b80 1 -- 172.21.15.80:0/2762030264 shutdown_connections 2024-05-10T04:24:02.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.546+0000 7f18cb642b80 1 -- 172.21.15.80:0/2762030264 wait complete. 2024-05-10T04:24:02.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.546+0000 7f18cb642b80 20 client.5256 trim_cache size 0 max 16384 2024-05-10T04:24:02.553 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-10T04:24:02.553 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "7fdf09a1-1b63-4484-b77e-59e97b1b5367", 2024-05-10T04:24:02.554 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-05-10T04:24:02.554 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 5067, 2024-05-10T04:24:02.554 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-05-10T04:24:02.554 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-05-10T04:24:02.554 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-05-10T04:24:02.554 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 7.5494367029999996, 2024-05-10T04:24:02.554 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 16, 2024-05-10T04:24:02.554 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 34, 2024-05-10T04:24:02.554 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 34, 2024-05-10T04:24:02.554 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 16.999777497 2024-05-10T04:24:02.554 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-10T04:24:02.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.546+0000 7f18b3800700 1 -- 172.21.15.80:0/2344168878 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f188c06ac90 msgr2=0x7f188c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:02.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.546+0000 7f18b3800700 1 --2- 172.21.15.80:0/2344168878 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f188c06ac90 0x7f188c06d1a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009870 tx=0x7f18a0008030 comp rx=0 tx=0).stop 2024-05-10T04:24:02.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.546+0000 7f18b3800700 1 -- 172.21.15.80:0/2344168878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18ac0cf4d0 msgr2=0x7f18ac15ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:02.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.546+0000 7f18b3800700 1 --2- 172.21.15.80:0/2344168878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18ac0cf4d0 0x7f18ac15ebe0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1898005910 tx=0x7f189800c860 comp rx=0 tx=0).stop 2024-05-10T04:24:02.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.546+0000 7f18b3800700 1 -- 172.21.15.80:0/2344168878 shutdown_connections 2024-05-10T04:24:02.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.546+0000 7f18b3800700 1 --2- 172.21.15.80:0/2344168878 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f188c06ac90 0x7f188c06d1a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.546+0000 7f18b3800700 1 --2- 172.21.15.80:0/2344168878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ac162150 0x7f18ac160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.546+0000 7f18b3800700 1 --2- 172.21.15.80:0/2344168878 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18ac06c160 0x7f18ac14f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.546+0000 7f18b3800700 1 --2- 172.21.15.80:0/2344168878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18ac0cf4d0 0x7f18ac15ebe0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.546+0000 7f18b3800700 1 -- 172.21.15.80:0/2344168878 >> 172.21.15.80:0/2344168878 conn(0x7f18ac0d3e10 msgr2=0x7f18ac158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:02.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.547+0000 7f18b3800700 1 -- 172.21.15.80:0/2344168878 shutdown_connections 2024-05-10T04:24:02.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.547+0000 7f18b3800700 1 -- 172.21.15.80:0/2344168878 wait complete. 2024-05-10T04:24:02.575 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T04:24:02.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.836+0000 7f8f8be00700 1 Processor -- start 2024-05-10T04:24:02.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.836+0000 7f8f8be00700 1 -- start start 2024-05-10T04:24:02.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.838+0000 7f8f8be00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f840b2f50 0x7f8f84161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.838+0000 7f8f8be00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8f840d3030 0x7f8f840d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.838+0000 7f8f8be00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f840d28c0 con 0x7f8f840d0630 2024-05-10T04:24:02.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.838+0000 7f8f8be00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f840b3360 con 0x7f8f840d3030 2024-05-10T04:24:02.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.838+0000 7f8f8be00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f841624e0 con 0x7f8f840b2f50 2024-05-10T04:24:02.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.838+0000 7f8f89e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8f840d0630 0x7f8f840d0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48044/0 (socket says 172.21.15.80:48044) 2024-05-10T04:24:02.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.838+0000 7f8f89e00700 1 -- 172.21.15.80:0/1447318352 learned_addr learned my addr 172.21.15.80:0/1447318352 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:24:02.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.838+0000 7f8f88a00700 1 --2- 172.21.15.80:0/1447318352 >> v2:172.21.15.106:3300/0 conn(0x7f8f840d3030 0x7f8f840d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.838+0000 7f8f89400700 1 --2- 172.21.15.80:0/1447318352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f840b2f50 0x7f8f84161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.839+0000 7f8f83e00700 1 -- 172.21.15.80:0/1447318352 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135023894 0 0) 0x7f8f840d28c0 con 0x7f8f840d0630 2024-05-10T04:24:02.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.839+0000 7f8f83e00700 1 -- 172.21.15.80:0/1447318352 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f6c0035b0 con 0x7f8f840d0630 2024-05-10T04:24:02.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.839+0000 7f8f89400700 1 -- 172.21.15.80:0/1447318352 >> v2:172.21.15.106:3300/0 conn(0x7f8f840d3030 msgr2=0x7f8f840d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:24:02.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.839+0000 7f8f89400700 1 --2- 172.21.15.80:0/1447318352 >> v2:172.21.15.106:3300/0 conn(0x7f8f840d3030 0x7f8f840d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.839+0000 7f8f89400700 1 -- 172.21.15.80:0/1447318352 >> v1:172.21.15.80:6789/0 conn(0x7f8f840d0630 legacy=0x7f8f840d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:02.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.839+0000 7f8f89400700 1 -- 172.21.15.80:0/1447318352 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f840d2ba0 con 0x7f8f840b2f50 2024-05-10T04:24:02.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.839+0000 7f8f88a00700 1 --2- 172.21.15.80:0/1447318352 >> v2:172.21.15.106:3300/0 conn(0x7f8f840d3030 0x7f8f840d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:24:02.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.839+0000 7f8f89400700 1 --2- 172.21.15.80:0/1447318352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f840b2f50 0x7f8f84161fa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009840 tx=0x7f8f78009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c805787e1e40ac15 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:02.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.840+0000 7f8f83e00700 1 -- 172.21.15.80:0/1447318352 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78011830 con 0x7f8f840b2f50 2024-05-10T04:24:02.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.840+0000 7f8f83e00700 1 -- 172.21.15.80:0/1447318352 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f78011990 con 0x7f8f840b2f50 2024-05-10T04:24:02.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.840+0000 7f8f83e00700 1 -- 172.21.15.80:0/1447318352 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78011d00 con 0x7f8f840b2f50 2024-05-10T04:24:02.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.840+0000 7f8f8be00700 1 -- 172.21.15.80:0/1447318352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f840b2f50 msgr2=0x7f8f84161fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:02.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.840+0000 7f8f8be00700 1 --2- 172.21.15.80:0/1447318352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f840b2f50 0x7f8f84161fa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009840 tx=0x7f8f78009b50 comp rx=0 tx=0).stop 2024-05-10T04:24:02.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.840+0000 7f8f8be00700 1 -- 172.21.15.80:0/1447318352 shutdown_connections 2024-05-10T04:24:02.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.840+0000 7f8f8be00700 1 --2- 172.21.15.80:0/1447318352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f840b2f50 0x7f8f84161fa0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.840+0000 7f8f8be00700 1 --2- 172.21.15.80:0/1447318352 >> v2:172.21.15.106:3300/0 conn(0x7f8f840d3030 0x7f8f840d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.840+0000 7f8f8be00700 1 -- 172.21.15.80:0/1447318352 >> 172.21.15.80:0/1447318352 conn(0x7f8f8406c3f0 msgr2=0x7f8f8406c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:02.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.840+0000 7f8f8be00700 1 -- 172.21.15.80:0/1447318352 shutdown_connections 2024-05-10T04:24:02.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.841+0000 7f8f8be00700 1 -- 172.21.15.80:0/1447318352 wait complete. 2024-05-10T04:24:02.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.843+0000 7f8f8be00700 1 Processor -- start 2024-05-10T04:24:02.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.843+0000 7f8f8be00700 1 -- start start 2024-05-10T04:24:02.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.844+0000 7f8f8be00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f840b2f50 0x7f8f8414b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.844+0000 7f8f8be00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f840d0630 0x7f8f840ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.844+0000 7f8f8be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f840d3030 0x7f8f840b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.844+0000 7f8f8be00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f84149cd0 con 0x7f8f840d3030 2024-05-10T04:24:02.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.844+0000 7f8f8be00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8414be60 con 0x7f8f840d0630 2024-05-10T04:24:02.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.844+0000 7f8f8be00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f840cc170 con 0x7f8f840b2f50 2024-05-10T04:24:02.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.845+0000 7f8f89e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f840d3030 0x7f8f840b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.845+0000 7f8f89e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f840d3030 0x7f8f840b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49688/0 (socket says 172.21.15.80:49688) 2024-05-10T04:24:02.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.845+0000 7f8f89e00700 1 -- 172.21.15.80:0/2369254295 learned_addr learned my addr 172.21.15.80:0/2369254295 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:24:02.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.845+0000 7f8f89400700 1 --2- 172.21.15.80:0/2369254295 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f840b2f50 0x7f8f8414b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.845+0000 7f8f88a00700 1 --2- 172.21.15.80:0/2369254295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f840d0630 0x7f8f840ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.845+0000 7f8f89e00700 1 -- 172.21.15.80:0/2369254295 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f840b2f50 msgr2=0x7f8f8414b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:02.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.845+0000 7f8f89e00700 1 --2- 172.21.15.80:0/2369254295 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f840b2f50 0x7f8f8414b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.845+0000 7f8f89e00700 1 -- 172.21.15.80:0/2369254295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f840d0630 msgr2=0x7f8f840ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:02.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.845+0000 7f8f89e00700 1 --2- 172.21.15.80:0/2369254295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f840d0630 0x7f8f840ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:02.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.845+0000 7f8f89e00700 1 -- 172.21.15.80:0/2369254295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f700094a0 con 0x7f8f840d3030 2024-05-10T04:24:02.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.845+0000 7f8f89400700 1 --2- 172.21.15.80:0/2369254295 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f840b2f50 0x7f8f8414b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:24:02.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.845+0000 7f8f88a00700 1 --2- 172.21.15.80:0/2369254295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f840d0630 0x7f8f840ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:24:02.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.845+0000 7f8f89e00700 1 --2- 172.21.15.80:0/2369254295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f840d3030 0x7f8f840b5600 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c00cad0 tx=0x7f8f7c00ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:02.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.846+0000 7f8f81600700 1 -- 172.21.15.80:0/2369254295 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c00aac0 con 0x7f8f840d3030 2024-05-10T04:24:02.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.846+0000 7f8f81600700 1 -- 172.21.15.80:0/2369254295 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7c00ac20 con 0x7f8f840d3030 2024-05-10T04:24:02.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.846+0000 7f8f8be00700 1 -- 172.21.15.80:0/2369254295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f780094a0 con 0x7f8f840d3030 2024-05-10T04:24:02.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.846+0000 7f8f81600700 1 -- 172.21.15.80:0/2369254295 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c012400 con 0x7f8f840d3030 2024-05-10T04:24:02.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.846+0000 7f8f8be00700 1 -- 172.21.15.80:0/2369254295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f84149330 con 0x7f8f840d3030 2024-05-10T04:24:02.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.847+0000 7f8f8be00700 1 -- 172.21.15.80:0/2369254295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f84074af0 con 0x7f8f840d3030 2024-05-10T04:24:02.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.848+0000 7f8f81600700 1 -- 172.21.15.80:0/2369254295 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8f7c01b3b0 con 0x7f8f840d3030 2024-05-10T04:24:02.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.849+0000 7f8f81600700 1 --2- 172.21.15.80:0/2369254295 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8f6406ac90 0x7f8f6406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:02.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.849+0000 7f8f81600700 1 -- 172.21.15.80:0/2369254295 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f7c089090 con 0x7f8f840d3030 2024-05-10T04:24:02.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.849+0000 7f8f89400700 1 --2- 172.21.15.80:0/2369254295 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8f6406ac90 0x7f8f6406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:02.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.850+0000 7f8f89400700 1 --2- 172.21.15.80:0/2369254295 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8f6406ac90 0x7f8f6406d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009840 tx=0x7f8f78008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:02.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:02.853+0000 7f8f81600700 1 -- 172.21.15.80:0/2369254295 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8f7c054260 con 0x7f8f840d3030 2024-05-10T04:24:03.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:03.109+0000 7f8f8be00700 1 -- 172.21.15.80:0/2369254295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8f840d3760 con 0x7f8f840d3030 2024-05-10T04:24:03.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:03.109+0000 7f8f81600700 1 -- 172.21.15.80:0/2369254295 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8f7c057880 con 0x7f8f840d3030 2024-05-10T04:24:03.111 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T04:24:03.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:03.112+0000 7f8f8be00700 1 -- 172.21.15.80:0/2369254295 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8f6406ac90 msgr2=0x7f8f6406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:03.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:03.112+0000 7f8f8be00700 1 --2- 172.21.15.80:0/2369254295 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8f6406ac90 0x7f8f6406d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009840 tx=0x7f8f78008030 comp rx=0 tx=0).stop 2024-05-10T04:24:03.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:03.112+0000 7f8f8be00700 1 -- 172.21.15.80:0/2369254295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f840d3030 msgr2=0x7f8f840b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:03.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:03.112+0000 7f8f8be00700 1 --2- 172.21.15.80:0/2369254295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f840d3030 0x7f8f840b5600 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c00cad0 tx=0x7f8f7c00ce90 comp rx=0 tx=0).stop 2024-05-10T04:24:03.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:03.112+0000 7f8f8be00700 1 -- 172.21.15.80:0/2369254295 shutdown_connections 2024-05-10T04:24:03.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:03.112+0000 7f8f8be00700 1 --2- 172.21.15.80:0/2369254295 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f8f6406ac90 0x7f8f6406d1a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:03.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:03.112+0000 7f8f8be00700 1 --2- 172.21.15.80:0/2369254295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f840d3030 0x7f8f840b5600 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:03.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:03.112+0000 7f8f8be00700 1 --2- 172.21.15.80:0/2369254295 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f840b2f50 0x7f8f8414b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:03.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:03.112+0000 7f8f8be00700 1 --2- 172.21.15.80:0/2369254295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f840d0630 0x7f8f840ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:03.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:03.112+0000 7f8f8be00700 1 -- 172.21.15.80:0/2369254295 >> 172.21.15.80:0/2369254295 conn(0x7f8f8406c3f0 msgr2=0x7f8f840d0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:03.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:03.112+0000 7f8f8be00700 1 -- 172.21.15.80:0/2369254295 shutdown_connections 2024-05-10T04:24:03.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:03.112+0000 7f8f8be00700 1 -- 172.21.15.80:0/2369254295 wait complete. 2024-05-10T04:24:03.138 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T04:24:03.138 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T04:24:03.139 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-05-10T04:24:03.139 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T04:24:03.139 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T04:24:03.139 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T04:24:03.139 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T04:24:03.139 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T04:24:03.139 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T04:24:03.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:24:03.139 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-05-10T04:24:03.182 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:24:03.182 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:24:03.182 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:24:03.182 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:24:03.182 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-05-10T04:24:03.182 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:24:03.182 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:24:03.182 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:24:03.182 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-05-10T04:24:03.182 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:24:03.182 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:24:03.183 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-05-10T04:24:03.183 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:24:03.183 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:24:03.183 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T04:24:03.183 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:24:03.183 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-10T04:24:03.183 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42080sec preferred_lft 42080sec 2024-05-10T04:24:03.183 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::ec4:7aff:fe8f:cba9/64 scope link 2024-05-10T04:24:03.183 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:24:03.183 INFO:teuthology.orchestra.run.smithi080.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T04:24:03.183 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 26:67:60:aa:2a:20 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:24:03.183 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T04:24:03.183 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:24:03.183 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::d0f9:bbff:fedc:adfa/64 scope link 2024-05-10T04:24:03.184 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:24:03.184 INFO:teuthology.orchestra.run.smithi080.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T04:24:03.184 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 7a:a0:0d:92:85:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T04:24:03.184 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::78a0:dff:fe92:854e/64 scope link 2024-05-10T04:24:03.184 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:24:03.184 INFO:teuthology.orchestra.run.smithi080.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T04:24:03.184 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 26:67:60:aa:2a:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T04:24:03.184 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::2467:60ff:feaa:2a20/64 scope link 2024-05-10T04:24:03.184 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:24:03.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:24:03.185 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T04:24:03.287 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-05-10T04:24:03.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:24:03.291 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-05-10T04:24:03.335 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-05-10T04:24:03.335 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T04:24:03.335 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T04:24:03.335 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T04:24:03.336 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T04:24:03.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:24:03.336 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-10T04:24:03.336 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-10T04:24:03.336 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T04:24:03.336 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T04:24:03.337 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T04:24:03.337 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-10T04:24:03.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:24:03.538 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-05-10T04:24:03.580 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T04:24:03.580 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T04:24:03.581 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T04:24:03.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:24:03.581 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-05-10T04:24:03.687 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:24:03.687 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T04:24:03.729 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T04:24:03.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:24:03.729 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T04:24:03.809 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-10T04:24:03.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:24:03.810 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:24:04.021 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:24:04.021 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-10T04:24:04.058 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:24:04.058 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-10T04:24:04.058 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.106:3300,172.21.15.106:3301" 2024-05-10T04:24:04.059 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with new device syntax: 0@7fdf09a1-1b63-4484-b77e-59e97b1b5367.cephfs=/ 2024-05-10T04:24:04.059 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.80:3300/172.21.15.106:3300/172.21.15.106:3301" will pass to kernel 2024-05-10T04:24:04.063 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T04:24:04.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:24:04.064 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T04:24:04.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:24:04.129 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:24:04.230 INFO:teuthology.orchestra.run.smithi080.stdout:client5265 2024-05-10T04:24:04.231 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:24:04.231 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:24:04.272 DEBUG:teuthology.orchestra.run.smithi080:> mktemp -d --suffix=xfstests-dev 2024-05-10T04:24:04.354 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.ujcZfho4Bmxfstests-dev 2024-05-10T04:24:04.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:24:04.355 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.ujcZfho4Bmxfstests-dev) 2024-05-10T04:24:04.443 INFO:teuthology.orchestra.run.smithi080.stderr:Cloning into '/tmp/tmp.ujcZfho4Bmxfstests-dev'... 2024-05-10T04:24:05.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:24:05.329 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-05-10T04:24:05.378 DEBUG:teuthology.orchestra.run.smithi080:> mktemp -d --suffix=test 2024-05-10T04:24:05.420 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.HTPFU0d2eItest 2024-05-10T04:24:05.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:24:05.421 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-05-10T04:24:05.504 DEBUG:teuthology.orchestra.run.smithi080:> mktemp -d --suffix=scratch 2024-05-10T04:24:05.587 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.up23bDHa8dscratch 2024-05-10T04:24:05.587 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2024-05-10T04:24:05.587 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite xfsprogs-qa-devel 2024-05-10T04:24:06.108 INFO:teuthology.orchestra.run.smithi080.stdout:Updating Subscription Management repositories. 2024-05-10T04:24:08.041 INFO:teuthology.orchestra.run.smithi080.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 kB/s | 4.1 kB 00:00 2024-05-10T04:24:08.458 INFO:teuthology.orchestra.run.smithi080.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 kB/s | 4.5 kB 00:00 2024-05-10T04:24:10.995 INFO:teuthology.orchestra.run.smithi080.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2024-05-10T04:24:10.996 INFO:teuthology.orchestra.run.smithi080.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2024-05-10T04:24:10.998 INFO:teuthology.orchestra.run.smithi080.stdout:Package automake-1.16.1-8.el8.noarch is already installed. 2024-05-10T04:24:11.000 INFO:teuthology.orchestra.run.smithi080.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2024-05-10T04:24:11.001 INFO:teuthology.orchestra.run.smithi080.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2024-05-10T04:24:11.005 INFO:teuthology.orchestra.run.smithi080.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2024-05-10T04:24:11.010 INFO:teuthology.orchestra.run.smithi080.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2024-05-10T04:24:11.010 INFO:teuthology.orchestra.run.smithi080.stdout:Package gcc-8.5.0-20.el8.x86_64 is already installed. 2024-05-10T04:24:11.012 INFO:teuthology.orchestra.run.smithi080.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2024-05-10T04:24:11.014 INFO:teuthology.orchestra.run.smithi080.stdout:Package lvm2-8:2.03.14-3.el8.x86_64 is already installed. 2024-05-10T04:24:11.016 INFO:teuthology.orchestra.run.smithi080.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2024-05-10T04:24:11.017 INFO:teuthology.orchestra.run.smithi080.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2024-05-10T04:24:11.019 INFO:teuthology.orchestra.run.smithi080.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2024-05-10T04:24:11.021 INFO:teuthology.orchestra.run.smithi080.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2024-05-10T04:24:11.023 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsdump-3.1.8-7.el8_9.x86_64 is already installed. 2024-05-10T04:24:11.025 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2024-05-10T04:24:11.027 INFO:teuthology.orchestra.run.smithi080.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-10T04:24:11.029 INFO:teuthology.orchestra.run.smithi080.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-10T04:24:11.031 INFO:teuthology.orchestra.run.smithi080.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2024-05-10T04:24:11.033 INFO:teuthology.orchestra.run.smithi080.stdout:Package libuuid-devel-2.32.1-44.el8_9.1.x86_64 is already installed. 2024-05-10T04:24:11.035 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsprogs-devel-5.0.0-12.el8.x86_64 is already installed. 2024-05-10T04:24:11.041 INFO:teuthology.orchestra.run.smithi080.stdout:Package python36-3.6.8-38.module+el8.5.0+12207+5c5719bc.x86_64 is already installed. 2024-05-10T04:24:11.043 INFO:teuthology.orchestra.run.smithi080.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2024-05-10T04:24:11.049 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2024-05-10T04:24:11.268 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-10T04:24:11.271 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================================================== 2024-05-10T04:24:11.271 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-05-10T04:24:11.271 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================================================== 2024-05-10T04:24:11.271 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-10T04:24:11.271 INFO:teuthology.orchestra.run.smithi080.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2024-05-10T04:24:11.271 INFO:teuthology.orchestra.run.smithi080.stdout: fio x86_64 3.19-4.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-10T04:24:11.271 INFO:teuthology.orchestra.run.smithi080.stdout: indent x86_64 2.2.13-5.el8 epel 187 k 2024-05-10T04:24:11.271 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrading: 2024-05-10T04:24:11.272 INFO:teuthology.orchestra.run.smithi080.stdout: device-mapper x86_64 8:1.02.181-13.el8_9 rhel-8-for-x86_64-baseos-rpms 379 k 2024-05-10T04:24:11.272 INFO:teuthology.orchestra.run.smithi080.stdout: device-mapper-event x86_64 8:1.02.181-13.el8_9 rhel-8-for-x86_64-baseos-rpms 272 k 2024-05-10T04:24:11.272 INFO:teuthology.orchestra.run.smithi080.stdout: device-mapper-event-libs x86_64 8:1.02.181-13.el8_9 rhel-8-for-x86_64-baseos-rpms 271 k 2024-05-10T04:24:11.272 INFO:teuthology.orchestra.run.smithi080.stdout: device-mapper-libs x86_64 8:1.02.181-13.el8_9 rhel-8-for-x86_64-baseos-rpms 411 k 2024-05-10T04:24:11.272 INFO:teuthology.orchestra.run.smithi080.stdout: e2fsprogs x86_64 1.45.6-5.el8 rhel-8-for-x86_64-baseos-rpms 1.0 M 2024-05-10T04:24:11.272 INFO:teuthology.orchestra.run.smithi080.stdout: e2fsprogs-libs x86_64 1.45.6-5.el8 rhel-8-for-x86_64-baseos-rpms 233 k 2024-05-10T04:24:11.272 INFO:teuthology.orchestra.run.smithi080.stdout: libcom_err x86_64 1.45.6-5.el8 rhel-8-for-x86_64-baseos-rpms 49 k 2024-05-10T04:24:11.272 INFO:teuthology.orchestra.run.smithi080.stdout: libcom_err-devel x86_64 1.45.6-5.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-10T04:24:11.272 INFO:teuthology.orchestra.run.smithi080.stdout: libss x86_64 1.45.6-5.el8 rhel-8-for-x86_64-baseos-rpms 54 k 2024-05-10T04:24:11.272 INFO:teuthology.orchestra.run.smithi080.stdout: lvm2 x86_64 8:2.03.14-13.el8_9 rhel-8-for-x86_64-baseos-rpms 1.7 M 2024-05-10T04:24:11.272 INFO:teuthology.orchestra.run.smithi080.stdout: lvm2-libs x86_64 8:2.03.14-13.el8_9 rhel-8-for-x86_64-baseos-rpms 1.2 M 2024-05-10T04:24:11.272 INFO:teuthology.orchestra.run.smithi080.stdout: python36 x86_64 3.6.8-38.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 19 k 2024-05-10T04:24:11.272 INFO:teuthology.orchestra.run.smithi080.stdout: sqlite x86_64 3.26.0-19.el8_9 rhel-8-for-x86_64-baseos-rpms 669 k 2024-05-10T04:24:11.272 INFO:teuthology.orchestra.run.smithi080.stdout: sqlite-libs x86_64 3.26.0-19.el8_9 rhel-8-for-x86_64-baseos-rpms 581 k 2024-05-10T04:24:11.272 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-05-10T04:24:11.273 INFO:teuthology.orchestra.run.smithi080.stdout: daxctl-libs x86_64 71.1-7.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2024-05-10T04:24:11.273 INFO:teuthology.orchestra.run.smithi080.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2024-05-10T04:24:11.273 INFO:teuthology.orchestra.run.smithi080.stdout: ndctl-libs x86_64 71.1-7.el8 rhel-8-for-x86_64-baseos-rpms 80 k 2024-05-10T04:24:11.273 INFO:teuthology.orchestra.run.smithi080.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2024-05-10T04:24:11.273 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:24:11.273 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-10T04:24:11.273 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================================================== 2024-05-10T04:24:11.273 INFO:teuthology.orchestra.run.smithi080.stdout:Install 7 Packages 2024-05-10T04:24:11.273 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrade 14 Packages 2024-05-10T04:24:11.273 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:24:11.274 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 7.9 M 2024-05-10T04:24:11.274 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-10T04:24:11.567 INFO:teuthology.orchestra.run.smithi080.stdout:(1/21): indent-2.2.13-5.el8.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2024-05-10T04:24:11.726 INFO:teuthology.orchestra.run.smithi080.stdout:(2/21): dump-0.4-0.36.b46.el8.x86_64.rpm 505 kB/s | 164 kB 00:00 2024-05-10T04:24:11.751 INFO:teuthology.orchestra.run.smithi080.stdout:(3/21): rmt-1.5.3-13.el8.x86_64.rpm 147 kB/s | 51 kB 00:00 2024-05-10T04:24:11.918 INFO:teuthology.orchestra.run.smithi080.stdout:(4/21): daxctl-libs-71.1-7.el8.x86_64.rpm 121 kB/s | 42 kB 00:00 2024-05-10T04:24:11.943 INFO:teuthology.orchestra.run.smithi080.stdout:(5/21): libpmemblk-1.6.1-1.el8.x86_64.rpm 479 kB/s | 92 kB 00:00 2024-05-10T04:24:12.044 INFO:teuthology.orchestra.run.smithi080.stdout:(6/21): ndctl-libs-71.1-7.el8.x86_64.rpm 252 kB/s | 80 kB 00:00 2024-05-10T04:24:12.144 INFO:teuthology.orchestra.run.smithi080.stdout:(7/21): fio-3.19-4.el8.x86_64.rpm 2.3 MB/s | 538 kB 00:00 2024-05-10T04:24:12.228 INFO:teuthology.orchestra.run.smithi080.stdout:(8/21): e2fsprogs-libs-1.45.6-5.el8.x86_64.rpm 821 kB/s | 233 kB 00:00 2024-05-10T04:24:12.322 INFO:teuthology.orchestra.run.smithi080.stdout:(9/21): libcom_err-1.45.6-5.el8.x86_64.rpm 178 kB/s | 49 kB 00:00 2024-05-10T04:24:12.370 INFO:teuthology.orchestra.run.smithi080.stdout:(10/21): e2fsprogs-1.45.6-5.el8.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-05-10T04:24:12.454 INFO:teuthology.orchestra.run.smithi080.stdout:(11/21): libss-1.45.6-5.el8.x86_64.rpm 410 kB/s | 54 kB 00:00 2024-05-10T04:24:12.479 INFO:teuthology.orchestra.run.smithi080.stdout:(12/21): libcom_err-devel-1.45.6-5.el8.x86_64.r 154 kB/s | 39 kB 00:00 2024-05-10T04:24:12.622 INFO:teuthology.orchestra.run.smithi080.stdout:(13/21): device-mapper-1.02.181-13.el8_9.x86_64 1.5 MB/s | 379 kB 00:00 2024-05-10T04:24:12.663 INFO:teuthology.orchestra.run.smithi080.stdout:(14/21): device-mapper-event-libs-1.02.181-13.e 1.4 MB/s | 271 kB 00:00 2024-05-10T04:24:12.751 INFO:teuthology.orchestra.run.smithi080.stdout:(15/21): device-mapper-event-1.02.181-13.el8_9. 918 kB/s | 272 kB 00:00 2024-05-10T04:24:12.839 INFO:teuthology.orchestra.run.smithi080.stdout:(16/21): lvm2-libs-2.03.14-13.el8_9.x86_64.rpm 5.5 MB/s | 1.2 MB 00:00 2024-05-10T04:24:12.906 INFO:teuthology.orchestra.run.smithi080.stdout:(17/21): device-mapper-libs-1.02.181-13.el8_9.x 1.7 MB/s | 411 kB 00:00 2024-05-10T04:24:13.090 INFO:teuthology.orchestra.run.smithi080.stdout:(18/21): lvm2-2.03.14-13.el8_9.x86_64.rpm 4.9 MB/s | 1.7 MB 00:00 2024-05-10T04:24:13.123 INFO:teuthology.orchestra.run.smithi080.stdout:(19/21): sqlite-3.26.0-19.el8_9.x86_64.rpm 2.3 MB/s | 669 kB 00:00 2024-05-10T04:24:13.190 INFO:teuthology.orchestra.run.smithi080.stdout:(20/21): sqlite-libs-3.26.0-19.el8_9.x86_64.rpm 2.0 MB/s | 581 kB 00:00 2024-05-10T04:24:13.357 INFO:teuthology.orchestra.run.smithi080.stdout:(21/21): python36-3.6.8-38.module+el8.9.0+20976 73 kB/s | 19 kB 00:00 2024-05-10T04:24:13.358 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-10T04:24:13.358 INFO:teuthology.orchestra.run.smithi080.stdout:Total 3.8 MB/s | 7.9 MB 00:02 2024-05-10T04:24:13.892 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-10T04:24:13.990 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-10T04:24:13.990 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-10T04:24:14.183 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-10T04:24:14.192 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-10T04:24:15.212 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-10T04:24:15.275 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcom_err-1.45.6-5.el8.x86_64 1/1 2024-05-10T04:24:15.419 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libcom_err-1.45.6-5.el8.x86_64 1/35 2024-05-10T04:24:15.529 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcom_err-1.45.6-5.el8.x86_64 1/35 2024-05-10T04:24:15.763 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : e2fsprogs-libs-1.45.6-5.el8.x86_64 2/35 2024-05-10T04:24:15.859 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: e2fsprogs-libs-1.45.6-5.el8.x86_64 2/35 2024-05-10T04:24:16.086 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : device-mapper-libs-8:1.02.181-13.el8_9.x86_64 3/35 2024-05-10T04:24:16.317 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : device-mapper-8:1.02.181-13.el8_9.x86_64 4/35 2024-05-10T04:24:16.484 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : device-mapper-event-libs-8:1.02.181-13.el8_9.x86_6 5/35 2024-05-10T04:24:16.660 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : daxctl-libs-71.1-7.el8.x86_64 6/35 2024-05-10T04:24:16.750 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: daxctl-libs-71.1-7.el8.x86_64 6/35 2024-05-10T04:24:16.913 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ndctl-libs-71.1-7.el8.x86_64 7/35 2024-05-10T04:24:17.019 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ndctl-libs-71.1-7.el8.x86_64 7/35 2024-05-10T04:24:17.179 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 8/35 2024-05-10T04:24:17.265 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 8/35 2024-05-10T04:24:17.511 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : device-mapper-event-8:1.02.181-13.el8_9.x86_64 9/35 2024-05-10T04:24:17.868 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: device-mapper-event-8:1.02.181-13.el8_9.x86_64 9/35 2024-05-10T04:24:18.074 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : lvm2-libs-8:2.03.14-13.el8_9.x86_64 10/35 2024-05-10T04:24:18.413 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libss-1.45.6-5.el8.x86_64 11/35 2024-05-10T04:24:18.543 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libss-1.45.6-5.el8.x86_64 11/35 2024-05-10T04:24:18.786 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : sqlite-libs-3.26.0-19.el8_9.x86_64 12/35 2024-05-10T04:24:18.972 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 13/35 2024-05-10T04:24:19.236 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 14/35 2024-05-10T04:24:19.580 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : sqlite-3.26.0-19.el8_9.x86_64 15/35 2024-05-10T04:24:20.050 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : e2fsprogs-1.45.6-5.el8.x86_64 16/35 2024-05-10T04:24:20.051 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : lvm2-8:2.03.14-13.el8_9.x86_64 17/35 2024-05-10T04:24:20.051 INFO:teuthology.orchestra.run.smithi080.stdout:warning: /etc/lvm/lvm.conf created as /etc/lvm/lvm.conf.rpmnew 2024-05-10T04:24:20.051 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:24:20.600 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: lvm2-8:2.03.14-13.el8_9.x86_64 17/35 2024-05-10T04:24:20.892 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : fio-3.19-4.el8.x86_64 18/35 2024-05-10T04:24:21.051 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libcom_err-devel-1.45.6-5.el8.x86_64 19/35 2024-05-10T04:24:21.270 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : python36-3.6.8-38.module+el8.9.0+20976+d3c38525.x8 20/35 2024-05-10T04:24:21.362 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: python36-3.6.8-38.module+el8.9.0+20976+d3c38525.x8 20/35 2024-05-10T04:24:21.566 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : indent-2.2.13-5.el8.x86_64 21/35 2024-05-10T04:24:21.804 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : e2fsprogs-1.45.6-4.el8.x86_64 22/35 2024-05-10T04:24:21.973 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libcom_err-devel-1.45.6-4.el8.x86_64 23/35 2024-05-10T04:24:22.006 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: lvm2-8:2.03.14-3.el8.x86_64 24/35 2024-05-10T04:24:22.006 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : lvm2-8:2.03.14-3.el8.x86_64 24/35 2024-05-10T04:24:22.240 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: lvm2-8:2.03.14-3.el8.x86_64 24/35 2024-05-10T04:24:22.405 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : lvm2-libs-8:2.03.14-3.el8.x86_64 25/35 2024-05-10T04:24:22.424 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: device-mapper-event-8:1.02.181-3.el8.x86_64 26/35 2024-05-10T04:24:22.603 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : device-mapper-event-8:1.02.181-3.el8.x86_64 26/35 2024-05-10T04:24:22.752 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : device-mapper-event-libs-8:1.02.181-3.el8.x86_64 27/35 2024-05-10T04:24:22.752 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : e2fsprogs-libs-1.45.6-4.el8.x86_64 28/35 2024-05-10T04:24:22.995 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: e2fsprogs-libs-1.45.6-4.el8.x86_64 28/35 2024-05-10T04:24:22.995 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libss-1.45.6-4.el8.x86_64 29/35 2024-05-10T04:24:23.203 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libss-1.45.6-4.el8.x86_64 29/35 2024-05-10T04:24:23.232 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:24:23.238 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:24:23.861 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : device-mapper-libs-8:1.02.181-3.el8.x86_64 30/35 2024-05-10T04:24:24.051 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : device-mapper-8:1.02.181-3.el8.x86_64 31/35 2024-05-10T04:24:24.215 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 32/35 2024-05-10T04:24:24.215 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : python36-3.6.8-38.module+el8.5.0+12207+5c5719bc.x8 33/35 2024-05-10T04:24:24.394 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: python36-3.6.8-38.module+el8.5.0+12207+5c5719bc.x8 33/35 2024-05-10T04:24:24.543 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 34/35 2024-05-10T04:24:24.543 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libcom_err-1.45.6-4.el8.x86_64 35/35 2024-05-10T04:24:25.718 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcom_err-1.45.6-4.el8.x86_64 35/35 2024-05-10T04:24:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : indent-2.2.13-5.el8.x86_64 1/35 2024-05-10T04:24:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 2/35 2024-05-10T04:24:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 3/35 2024-05-10T04:24:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : daxctl-libs-71.1-7.el8.x86_64 4/35 2024-05-10T04:24:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ndctl-libs-71.1-7.el8.x86_64 5/35 2024-05-10T04:24:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 6/35 2024-05-10T04:24:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : fio-3.19-4.el8.x86_64 7/35 2024-05-10T04:24:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : e2fsprogs-libs-1.45.6-5.el8.x86_64 8/35 2024-05-10T04:24:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : e2fsprogs-libs-1.45.6-4.el8.x86_64 9/35 2024-05-10T04:24:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcom_err-1.45.6-5.el8.x86_64 10/35 2024-05-10T04:24:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcom_err-1.45.6-4.el8.x86_64 11/35 2024-05-10T04:24:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : e2fsprogs-1.45.6-5.el8.x86_64 12/35 2024-05-10T04:24:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : e2fsprogs-1.45.6-4.el8.x86_64 13/35 2024-05-10T04:24:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 14/35 2024-05-10T04:24:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 15/35 2024-05-10T04:24:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libss-1.45.6-5.el8.x86_64 16/35 2024-05-10T04:24:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libss-1.45.6-4.el8.x86_64 17/35 2024-05-10T04:24:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : device-mapper-8:1.02.181-13.el8_9.x86_64 18/35 2024-05-10T04:24:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : device-mapper-8:1.02.181-3.el8.x86_64 19/35 2024-05-10T04:24:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : device-mapper-event-8:1.02.181-13.el8_9.x86_64 20/35 2024-05-10T04:24:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : device-mapper-event-8:1.02.181-3.el8.x86_64 21/35 2024-05-10T04:24:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : device-mapper-event-libs-8:1.02.181-13.el8_9.x86_6 22/35 2024-05-10T04:24:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : device-mapper-event-libs-8:1.02.181-3.el8.x86_64 23/35 2024-05-10T04:24:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lvm2-libs-8:2.03.14-13.el8_9.x86_64 24/35 2024-05-10T04:24:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lvm2-libs-8:2.03.14-3.el8.x86_64 25/35 2024-05-10T04:24:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : device-mapper-libs-8:1.02.181-13.el8_9.x86_64 26/35 2024-05-10T04:24:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : device-mapper-libs-8:1.02.181-3.el8.x86_64 27/35 2024-05-10T04:24:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lvm2-8:2.03.14-13.el8_9.x86_64 28/35 2024-05-10T04:24:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lvm2-8:2.03.14-3.el8.x86_64 29/35 2024-05-10T04:24:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : sqlite-3.26.0-19.el8_9.x86_64 30/35 2024-05-10T04:24:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 31/35 2024-05-10T04:24:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : sqlite-libs-3.26.0-19.el8_9.x86_64 32/35 2024-05-10T04:24:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 33/35 2024-05-10T04:24:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python36-3.6.8-38.module+el8.9.0+20976+d3c38525.x8 34/35 2024-05-10T04:24:35.778 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python36-3.6.8-38.module+el8.5.0+12207+5c5719bc.x8 35/35 2024-05-10T04:24:35.778 INFO:teuthology.orchestra.run.smithi080.stdout:Installed products updated. 2024-05-10T04:24:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:24:36.455 INFO:teuthology.orchestra.run.smithi080.stdout:Upgraded: 2024-05-10T04:24:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: device-mapper-8:1.02.181-13.el8_9.x86_64 2024-05-10T04:24:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: device-mapper-event-8:1.02.181-13.el8_9.x86_64 2024-05-10T04:24:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: device-mapper-event-libs-8:1.02.181-13.el8_9.x86_64 2024-05-10T04:24:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: device-mapper-libs-8:1.02.181-13.el8_9.x86_64 2024-05-10T04:24:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: e2fsprogs-1.45.6-5.el8.x86_64 2024-05-10T04:24:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: e2fsprogs-libs-1.45.6-5.el8.x86_64 2024-05-10T04:24:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: libcom_err-1.45.6-5.el8.x86_64 2024-05-10T04:24:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-05-10T04:24:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: libss-1.45.6-5.el8.x86_64 2024-05-10T04:24:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: lvm2-8:2.03.14-13.el8_9.x86_64 2024-05-10T04:24:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: lvm2-libs-8:2.03.14-13.el8_9.x86_64 2024-05-10T04:24:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: python36-3.6.8-38.module+el8.9.0+20976+d3c38525.x86_64 2024-05-10T04:24:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: sqlite-3.26.0-19.el8_9.x86_64 2024-05-10T04:24:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: sqlite-libs-3.26.0-19.el8_9.x86_64 2024-05-10T04:24:36.456 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-10T04:24:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: daxctl-libs-71.1-7.el8.x86_64 dump-1:0.4-0.36.b46.el8.x86_64 2024-05-10T04:24:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: fio-3.19-4.el8.x86_64 indent-2.2.13-5.el8.x86_64 2024-05-10T04:24:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: libpmemblk-1.6.1-1.el8.x86_64 ndctl-libs-71.1-7.el8.x86_64 2024-05-10T04:24:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: rmt-2:1.5.3-13.el8.x86_64 2024-05-10T04:24:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:24:36.456 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-10T04:24:36.720 DEBUG:teuthology.orchestra.run.smithi080:> sudo useradd -m fsgqa 2024-05-10T04:24:36.788 INFO:teuthology.orchestra.run.smithi080.stderr:useradd: user 'fsgqa' already exists 2024-05-10T04:24:36.790 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-05-10T04:24:36.791 DEBUG:teuthology.orchestra.run.smithi080:> sudo groupadd fsgqa 2024-05-10T04:24:36.854 INFO:teuthology.orchestra.run.smithi080.stderr:groupadd: group 'fsgqa' already exists 2024-05-10T04:24:36.857 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-05-10T04:24:36.857 DEBUG:teuthology.orchestra.run.smithi080:> sudo useradd fsgqa2 2024-05-10T04:24:38.349 DEBUG:teuthology.orchestra.run.smithi080:> sudo useradd 123456-fsgqa 2024-05-10T04:24:42.022 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-05-10T04:24:42.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.297+0000 7f1f6a600700 1 Processor -- start 2024-05-10T04:24:42.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.298+0000 7f1f6a600700 1 -- start start 2024-05-10T04:24:42.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.299+0000 7f1f6a600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f640aed90 0x7f1f640cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:42.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.299+0000 7f1f6a600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1f6415c310 0x7f1f640cde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:42.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.299+0000 7f1f6a600700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f640717a0 con 0x7f1f640cbcb0 2024-05-10T04:24:42.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.299+0000 7f1f6a600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6406d780 con 0x7f1f6415c310 2024-05-10T04:24:42.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.299+0000 7f1f6a600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f640a8560 con 0x7f1f640aed90 2024-05-10T04:24:42.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.300+0000 7f1f63e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1f640cbcb0 0x7f1f6415fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40042/0 (socket says 172.21.15.80:40042) 2024-05-10T04:24:42.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.300+0000 7f1f63e00700 1 -- 172.21.15.80:0/3853579894 learned_addr learned my addr 172.21.15.80:0/3853579894 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:24:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.300+0000 7f1f5be00700 1 --2- 172.21.15.80:0/3853579894 >> v2:172.21.15.106:3300/0 conn(0x7f1f6415c310 0x7f1f640cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.300+0000 7f1f63400700 1 --2- 172.21.15.80:0/3853579894 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f640aed90 0x7f1f640cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.300+0000 7f1f62a00700 1 -- 172.21.15.80:0/3853579894 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285108103 0 0) 0x7f1f640717a0 con 0x7f1f640cbcb0 2024-05-10T04:24:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.300+0000 7f1f62a00700 1 -- 172.21.15.80:0/3853579894 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f480035b0 con 0x7f1f640cbcb0 2024-05-10T04:24:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.301+0000 7f1f63400700 1 -- 172.21.15.80:0/3853579894 >> v2:172.21.15.106:3300/0 conn(0x7f1f6415c310 msgr2=0x7f1f640cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:24:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.301+0000 7f1f63400700 1 --2- 172.21.15.80:0/3853579894 >> v2:172.21.15.106:3300/0 conn(0x7f1f6415c310 0x7f1f640cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.301+0000 7f1f63400700 1 -- 172.21.15.80:0/3853579894 >> v1:172.21.15.80:6789/0 conn(0x7f1f640cbcb0 legacy=0x7f1f6415fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.301+0000 7f1f63400700 1 -- 172.21.15.80:0/3853579894 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f64071a80 con 0x7f1f640aed90 2024-05-10T04:24:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.301+0000 7f1f63400700 1 --2- 172.21.15.80:0/3853579894 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f640aed90 0x7f1f640cd910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009840 tx=0x7f1f54009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eac741bad43f325e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.301+0000 7f1f62a00700 1 -- 172.21.15.80:0/3853579894 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54011830 con 0x7f1f640aed90 2024-05-10T04:24:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.301+0000 7f1f62a00700 1 -- 172.21.15.80:0/3853579894 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f54011990 con 0x7f1f640aed90 2024-05-10T04:24:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.301+0000 7f1f62a00700 1 -- 172.21.15.80:0/3853579894 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54011d20 con 0x7f1f640aed90 2024-05-10T04:24:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.302+0000 7f1f6a600700 1 -- 172.21.15.80:0/3853579894 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f640aed90 msgr2=0x7f1f640cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.302+0000 7f1f6a600700 1 --2- 172.21.15.80:0/3853579894 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f640aed90 0x7f1f640cd910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009840 tx=0x7f1f54009b50 comp rx=0 tx=0).stop 2024-05-10T04:24:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.302+0000 7f1f6a600700 1 -- 172.21.15.80:0/3853579894 shutdown_connections 2024-05-10T04:24:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.302+0000 7f1f6a600700 1 --2- 172.21.15.80:0/3853579894 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f640aed90 0x7f1f640cd910 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.302+0000 7f1f6a600700 1 --2- 172.21.15.80:0/3853579894 >> v2:172.21.15.106:3300/0 conn(0x7f1f6415c310 0x7f1f640cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.302+0000 7f1f6a600700 1 -- 172.21.15.80:0/3853579894 >> 172.21.15.80:0/3853579894 conn(0x7f1f6406b470 msgr2=0x7f1f640b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:42.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.302+0000 7f1f6a600700 1 -- 172.21.15.80:0/3853579894 shutdown_connections 2024-05-10T04:24:42.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.302+0000 7f1f6a600700 1 -- 172.21.15.80:0/3853579894 wait complete. 2024-05-10T04:24:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.304+0000 7f1f6a600700 1 Processor -- start 2024-05-10T04:24:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.305+0000 7f1f6a600700 1 -- start start 2024-05-10T04:24:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.306+0000 7f1f6a600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f640aed90 0x7f1f64143210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.306+0000 7f1f6a600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f640cbcb0 0x7f1f6415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.306+0000 7f1f6a600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f6415c310 0x7f1f64154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.306+0000 7f1f6a600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f641575d0 con 0x7f1f640cbcb0 2024-05-10T04:24:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.306+0000 7f1f6a600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f64153d00 con 0x7f1f640aed90 2024-05-10T04:24:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.306+0000 7f1f6a600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6415e680 con 0x7f1f6415c310 2024-05-10T04:24:42.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.306+0000 7f1f5be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f640cbcb0 0x7f1f6415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:42.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.306+0000 7f1f5be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f640cbcb0 0x7f1f6415dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38792/0 (socket says 172.21.15.80:38792) 2024-05-10T04:24:42.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.306+0000 7f1f5be00700 1 -- 172.21.15.80:0/2980171949 learned_addr learned my addr 172.21.15.80:0/2980171949 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:24:42.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.307+0000 7f1f63400700 1 --2- 172.21.15.80:0/2980171949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f640aed90 0x7f1f64143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:42.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.307+0000 7f1f63e00700 1 --2- 172.21.15.80:0/2980171949 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f6415c310 0x7f1f64154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:42.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.307+0000 7f1f5be00700 1 -- 172.21.15.80:0/2980171949 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f6415c310 msgr2=0x7f1f64154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:42.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.307+0000 7f1f5be00700 1 --2- 172.21.15.80:0/2980171949 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f6415c310 0x7f1f64154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:42.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.307+0000 7f1f5be00700 1 -- 172.21.15.80:0/2980171949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f640aed90 msgr2=0x7f1f64143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:42.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.307+0000 7f1f5be00700 1 --2- 172.21.15.80:0/2980171949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f640aed90 0x7f1f64143210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:42.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.307+0000 7f1f5be00700 1 -- 172.21.15.80:0/2980171949 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f540094a0 con 0x7f1f640cbcb0 2024-05-10T04:24:42.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.307+0000 7f1f5be00700 1 --2- 172.21.15.80:0/2980171949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f640cbcb0 0x7f1f6415dc50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00e8a0 tx=0x7f1f4c00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:42.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.307+0000 7f1f5b400700 1 -- 172.21.15.80:0/2980171949 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c009590 con 0x7f1f640cbcb0 2024-05-10T04:24:42.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.307+0000 7f1f5b400700 1 -- 172.21.15.80:0/2980171949 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c013680 con 0x7f1f640cbcb0 2024-05-10T04:24:42.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.307+0000 7f1f6a600700 1 -- 172.21.15.80:0/2980171949 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f641f5cb0 con 0x7f1f640cbcb0 2024-05-10T04:24:42.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.308+0000 7f1f5b400700 1 -- 172.21.15.80:0/2980171949 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0139f0 con 0x7f1f640cbcb0 2024-05-10T04:24:42.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.308+0000 7f1f6a600700 1 -- 172.21.15.80:0/2980171949 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f641f6230 con 0x7f1f640cbcb0 2024-05-10T04:24:42.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.309+0000 7f1f6a600700 1 -- 172.21.15.80:0/2980171949 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f641f6880 con 0x7f1f640cbcb0 2024-05-10T04:24:42.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.310+0000 7f1f5b400700 1 -- 172.21.15.80:0/2980171949 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1f4c013b50 con 0x7f1f640cbcb0 2024-05-10T04:24:42.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.311+0000 7f1f5b400700 1 --2- 172.21.15.80:0/2980171949 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1f4006acc0 0x7f1f4006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:42.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.311+0000 7f1f5b400700 1 -- 172.21.15.80:0/2980171949 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f4c089550 con 0x7f1f640cbcb0 2024-05-10T04:24:42.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.311+0000 7f1f63400700 1 --2- 172.21.15.80:0/2980171949 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1f4006acc0 0x7f1f4006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:42.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.312+0000 7f1f63400700 1 --2- 172.21.15.80:0/2980171949 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1f4006acc0 0x7f1f4006d1d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009840 tx=0x7f1f54008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:42.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.315+0000 7f1f5b400700 1 -- 172.21.15.80:0/2980171949 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1f4c054690 con 0x7f1f640cbcb0 2024-05-10T04:24:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.606+0000 7f1f6a600700 1 -- 172.21.15.80:0/2980171949 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1f64074af0 con 0x7f1f640cbcb0 2024-05-10T04:24:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.606+0000 7f1f5b400700 1 -- 172.21.15.80:0/2980171949 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f1f4c017510 con 0x7f1f640cbcb0 2024-05-10T04:24:42.607 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:24:42.608 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":1,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","modified":"2024-05-10T04:21:25.213297Z","created":"2024-05-10T04:21:25.213297Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:3300","nonce":0},{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:3301","nonce":0},{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-10T04:24:42.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.609+0000 7f1f6a600700 1 -- 172.21.15.80:0/2980171949 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1f4006acc0 msgr2=0x7f1f4006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:42.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.609+0000 7f1f6a600700 1 --2- 172.21.15.80:0/2980171949 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1f4006acc0 0x7f1f4006d1d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009840 tx=0x7f1f54008030 comp rx=0 tx=0).stop 2024-05-10T04:24:42.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.609+0000 7f1f6a600700 1 -- 172.21.15.80:0/2980171949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f640cbcb0 msgr2=0x7f1f6415dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:42.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.609+0000 7f1f6a600700 1 --2- 172.21.15.80:0/2980171949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f640cbcb0 0x7f1f6415dc50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00e8a0 tx=0x7f1f4c00ebb0 comp rx=0 tx=0).stop 2024-05-10T04:24:42.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.609+0000 7f1f6a600700 1 -- 172.21.15.80:0/2980171949 shutdown_connections 2024-05-10T04:24:42.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.609+0000 7f1f6a600700 1 --2- 172.21.15.80:0/2980171949 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1f4006acc0 0x7f1f4006d1d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:42.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.609+0000 7f1f6a600700 1 --2- 172.21.15.80:0/2980171949 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f6415c310 0x7f1f64154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:42.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.609+0000 7f1f6a600700 1 --2- 172.21.15.80:0/2980171949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f640aed90 0x7f1f64143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:42.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.609+0000 7f1f6a600700 1 --2- 172.21.15.80:0/2980171949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f640cbcb0 0x7f1f6415dc50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:42.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.609+0000 7f1f6a600700 1 -- 172.21.15.80:0/2980171949 >> 172.21.15.80:0/2980171949 conn(0x7f1f6406b470 msgr2=0x7f1f6415b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:42.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.609+0000 7f1f6a600700 1 -- 172.21.15.80:0/2980171949 shutdown_connections 2024-05-10T04:24:42.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.609+0000 7f1f6a600700 1 -- 172.21.15.80:0/2980171949 wait complete. 2024-05-10T04:24:42.612 INFO:teuthology.orchestra.run.smithi080.stderr:dumped monmap epoch 1 2024-05-10T04:24:42.639 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-05-10T04:24:42.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.903+0000 7fbb9ae00700 1 Processor -- start 2024-05-10T04:24:42.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.903+0000 7fbb9ae00700 1 -- start start 2024-05-10T04:24:42.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.905+0000 7fbb9ae00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940cc9c0 0x7fbb9406b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:42.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.905+0000 7fbb9ae00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb940ce9a0 con 0x7fbb940b31c0 2024-05-10T04:24:42.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.905+0000 7fbb9ae00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb940b02e0 con 0x7fbb940d04e0 2024-05-10T04:24:42.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.905+0000 7fbb9ae00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94070950 con 0x7fbb940cc9c0 2024-05-10T04:24:42.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.905+0000 7fbb93e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbb940b31c0 0x7fbb940cfdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50742/0 (socket says 172.21.15.80:50742) 2024-05-10T04:24:42.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.905+0000 7fbb93e00700 1 -- 172.21.15.80:0/1617319956 learned_addr learned my addr 172.21.15.80:0/1617319956 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:24:42.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.905+0000 7fbb98e00700 1 --2- 172.21.15.80:0/1617319956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940cc9c0 0x7fbb9406b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:42.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb92a00700 1 -- 172.21.15.80:0/1617319956 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104427678 0 0) 0x7fbb940ce9a0 con 0x7fbb940b31c0 2024-05-10T04:24:42.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb92a00700 1 -- 172.21.15.80:0/1617319956 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb780035b0 con 0x7fbb940b31c0 2024-05-10T04:24:42.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb92a00700 1 -- 172.21.15.80:0/1617319956 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488942933 0 0) 0x7fbb940b02e0 con 0x7fbb940d04e0 2024-05-10T04:24:42.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb92a00700 1 -- 172.21.15.80:0/1617319956 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb940ce9a0 con 0x7fbb940d04e0 2024-05-10T04:24:42.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb92a00700 1 -- 172.21.15.80:0/1617319956 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1929253382 0 0) 0x7fbb780035b0 con 0x7fbb940b31c0 2024-05-10T04:24:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb92a00700 1 -- 172.21.15.80:0/1617319956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940cc9c0 msgr2=0x7fbb9406b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:24:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb92a00700 1 --2- 172.21.15.80:0/1617319956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940cc9c0 0x7fbb9406b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb92a00700 1 -- 172.21.15.80:0/1617319956 >> v1:172.21.15.106:6789/0 conn(0x7fbb940d04e0 legacy=0x7fbb9406e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb92a00700 1 -- 172.21.15.80:0/1617319956 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9406bb80 con 0x7fbb940b31c0 2024-05-10T04:24:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb92a00700 1 -- 172.21.15.80:0/1617319956 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7fbb84001670 con 0x7fbb940b31c0 2024-05-10T04:24:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb92a00700 1 -- 172.21.15.80:0/1617319956 >> v1:172.21.15.80:6789/0 conn(0x7fbb940b31c0 legacy=0x7fbb940cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb92a00700 1 --2- 172.21.15.80:0/1617319956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940cc9c0 0x7fbb78003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb92a00700 1 --2- 172.21.15.80:0/1617319956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb78004120 0x7fbb78004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb92a00700 1 --2- 172.21.15.80:0/1617319956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb78004d90 0x7fbb780051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb92a00700 1 -- 172.21.15.80:0/1617319956 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94070950 con 0x7fbb78004d90 2024-05-10T04:24:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb92a00700 1 -- 172.21.15.80:0/1617319956 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7800bb70 con 0x7fbb78004120 2024-05-10T04:24:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb92a00700 1 -- 172.21.15.80:0/1617319956 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7800bd30 con 0x7fbb940cc9c0 2024-05-10T04:24:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.906+0000 7fbb98e00700 1 --2- 172.21.15.80:0/1617319956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb78004d90 0x7fbb780051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.907+0000 7fbb93e00700 1 --2- 172.21.15.80:0/1617319956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940cc9c0 0x7fbb78003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.907+0000 7fbb93400700 1 --2- 172.21.15.80:0/1617319956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb78004120 0x7fbb78004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.907+0000 7fbb98e00700 1 -- 172.21.15.80:0/1617319956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940cc9c0 msgr2=0x7fbb78003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:24:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.907+0000 7fbb98e00700 1 --2- 172.21.15.80:0/1617319956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940cc9c0 0x7fbb78003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.907+0000 7fbb98e00700 1 -- 172.21.15.80:0/1617319956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb78004120 msgr2=0x7fbb78004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:24:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.907+0000 7fbb98e00700 1 --2- 172.21.15.80:0/1617319956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb78004120 0x7fbb78004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.907+0000 7fbb98e00700 1 -- 172.21.15.80:0/1617319956 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb780035b0 con 0x7fbb78004d90 2024-05-10T04:24:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.907+0000 7fbb98e00700 1 --2- 172.21.15.80:0/1617319956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb78004d90 0x7fbb780051a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbb940702a0 tx=0x7fbb78005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a408c6e7e8b559 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.907+0000 7fbb92a00700 1 -- 172.21.15.80:0/1617319956 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c00ebd0 con 0x7fbb78004d90 2024-05-10T04:24:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.907+0000 7fbb92a00700 1 -- 172.21.15.80:0/1617319956 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c00f040 con 0x7fbb78004d90 2024-05-10T04:24:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.907+0000 7fbb92a00700 1 -- 172.21.15.80:0/1617319956 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c014480 con 0x7fbb78004d90 2024-05-10T04:24:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.908+0000 7fbb9ae00700 1 -- 172.21.15.80:0/1617319956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb78004d90 msgr2=0x7fbb780051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.908+0000 7fbb9ae00700 1 --2- 172.21.15.80:0/1617319956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb78004d90 0x7fbb780051a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbb940702a0 tx=0x7fbb78005880 comp rx=0 tx=0).stop 2024-05-10T04:24:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.908+0000 7fbb98e00700 1 -- 172.21.15.80:0/1617319956 reap_dead start 2024-05-10T04:24:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.908+0000 7fbb9ae00700 1 -- 172.21.15.80:0/1617319956 shutdown_connections 2024-05-10T04:24:42.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.908+0000 7fbb9ae00700 1 -- 172.21.15.80:0/1617319956 >> 172.21.15.80:0/1617319956 conn(0x7fbb940b26a0 msgr2=0x7fbb940b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:42.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.908+0000 7fbb9ae00700 1 -- 172.21.15.80:0/1617319956 shutdown_connections 2024-05-10T04:24:42.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.908+0000 7fbb9ae00700 1 -- 172.21.15.80:0/1617319956 wait complete. 2024-05-10T04:24:42.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.911+0000 7fbb9ae00700 1 Processor -- start 2024-05-10T04:24:42.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.911+0000 7fbb9ae00700 1 -- start start 2024-05-10T04:24:42.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.912+0000 7fbb9ae00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb78004d90 0x7fbb94154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:42.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.912+0000 7fbb9ae00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb940ca1e0 0x7fbb940ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:42.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.912+0000 7fbb9ae00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940af120 0x7fbb940af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:42.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.912+0000 7fbb9ae00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb941f7890 con 0x7fbb78004d90 2024-05-10T04:24:42.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.912+0000 7fbb9ae00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94154540 con 0x7fbb940ca1e0 2024-05-10T04:24:42.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.912+0000 7fbb9ae00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940afa70 con 0x7fbb940af120 2024-05-10T04:24:42.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.912+0000 7fbb93e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb78004d90 0x7fbb94154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:42.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.913+0000 7fbb93e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb78004d90 0x7fbb94154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54694/0 (socket says 172.21.15.80:54694) 2024-05-10T04:24:42.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.913+0000 7fbb93e00700 1 -- 172.21.15.80:0/2483778960 learned_addr learned my addr 172.21.15.80:0/2483778960 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:24:42.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.913+0000 7fbb98e00700 1 --2- 172.21.15.80:0/2483778960 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940af120 0x7fbb940af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:42.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.913+0000 7fbb93e00700 1 -- 172.21.15.80:0/2483778960 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940af120 msgr2=0x7fbb940af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:42.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.913+0000 7fbb93400700 1 --2- 172.21.15.80:0/2483778960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb940ca1e0 0x7fbb940ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.913+0000 7fbb93e00700 1 --2- 172.21.15.80:0/2483778960 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940af120 0x7fbb940af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.913+0000 7fbb93e00700 1 -- 172.21.15.80:0/2483778960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb940ca1e0 msgr2=0x7fbb940ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.913+0000 7fbb93e00700 1 --2- 172.21.15.80:0/2483778960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb940ca1e0 0x7fbb940ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.913+0000 7fbb93e00700 1 -- 172.21.15.80:0/2483778960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb941f7ae0 con 0x7fbb78004d90 2024-05-10T04:24:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.913+0000 7fbb93400700 1 --2- 172.21.15.80:0/2483778960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb940ca1e0 0x7fbb940ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:24:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.913+0000 7fbb98e00700 1 --2- 172.21.15.80:0/2483778960 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940af120 0x7fbb940af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:24:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.913+0000 7fbb93e00700 1 --2- 172.21.15.80:0/2483778960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb78004d90 0x7fbb94154000 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbb84007370 tx=0x7fbb84007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.914+0000 7fbb8be00700 1 -- 172.21.15.80:0/2483778960 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8400f8d0 con 0x7fbb78004d90 2024-05-10T04:24:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.914+0000 7fbb8be00700 1 -- 172.21.15.80:0/2483778960 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8400fa50 con 0x7fbb78004d90 2024-05-10T04:24:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.914+0000 7fbb9ae00700 1 -- 172.21.15.80:0/2483778960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb941f7dc0 con 0x7fbb78004d90 2024-05-10T04:24:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.914+0000 7fbb8be00700 1 -- 172.21.15.80:0/2483778960 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8400fe00 con 0x7fbb78004d90 2024-05-10T04:24:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.914+0000 7fbb9ae00700 1 -- 172.21.15.80:0/2483778960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb941f8380 con 0x7fbb78004d90 2024-05-10T04:24:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.915+0000 7fbb9ae00700 1 -- 172.21.15.80:0/2483778960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb941f86f0 con 0x7fbb78004d90 2024-05-10T04:24:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.916+0000 7fbb8be00700 1 -- 172.21.15.80:0/2483778960 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbb8401d460 con 0x7fbb78004d90 2024-05-10T04:24:42.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.917+0000 7fbb8be00700 1 --2- 172.21.15.80:0/2483778960 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fbb7406acc0 0x7fbb7406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:24:42.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.917+0000 7fbb8be00700 1 -- 172.21.15.80:0/2483778960 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb84089460 con 0x7fbb78004d90 2024-05-10T04:24:42.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.918+0000 7fbb93400700 1 --2- 172.21.15.80:0/2483778960 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fbb7406acc0 0x7fbb7406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:24:42.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.918+0000 7fbb93400700 1 --2- 172.21.15.80:0/2483778960 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fbb7406acc0 0x7fbb7406d1d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbb940afd60 tx=0x7fbb80009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:24:42.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:42.922+0000 7fbb8be00700 1 -- 172.21.15.80:0/2483778960 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbb840545b0 con 0x7fbb78004d90 2024-05-10T04:24:43.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:43.212+0000 7fbb9ae00700 1 -- 172.21.15.80:0/2483778960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7fbb940c4660 con 0x7fbb78004d90 2024-05-10T04:24:43.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:43.213+0000 7fbb8be00700 1 -- 172.21.15.80:0/2483778960 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7fbb940c4660 con 0x7fbb78004d90 2024-05-10T04:24:43.214 INFO:teuthology.orchestra.run.smithi080.stdout:[client.admin] 2024-05-10T04:24:43.214 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDFoD1mdOoYJRAACeUopudzFqH/0fbbz4jU0w== 2024-05-10T04:24:43.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:43.215+0000 7fbb9ae00700 1 -- 172.21.15.80:0/2483778960 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fbb7406acc0 msgr2=0x7fbb7406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:43.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:43.215+0000 7fbb9ae00700 1 --2- 172.21.15.80:0/2483778960 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fbb7406acc0 0x7fbb7406d1d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbb940afd60 tx=0x7fbb80009040 comp rx=0 tx=0).stop 2024-05-10T04:24:43.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:43.215+0000 7fbb9ae00700 1 -- 172.21.15.80:0/2483778960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb78004d90 msgr2=0x7fbb94154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:24:43.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:43.215+0000 7fbb9ae00700 1 --2- 172.21.15.80:0/2483778960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb78004d90 0x7fbb94154000 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbb84007370 tx=0x7fbb84007680 comp rx=0 tx=0).stop 2024-05-10T04:24:43.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:43.215+0000 7fbb9ae00700 1 -- 172.21.15.80:0/2483778960 shutdown_connections 2024-05-10T04:24:43.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:43.215+0000 7fbb9ae00700 1 --2- 172.21.15.80:0/2483778960 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fbb7406acc0 0x7fbb7406d1d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:43.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:43.215+0000 7fbb9ae00700 1 --2- 172.21.15.80:0/2483778960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb78004d90 0x7fbb94154000 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:43.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:43.215+0000 7fbb9ae00700 1 --2- 172.21.15.80:0/2483778960 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940af120 0x7fbb940af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:43.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:43.215+0000 7fbb9ae00700 1 --2- 172.21.15.80:0/2483778960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb940ca1e0 0x7fbb940ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:24:43.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:43.215+0000 7fbb9ae00700 1 -- 172.21.15.80:0/2483778960 >> 172.21.15.80:0/2483778960 conn(0x7fbb940b26a0 msgr2=0x7fbb9406f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:24:43.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:43.215+0000 7fbb9ae00700 1 -- 172.21.15.80:0/2483778960 shutdown_connections 2024-05-10T04:24:43.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:24:43.215+0000 7fbb9ae00700 1 -- 172.21.15.80:0/2483778960 wait complete. 2024-05-10T04:24:43.245 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:24:43.245 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/tmp/tmp.ujcZfho4Bmxfstests-dev/local.config 2024-05-10T04:24:43.310 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.80:6789:/test export TEST_DIR=/tmp/tmp.HTPFU0d2eItest export SCRATCH_DEV=172.21.15.80:6789:/scratch export SCRATCH_MNT=/tmp/tmp.up23bDHa8dscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQDFoD1mdOoYJRAACeUopudzFqH/0fbbz4jU0w==" 2024-05-10T04:24:43.310 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:24:43.310 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/tmp/tmp.ujcZfho4Bmxfstests-dev/ceph.exclude 2024-05-10T04:24:43.414 DEBUG:teuthology.orchestra.run.smithi080:> (cd /tmp/tmp.ujcZfho4Bmxfstests-dev && exec sudo make) 2024-05-10T04:24:43.538 INFO:teuthology.orchestra.run.smithi080.stdout:libtoolize -cfi 2024-05-10T04:24:44.060 INFO:teuthology.orchestra.run.smithi080.stdout:libtoolize: putting auxiliary files in '.'. 2024-05-10T04:24:44.061 INFO:teuthology.orchestra.run.smithi080.stdout:libtoolize: copying file './config.guess' 2024-05-10T04:24:44.070 INFO:teuthology.orchestra.run.smithi080.stdout:libtoolize: copying file './config.sub' 2024-05-10T04:24:44.080 INFO:teuthology.orchestra.run.smithi080.stdout:libtoolize: copying file './install-sh' 2024-05-10T04:24:44.091 INFO:teuthology.orchestra.run.smithi080.stdout:libtoolize: copying file './ltmain.sh' 2024-05-10T04:24:44.150 INFO:teuthology.orchestra.run.smithi080.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-05-10T04:24:44.151 INFO:teuthology.orchestra.run.smithi080.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-05-10T04:24:44.163 INFO:teuthology.orchestra.run.smithi080.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-05-10T04:24:44.175 INFO:teuthology.orchestra.run.smithi080.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-05-10T04:24:44.190 INFO:teuthology.orchestra.run.smithi080.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-05-10T04:24:44.200 INFO:teuthology.orchestra.run.smithi080.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-05-10T04:24:44.216 INFO:teuthology.orchestra.run.smithi080.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-05-10T04:24:44.219 INFO:teuthology.orchestra.run.smithi080.stdout:cp include/install-sh . 2024-05-10T04:24:44.221 INFO:teuthology.orchestra.run.smithi080.stdout:aclocal -I m4 2024-05-10T04:24:45.455 INFO:teuthology.orchestra.run.smithi080.stdout:autoheader 2024-05-10T04:24:45.816 INFO:teuthology.orchestra.run.smithi080.stdout:autoconf 2024-05-10T04:24:46.024 INFO:teuthology.orchestra.run.smithi080.stdout:./configure \ 2024-05-10T04:24:46.024 INFO:teuthology.orchestra.run.smithi080.stdout: --libexecdir=/usr/lib \ 2024-05-10T04:24:46.025 INFO:teuthology.orchestra.run.smithi080.stdout: --exec_prefix=/var/lib 2024-05-10T04:24:46.719 INFO:teuthology.orchestra.run.smithi080.stdout:checking build system type... x86_64-pc-linux-gnu 2024-05-10T04:24:46.720 INFO:teuthology.orchestra.run.smithi080.stdout:checking host system type... x86_64-pc-linux-gnu 2024-05-10T04:24:46.723 INFO:teuthology.orchestra.run.smithi080.stdout:checking how to print strings... printf 2024-05-10T04:24:46.724 INFO:teuthology.orchestra.run.smithi080.stdout:checking for gcc... gcc 2024-05-10T04:24:47.001 INFO:teuthology.orchestra.run.smithi080.stdout:checking whether the C compiler works... yes 2024-05-10T04:24:47.001 INFO:teuthology.orchestra.run.smithi080.stdout:checking for C compiler default output file name... a.out 2024-05-10T04:24:47.058 INFO:teuthology.orchestra.run.smithi080.stdout:checking for suffix of executables... 2024-05-10T04:24:47.152 INFO:teuthology.orchestra.run.smithi080.stdout:checking whether we are cross compiling... no 2024-05-10T04:24:47.191 INFO:teuthology.orchestra.run.smithi080.stdout:checking for suffix of object files... o 2024-05-10T04:24:47.225 INFO:teuthology.orchestra.run.smithi080.stdout:checking whether we are using the GNU C compiler... yes 2024-05-10T04:24:47.261 INFO:teuthology.orchestra.run.smithi080.stdout:checking whether gcc accepts -g... yes 2024-05-10T04:24:47.339 INFO:teuthology.orchestra.run.smithi080.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-10T04:24:47.346 INFO:teuthology.orchestra.run.smithi080.stdout:checking for a sed that does not truncate output... /bin/sed 2024-05-10T04:24:47.351 INFO:teuthology.orchestra.run.smithi080.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-05-10T04:24:47.354 INFO:teuthology.orchestra.run.smithi080.stdout:checking for egrep... /bin/grep -E 2024-05-10T04:24:47.357 INFO:teuthology.orchestra.run.smithi080.stdout:checking for fgrep... /bin/grep -F 2024-05-10T04:24:47.365 INFO:teuthology.orchestra.run.smithi080.stdout:checking for ld used by gcc... /bin/ld 2024-05-10T04:24:47.370 INFO:teuthology.orchestra.run.smithi080.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-05-10T04:24:47.410 INFO:teuthology.orchestra.run.smithi080.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-05-10T04:24:47.450 INFO:teuthology.orchestra.run.smithi080.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-05-10T04:24:47.450 INFO:teuthology.orchestra.run.smithi080.stdout:checking whether ln -s works... yes 2024-05-10T04:24:47.468 INFO:teuthology.orchestra.run.smithi080.stdout:checking the maximum length of command line arguments... 1572864 2024-05-10T04:24:47.474 INFO:teuthology.orchestra.run.smithi080.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-05-10T04:24:47.474 INFO:teuthology.orchestra.run.smithi080.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-05-10T04:24:47.474 INFO:teuthology.orchestra.run.smithi080.stdout:checking for /bin/ld option to reload object files... -r 2024-05-10T04:24:47.475 INFO:teuthology.orchestra.run.smithi080.stdout:checking for objdump... objdump 2024-05-10T04:24:47.476 INFO:teuthology.orchestra.run.smithi080.stdout:checking how to recognize dependent libraries... pass_all 2024-05-10T04:24:47.476 INFO:teuthology.orchestra.run.smithi080.stdout:checking for dlltool... no 2024-05-10T04:24:47.476 INFO:teuthology.orchestra.run.smithi080.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-05-10T04:24:47.476 INFO:teuthology.orchestra.run.smithi080.stdout:checking for ar... ar 2024-05-10T04:24:47.534 INFO:teuthology.orchestra.run.smithi080.stdout:checking for archiver @FILE support... @ 2024-05-10T04:24:47.535 INFO:teuthology.orchestra.run.smithi080.stdout:checking for strip... strip 2024-05-10T04:24:47.535 INFO:teuthology.orchestra.run.smithi080.stdout:checking for ranlib... ranlib 2024-05-10T04:24:47.535 INFO:teuthology.orchestra.run.smithi080.stdout:checking for gawk... gawk 2024-05-10T04:24:47.647 INFO:teuthology.orchestra.run.smithi080.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-05-10T04:24:47.650 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sysroot... no 2024-05-10T04:24:47.658 INFO:teuthology.orchestra.run.smithi080.stdout:checking for a working dd... /bin/dd 2024-05-10T04:24:47.665 INFO:teuthology.orchestra.run.smithi080.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-05-10T04:24:47.695 INFO:teuthology.orchestra.run.smithi080.stdout:checking for mt... no 2024-05-10T04:24:47.700 INFO:teuthology.orchestra.run.smithi080.stdout:checking if : is a manifest tool... no 2024-05-10T04:24:47.771 INFO:teuthology.orchestra.run.smithi080.stdout:checking how to run the C preprocessor... gcc -E 2024-05-10T04:24:48.018 INFO:teuthology.orchestra.run.smithi080.stdout:checking for ANSI C header files... yes 2024-05-10T04:24:48.063 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/types.h... yes 2024-05-10T04:24:48.116 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/stat.h... yes 2024-05-10T04:24:48.168 INFO:teuthology.orchestra.run.smithi080.stdout:checking for stdlib.h... yes 2024-05-10T04:24:48.222 INFO:teuthology.orchestra.run.smithi080.stdout:checking for string.h... yes 2024-05-10T04:24:48.276 INFO:teuthology.orchestra.run.smithi080.stdout:checking for memory.h... yes 2024-05-10T04:24:48.330 INFO:teuthology.orchestra.run.smithi080.stdout:checking for strings.h... yes 2024-05-10T04:24:48.388 INFO:teuthology.orchestra.run.smithi080.stdout:checking for inttypes.h... yes 2024-05-10T04:24:48.442 INFO:teuthology.orchestra.run.smithi080.stdout:checking for stdint.h... yes 2024-05-10T04:24:48.502 INFO:teuthology.orchestra.run.smithi080.stdout:checking for unistd.h... yes 2024-05-10T04:24:48.555 INFO:teuthology.orchestra.run.smithi080.stdout:checking for dlfcn.h... yes 2024-05-10T04:24:48.564 INFO:teuthology.orchestra.run.smithi080.stdout:checking for objdir... .libs 2024-05-10T04:24:48.701 INFO:teuthology.orchestra.run.smithi080.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-05-10T04:24:48.702 INFO:teuthology.orchestra.run.smithi080.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-05-10T04:24:48.741 INFO:teuthology.orchestra.run.smithi080.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-05-10T04:24:48.780 INFO:teuthology.orchestra.run.smithi080.stdout:checking if gcc static flag -static works... no 2024-05-10T04:24:48.835 INFO:teuthology.orchestra.run.smithi080.stdout:checking if gcc supports -c -o file.o... yes 2024-05-10T04:24:48.835 INFO:teuthology.orchestra.run.smithi080.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-05-10T04:24:48.853 INFO:teuthology.orchestra.run.smithi080.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-05-10T04:24:48.904 INFO:teuthology.orchestra.run.smithi080.stdout:checking whether -lc should be explicitly linked in... no 2024-05-10T04:24:49.008 INFO:teuthology.orchestra.run.smithi080.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-05-10T04:24:49.009 INFO:teuthology.orchestra.run.smithi080.stdout:checking how to hardcode library paths into programs... immediate 2024-05-10T04:24:49.013 INFO:teuthology.orchestra.run.smithi080.stdout:checking whether stripping libraries is possible... yes 2024-05-10T04:24:49.013 INFO:teuthology.orchestra.run.smithi080.stdout:checking if libtool supports shared libraries... yes 2024-05-10T04:24:49.013 INFO:teuthology.orchestra.run.smithi080.stdout:checking whether to build shared libraries... yes 2024-05-10T04:24:49.013 INFO:teuthology.orchestra.run.smithi080.stdout:checking whether to build static libraries... yes 2024-05-10T04:24:49.026 INFO:teuthology.orchestra.run.smithi080.stdout:checking for gcc... (cached) gcc 2024-05-10T04:24:49.065 INFO:teuthology.orchestra.run.smithi080.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-10T04:24:49.065 INFO:teuthology.orchestra.run.smithi080.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-10T04:24:49.065 INFO:teuthology.orchestra.run.smithi080.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-10T04:24:49.065 INFO:teuthology.orchestra.run.smithi080.stdout:checking for gmake... /usr/bin/gmake 2024-05-10T04:24:49.065 INFO:teuthology.orchestra.run.smithi080.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2024-05-10T04:24:49.066 INFO:teuthology.orchestra.run.smithi080.stdout:checking for tar... /bin/tar 2024-05-10T04:24:49.066 INFO:teuthology.orchestra.run.smithi080.stdout:checking for gzip... /bin/gzip 2024-05-10T04:24:49.082 INFO:teuthology.orchestra.run.smithi080.stdout:checking whether gcc -MM is supported... yes 2024-05-10T04:24:49.083 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sort... /bin/sort 2024-05-10T04:24:49.083 INFO:teuthology.orchestra.run.smithi080.stdout:checking whether ln -s works... yes 2024-05-10T04:24:49.083 INFO:teuthology.orchestra.run.smithi080.stdout:checking for rpm... /bin/rpm 2024-05-10T04:24:49.092 INFO:teuthology.orchestra.run.smithi080.stdout:checking for rpmbuild... no 2024-05-10T04:24:49.142 INFO:teuthology.orchestra.run.smithi080.stdout:checking assert.h usability... yes 2024-05-10T04:24:49.158 INFO:teuthology.orchestra.run.smithi080.stdout:checking assert.h presence... yes 2024-05-10T04:24:49.158 INFO:teuthology.orchestra.run.smithi080.stdout:checking for assert.h... yes 2024-05-10T04:24:49.215 INFO:teuthology.orchestra.run.smithi080.stdout:checking bstring.h usability... no 2024-05-10T04:24:49.239 INFO:teuthology.orchestra.run.smithi080.stdout:checking bstring.h presence... no 2024-05-10T04:24:49.240 INFO:teuthology.orchestra.run.smithi080.stdout:checking for bstring.h... no 2024-05-10T04:24:49.290 INFO:teuthology.orchestra.run.smithi080.stdout:checking libgen.h usability... yes 2024-05-10T04:24:49.306 INFO:teuthology.orchestra.run.smithi080.stdout:checking libgen.h presence... yes 2024-05-10T04:24:49.306 INFO:teuthology.orchestra.run.smithi080.stdout:checking for libgen.h... yes 2024-05-10T04:24:49.366 INFO:teuthology.orchestra.run.smithi080.stdout:checking dirent.h usability... yes 2024-05-10T04:24:49.383 INFO:teuthology.orchestra.run.smithi080.stdout:checking dirent.h presence... yes 2024-05-10T04:24:49.384 INFO:teuthology.orchestra.run.smithi080.stdout:checking for dirent.h... yes 2024-05-10T04:24:49.492 INFO:teuthology.orchestra.run.smithi080.stdout:checking errno.h usability... yes 2024-05-10T04:24:49.509 INFO:teuthology.orchestra.run.smithi080.stdout:checking errno.h presence... yes 2024-05-10T04:24:49.510 INFO:teuthology.orchestra.run.smithi080.stdout:checking for errno.h... yes 2024-05-10T04:24:49.569 INFO:teuthology.orchestra.run.smithi080.stdout:checking malloc.h usability... yes 2024-05-10T04:24:49.587 INFO:teuthology.orchestra.run.smithi080.stdout:checking malloc.h presence... yes 2024-05-10T04:24:49.587 INFO:teuthology.orchestra.run.smithi080.stdout:checking for malloc.h... yes 2024-05-10T04:24:49.644 INFO:teuthology.orchestra.run.smithi080.stdout:checking uuid.h usability... no 2024-05-10T04:24:49.668 INFO:teuthology.orchestra.run.smithi080.stdout:checking uuid.h presence... no 2024-05-10T04:24:49.668 INFO:teuthology.orchestra.run.smithi080.stdout:checking for uuid.h... no 2024-05-10T04:24:49.721 INFO:teuthology.orchestra.run.smithi080.stdout:checking uuid/uuid.h usability... yes 2024-05-10T04:24:49.740 INFO:teuthology.orchestra.run.smithi080.stdout:checking uuid/uuid.h presence... yes 2024-05-10T04:24:49.740 INFO:teuthology.orchestra.run.smithi080.stdout:checking for uuid/uuid.h... yes 2024-05-10T04:24:49.797 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/uuid.h usability... no 2024-05-10T04:24:49.822 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/uuid.h presence... no 2024-05-10T04:24:49.822 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/uuid.h... no 2024-05-10T04:24:49.875 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/file.h usability... yes 2024-05-10T04:24:49.892 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/file.h presence... yes 2024-05-10T04:24:49.893 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/file.h... yes 2024-05-10T04:24:49.951 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/fcntl.h usability... yes 2024-05-10T04:24:49.968 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/fcntl.h presence... yes 2024-05-10T04:24:49.968 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/fcntl.h... yes 2024-05-10T04:24:50.025 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/syssgi.h usability... no 2024-05-10T04:24:50.049 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/syssgi.h presence... no 2024-05-10T04:24:50.049 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/syssgi.h... no 2024-05-10T04:24:50.121 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/param.h usability... yes 2024-05-10T04:24:50.143 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/param.h presence... yes 2024-05-10T04:24:50.143 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/param.h... yes 2024-05-10T04:24:50.157 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/stat.h... (cached) yes 2024-05-10T04:24:50.215 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/statvfs.h usability... yes 2024-05-10T04:24:50.232 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/statvfs.h presence... yes 2024-05-10T04:24:50.233 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/statvfs.h... yes 2024-05-10T04:24:50.291 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/time.h usability... yes 2024-05-10T04:24:50.308 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/time.h presence... yes 2024-05-10T04:24:50.308 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/time.h... yes 2024-05-10T04:24:50.378 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/ioctl.h usability... yes 2024-05-10T04:24:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/ioctl.h presence... yes 2024-05-10T04:24:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/ioctl.h... yes 2024-05-10T04:24:50.460 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/wait.h usability... yes 2024-05-10T04:24:50.479 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/wait.h presence... yes 2024-05-10T04:24:50.480 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/wait.h... yes 2024-05-10T04:24:50.493 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/types.h... (cached) yes 2024-05-10T04:24:50.507 INFO:teuthology.orchestra.run.smithi080.stdout:checking for strings.h... (cached) yes 2024-05-10T04:24:50.569 INFO:teuthology.orchestra.run.smithi080.stdout:checking err.h usability... yes 2024-05-10T04:24:50.586 INFO:teuthology.orchestra.run.smithi080.stdout:checking err.h presence... yes 2024-05-10T04:24:50.586 INFO:teuthology.orchestra.run.smithi080.stdout:checking for err.h... yes 2024-05-10T04:24:50.644 INFO:teuthology.orchestra.run.smithi080.stdout:checking linux/falloc.h usability... yes 2024-05-10T04:24:50.659 INFO:teuthology.orchestra.run.smithi080.stdout:checking linux/falloc.h presence... yes 2024-05-10T04:24:50.660 INFO:teuthology.orchestra.run.smithi080.stdout:checking for linux/falloc.h... yes 2024-05-10T04:24:50.717 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-05-10T04:24:50.742 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-05-10T04:24:50.742 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/fs/xfs_fsops.h... no 2024-05-10T04:24:50.791 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/fs/xfs_itable.h usability... no 2024-05-10T04:24:50.815 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/fs/xfs_itable.h presence... no 2024-05-10T04:24:50.816 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/fs/xfs_itable.h... no 2024-05-10T04:24:50.864 INFO:teuthology.orchestra.run.smithi080.stdout:checking xfs/platform_defs.h usability... no 2024-05-10T04:24:50.889 INFO:teuthology.orchestra.run.smithi080.stdout:checking xfs/platform_defs.h presence... no 2024-05-10T04:24:50.889 INFO:teuthology.orchestra.run.smithi080.stdout:checking for xfs/platform_defs.h... no 2024-05-10T04:24:50.939 INFO:teuthology.orchestra.run.smithi080.stdout:checking btrfs/ioctl.h usability... no 2024-05-10T04:24:50.963 INFO:teuthology.orchestra.run.smithi080.stdout:checking btrfs/ioctl.h presence... no 2024-05-10T04:24:50.963 INFO:teuthology.orchestra.run.smithi080.stdout:checking for btrfs/ioctl.h... no 2024-05-10T04:24:51.012 INFO:teuthology.orchestra.run.smithi080.stdout:checking cifs/ioctl.h usability... no 2024-05-10T04:24:51.038 INFO:teuthology.orchestra.run.smithi080.stdout:checking cifs/ioctl.h presence... no 2024-05-10T04:24:51.039 INFO:teuthology.orchestra.run.smithi080.stdout:checking for cifs/ioctl.h... no 2024-05-10T04:24:51.099 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/mman.h usability... yes 2024-05-10T04:24:51.117 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/mman.h presence... yes 2024-05-10T04:24:51.117 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/mman.h... yes 2024-05-10T04:24:51.174 INFO:teuthology.orchestra.run.smithi080.stdout:checking linux/ext4.h usability... no 2024-05-10T04:24:51.198 INFO:teuthology.orchestra.run.smithi080.stdout:checking linux/ext4.h presence... no 2024-05-10T04:24:51.198 INFO:teuthology.orchestra.run.smithi080.stdout:checking for linux/ext4.h... no 2024-05-10T04:24:51.229 INFO:teuthology.orchestra.run.smithi080.stdout:checking for xfs/xfs_log_format.h... no 2024-05-10T04:24:51.297 INFO:teuthology.orchestra.run.smithi080.stdout:checking for uuid_compare... no 2024-05-10T04:24:51.355 INFO:teuthology.orchestra.run.smithi080.stdout:checking for uuid_compare in -luuid... yes 2024-05-10T04:24:51.445 INFO:teuthology.orchestra.run.smithi080.stdout:checking for xfs/xfs.h... yes 2024-05-10T04:24:51.477 INFO:teuthology.orchestra.run.smithi080.stdout:checking for xfs/libxfs.h... no 2024-05-10T04:24:51.517 INFO:teuthology.orchestra.run.smithi080.stdout:checking whether xlog_assign_lsn is declared... no 2024-05-10T04:24:51.570 INFO:teuthology.orchestra.run.smithi080.stdout:checking for xfs/xqm.h... yes 2024-05-10T04:24:51.651 INFO:teuthology.orchestra.run.smithi080.stdout:checking xfsctl from xfs/xfs.h... ok 2024-05-10T04:24:51.697 INFO:teuthology.orchestra.run.smithi080.stdout:checking xfs/handle.h usability... yes 2024-05-10T04:24:51.712 INFO:teuthology.orchestra.run.smithi080.stdout:checking xfs/handle.h presence... yes 2024-05-10T04:24:51.713 INFO:teuthology.orchestra.run.smithi080.stdout:checking for xfs/handle.h... yes 2024-05-10T04:24:51.773 INFO:teuthology.orchestra.run.smithi080.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-05-10T04:24:51.830 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/acl.h usability... yes 2024-05-10T04:24:51.851 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/acl.h presence... yes 2024-05-10T04:24:51.851 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/acl.h... yes 2024-05-10T04:24:51.906 INFO:teuthology.orchestra.run.smithi080.stdout:checking acl/libacl.h usability... yes 2024-05-10T04:24:51.925 INFO:teuthology.orchestra.run.smithi080.stdout:checking acl/libacl.h presence... yes 2024-05-10T04:24:51.925 INFO:teuthology.orchestra.run.smithi080.stdout:checking for acl/libacl.h... yes 2024-05-10T04:24:51.986 INFO:teuthology.orchestra.run.smithi080.stdout:checking for acl_init in -lacl... yes 2024-05-10T04:24:52.037 INFO:teuthology.orchestra.run.smithi080.stdout:checking gdbm-ndbm.h usability... no 2024-05-10T04:24:52.062 INFO:teuthology.orchestra.run.smithi080.stdout:checking gdbm-ndbm.h presence... no 2024-05-10T04:24:52.062 INFO:teuthology.orchestra.run.smithi080.stdout:checking for gdbm-ndbm.h... no 2024-05-10T04:24:52.105 INFO:teuthology.orchestra.run.smithi080.stdout:checking gdbm/ndbm.h usability... no 2024-05-10T04:24:52.129 INFO:teuthology.orchestra.run.smithi080.stdout:checking gdbm/ndbm.h presence... no 2024-05-10T04:24:52.130 INFO:teuthology.orchestra.run.smithi080.stdout:checking for gdbm/ndbm.h... no 2024-05-10T04:24:52.173 INFO:teuthology.orchestra.run.smithi080.stdout:checking ndbm.h usability... no 2024-05-10T04:24:52.198 INFO:teuthology.orchestra.run.smithi080.stdout:checking ndbm.h presence... no 2024-05-10T04:24:52.198 INFO:teuthology.orchestra.run.smithi080.stdout:checking for ndbm.h... no 2024-05-10T04:24:52.246 INFO:teuthology.orchestra.run.smithi080.stdout:checking libaio.h usability... yes 2024-05-10T04:24:52.268 INFO:teuthology.orchestra.run.smithi080.stdout:checking libaio.h presence... yes 2024-05-10T04:24:52.268 INFO:teuthology.orchestra.run.smithi080.stdout:checking for libaio.h... yes 2024-05-10T04:24:52.313 INFO:teuthology.orchestra.run.smithi080.stdout:checking liburing.h usability... no 2024-05-10T04:24:52.338 INFO:teuthology.orchestra.run.smithi080.stdout:checking liburing.h presence... no 2024-05-10T04:24:52.338 INFO:teuthology.orchestra.run.smithi080.stdout:checking for liburing.h... no 2024-05-10T04:24:52.381 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/capability.h usability... no 2024-05-10T04:24:52.407 INFO:teuthology.orchestra.run.smithi080.stdout:checking sys/capability.h presence... no 2024-05-10T04:24:52.407 INFO:teuthology.orchestra.run.smithi080.stdout:checking for sys/capability.h... no 2024-05-10T04:24:52.452 INFO:teuthology.orchestra.run.smithi080.stdout:checking linux/fiemap.h usability... yes 2024-05-10T04:24:52.469 INFO:teuthology.orchestra.run.smithi080.stdout:checking linux/fiemap.h presence... yes 2024-05-10T04:24:52.469 INFO:teuthology.orchestra.run.smithi080.stdout:checking for linux/fiemap.h... yes 2024-05-10T04:24:52.531 INFO:teuthology.orchestra.run.smithi080.stdout:checking for fallocate... yes 2024-05-10T04:24:52.594 INFO:teuthology.orchestra.run.smithi080.stdout:checking for open_by_handle_at... yes 2024-05-10T04:24:52.640 INFO:teuthology.orchestra.run.smithi080.stdout:checking linux/fs.h usability... yes 2024-05-10T04:24:52.658 INFO:teuthology.orchestra.run.smithi080.stdout:checking linux/fs.h presence... yes 2024-05-10T04:24:52.658 INFO:teuthology.orchestra.run.smithi080.stdout:checking for linux/fs.h... yes 2024-05-10T04:24:52.701 INFO:teuthology.orchestra.run.smithi080.stdout:checking btrfsutil.h usability... no 2024-05-10T04:24:52.725 INFO:teuthology.orchestra.run.smithi080.stdout:checking btrfsutil.h presence... no 2024-05-10T04:24:52.725 INFO:teuthology.orchestra.run.smithi080.stdout:checking for btrfsutil.h... no 2024-05-10T04:24:52.789 INFO:teuthology.orchestra.run.smithi080.stdout:checking for copy_file_range... yes 2024-05-10T04:24:52.854 INFO:teuthology.orchestra.run.smithi080.stdout:checking for SEEK_DATA... yes 2024-05-10T04:24:52.936 INFO:teuthology.orchestra.run.smithi080.stdout:checking for BMV_OF_SHARED... yes 2024-05-10T04:24:53.002 INFO:teuthology.orchestra.run.smithi080.stdout:checking for nftw... yes 2024-05-10T04:24:53.065 INFO:teuthology.orchestra.run.smithi080.stdout:checking for RLIMIT_NOFILE... yes 2024-05-10T04:24:53.120 INFO:teuthology.orchestra.run.smithi080.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-05-10T04:24:53.182 INFO:teuthology.orchestra.run.smithi080.stdout:checking for FICLONE... yes 2024-05-10T04:24:53.244 INFO:teuthology.orchestra.run.smithi080.stdout:checking for renameat2... yes 2024-05-10T04:24:53.306 INFO:teuthology.orchestra.run.smithi080.stdout:checking for reallocarray... yes 2024-05-10T04:24:53.339 INFO:teuthology.orchestra.run.smithi080.stdout:checking for struct mount_attr... no 2024-05-10T04:24:53.417 INFO:teuthology.orchestra.run.smithi080.stdout:checking for struct btrfs_qgroup_limit... yes 2024-05-10T04:24:53.492 INFO:teuthology.orchestra.run.smithi080.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-05-10T04:24:53.567 INFO:teuthology.orchestra.run.smithi080.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-05-10T04:24:53.641 INFO:teuthology.orchestra.run.smithi080.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-05-10T04:24:53.717 INFO:teuthology.orchestra.run.smithi080.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-05-10T04:24:53.758 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:24:53.762 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:24:53.792 INFO:teuthology.orchestra.run.smithi080.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-05-10T04:24:53.869 INFO:teuthology.orchestra.run.smithi080.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-05-10T04:24:53.924 INFO:teuthology.orchestra.run.smithi080.stdout:checking linux/btrfs.h usability... yes 2024-05-10T04:24:53.941 INFO:teuthology.orchestra.run.smithi080.stdout:checking linux/btrfs.h presence... yes 2024-05-10T04:24:53.941 INFO:teuthology.orchestra.run.smithi080.stdout:checking for linux/btrfs.h... yes 2024-05-10T04:24:54.002 INFO:teuthology.orchestra.run.smithi080.stdout:checking linux/btrfs_tree.h usability... yes 2024-05-10T04:24:54.019 INFO:teuthology.orchestra.run.smithi080.stdout:checking linux/btrfs_tree.h presence... yes 2024-05-10T04:24:54.020 INFO:teuthology.orchestra.run.smithi080.stdout:checking for linux/btrfs_tree.h... yes 2024-05-10T04:24:54.094 INFO:teuthology.orchestra.run.smithi080.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2024-05-10T04:24:54.136 INFO:teuthology.orchestra.run.smithi080.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... no 2024-05-10T04:24:54.168 INFO:teuthology.orchestra.run.smithi080.stdout:configure: creating ./config.status 2024-05-10T04:24:55.072 INFO:teuthology.orchestra.run.smithi080.stdout:config.status: creating include/builddefs 2024-05-10T04:24:55.100 INFO:teuthology.orchestra.run.smithi080.stdout:config.status: creating include/config.h 2024-05-10T04:24:55.122 INFO:teuthology.orchestra.run.smithi080.stdout:config.status: executing libtool commands 2024-05-10T04:24:55.200 INFO:teuthology.orchestra.run.smithi080.stdout:Building include 2024-05-10T04:24:55.207 INFO:teuthology.orchestra.run.smithi080.stdout:Building lib 2024-05-10T04:24:55.213 INFO:teuthology.orchestra.run.smithi080.stdout: [LTDEP] 2024-05-10T04:24:55.432 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] dataascii.lo 2024-05-10T04:24:55.671 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] databin.lo 2024-05-10T04:24:55.906 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] datapid.lo 2024-05-10T04:24:56.093 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] file_lock.lo 2024-05-10T04:24:56.331 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] forker.lo 2024-05-10T04:24:56.549 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] pattern.lo 2024-05-10T04:24:56.762 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] open_flags.lo 2024-05-10T04:24:56.990 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] random_range.lo 2024-05-10T04:24:57.305 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] string_to_tokens.lo 2024-05-10T04:24:57.490 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] str_to_bytes.lo 2024-05-10T04:24:57.706 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] tlibio.lo 2024-05-10T04:24:58.026 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] write_log.lo 2024-05-10T04:24:58.357 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] random.lo 2024-05-10T04:24:58.555 INFO:teuthology.orchestra.run.smithi080.stdout: [LD] 2024-05-10T04:24:58.688 INFO:teuthology.orchestra.run.smithi080.stdout:Building ltp 2024-05-10T04:24:58.694 INFO:teuthology.orchestra.run.smithi080.stdout: [DEP] 2024-05-10T04:24:58.891 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] doio 2024-05-10T04:24:59.642 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] fsstress 2024-05-10T04:25:01.022 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] fsx 2024-05-10T04:25:01.965 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] growfiles 2024-05-10T04:25:02.560 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] iogen 2024-05-10T04:25:03.011 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aio-stress 2024-05-10T04:25:03.518 INFO:teuthology.orchestra.run.smithi080.stdout:Building src 2024-05-10T04:25:03.527 INFO:teuthology.orchestra.run.smithi080.stdout: [DEP] 2024-05-10T04:25:06.169 INFO:teuthology.orchestra.run.smithi080.stdout: [DEP] 2024-05-10T04:25:06.220 INFO:teuthology.orchestra.run.smithi080.stdout: [DEP] 2024-05-10T04:25:06.236 INFO:teuthology.orchestra.run.smithi080.stdout: [DEP] 2024-05-10T04:25:06.582 INFO:teuthology.orchestra.run.smithi080.stdout: [DEP] 2024-05-10T04:25:06.622 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] dirstress 2024-05-10T04:25:06.960 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] fill 2024-05-10T04:25:07.213 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] fill2 2024-05-10T04:25:07.539 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] getpagesize 2024-05-10T04:25:07.771 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] holes 2024-05-10T04:25:08.067 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] lstat64 2024-05-10T04:25:08.346 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] nametest 2024-05-10T04:25:08.680 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] permname 2024-05-10T04:25:08.979 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] randholes 2024-05-10T04:25:09.325 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] runas 2024-05-10T04:25:09.599 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] truncfile 2024-05-10T04:25:09.879 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] usemem 2024-05-10T04:25:10.128 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] mmapcat 2024-05-10T04:25:10.378 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] append_reader 2024-05-10T04:25:10.624 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] append_writer 2024-05-10T04:25:10.875 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] dirperf 2024-05-10T04:25:11.213 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] metaperf 2024-05-10T04:25:11.560 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] devzero 2024-05-10T04:25:11.834 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] feature 2024-05-10T04:25:12.152 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] alloc 2024-05-10T04:25:12.470 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] fault 2024-05-10T04:25:12.733 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] fstest 2024-05-10T04:25:13.068 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_access_root 2024-05-10T04:25:13.321 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] godown 2024-05-10T04:25:13.591 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] resvtest 2024-05-10T04:25:13.878 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] writemod 2024-05-10T04:25:14.121 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] writev_on_pagefault 2024-05-10T04:25:14.378 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] makeextents 2024-05-10T04:25:14.656 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] itrash 2024-05-10T04:25:14.909 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] rename 2024-05-10T04:25:15.148 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] multi_open_unlink 2024-05-10T04:25:15.411 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] unwritten_sync 2024-05-10T04:25:15.693 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] genhashnames 2024-05-10T04:25:15.975 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_holes 2024-05-10T04:25:16.217 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_mmap_writev 2024-05-10T04:25:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_truncate_cmtime 2024-05-10T04:25:16.719 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] dirhash_collide 2024-05-10T04:25:16.999 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_rename_overwrite 2024-05-10T04:25:17.237 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] holetest 2024-05-10T04:25:17.551 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_truncate_self 2024-05-10T04:25:17.788 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] af_unix 2024-05-10T04:25:18.039 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_mmap_stale_pmd 2024-05-10T04:25:18.289 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_mmap_cow_race 2024-05-10T04:25:18.551 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_mmap_fallocate 2024-05-10T04:25:18.799 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] fsync-err 2024-05-10T04:25:19.080 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_mmap_write_ro 2024-05-10T04:25:19.329 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_ext4_dax_journal_corruption 2024-05-10T04:25:19.587 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_ext4_dax_inline_corruption 2024-05-10T04:25:19.840 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_ofd_locks 2024-05-10T04:25:20.134 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_mmap_collision 2024-05-10T04:25:20.430 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] mmap-write-concurrent 2024-05-10T04:25:20.698 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_get_file_time 2024-05-10T04:25:20.943 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_create_short_dirs 2024-05-10T04:25:21.206 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_create_long_dirs 2024-05-10T04:25:21.468 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_enospc 2024-05-10T04:25:21.749 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_mmap_writev_overlap 2024-05-10T04:25:22.016 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] checkpoint_journal 2024-05-10T04:25:22.268 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] mmap-rw-fault 2024-05-10T04:25:22.552 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] allocstale 2024-05-10T04:25:22.821 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_mmap_cow_memory_failure 2024-05-10T04:25:23.094 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] fake-dump-rootino 2024-05-10T04:25:23.343 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] dio-buf-fault 2024-05-10T04:25:23.596 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] rewinddir-test 2024-05-10T04:25:23.862 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] readdir-while-renames 2024-05-10T04:25:23.868 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:25:23.872 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:25:24.127 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] xfsctl 2024-05-10T04:25:24.414 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] bstat 2024-05-10T04:25:24.716 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_mtab 2024-05-10T04:25:24.997 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] getdevicesize 2024-05-10T04:25:25.235 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] preallo_rw_pattern_reader 2024-05-10T04:25:25.495 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] preallo_rw_pattern_writer 2024-05-10T04:25:25.754 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] ftrunc 2024-05-10T04:25:26.001 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] trunc 2024-05-10T04:25:26.259 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] fs_perms 2024-05-10T04:25:26.521 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] testx 2024-05-10T04:25:26.749 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] looptest 2024-05-10T04:25:27.040 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] locktest 2024-05-10T04:25:27.440 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] unwritten_mmap 2024-05-10T04:25:27.703 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] bulkstat_unlink_test 2024-05-10T04:25:28.003 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] deduperace 2024-05-10T04:25:28.296 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] bulkstat_unlink_test_modified 2024-05-10T04:25:28.591 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_dir_offset 2024-05-10T04:25:28.838 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_futimens 2024-05-10T04:25:29.078 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_immutable 2024-05-10T04:25:29.771 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] stale_handle 2024-05-10T04:25:30.043 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] pwrite_mmap_blocked 2024-05-10T04:25:30.296 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_dir_offset2 2024-05-10T04:25:30.587 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] seek_sanity_test 2024-05-10T04:25:31.099 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] seek_copy_test 2024-05-10T04:25:31.374 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_readdir_1 2024-05-10T04:25:31.621 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_readdir_2 2024-05-10T04:25:31.870 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] fsync-tester 2024-05-10T04:25:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] nsexec 2024-05-10T04:25:32.488 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] cloner 2024-05-10T04:25:32.764 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] renameat2 2024-05-10T04:25:33.031 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_getcwd 2024-05-10T04:25:33.285 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] e4compact 2024-05-10T04:25:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] test-nextquota 2024-05-10T04:25:33.854 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] punch-alternating 2024-05-10T04:25:34.126 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] attr-list-by-handle-cursor-test 2024-05-10T04:25:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] listxattr 2024-05-10T04:25:34.638 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] dio-interleaved 2024-05-10T04:25:34.897 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_dir_type 2024-05-10T04:25:35.152 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] dio-invalidate-cache 2024-05-10T04:25:35.453 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] stat_test 2024-05-10T04:25:35.844 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_encrypted_d_revalidate 2024-05-10T04:25:36.108 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] attr_replace_test 2024-05-10T04:25:36.371 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] swapon 2024-05-10T04:25:36.635 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] mkswap 2024-05-10T04:25:36.883 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_attr_corruption 2024-05-10T04:25:37.131 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_open_tmpfiles 2024-05-10T04:25:37.414 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] fscrypt-crypt-util 2024-05-10T04:25:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] bulkstat_null_ocount 2024-05-10T04:25:38.401 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] splice-test 2024-05-10T04:25:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] chprojid_fail 2024-05-10T04:25:38.945 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] detached_mounts_propagation 2024-05-10T04:25:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] ext4_resize 2024-05-10T04:25:39.481 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_readdir_3 2024-05-10T04:25:39.773 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] splice2pipe 2024-05-10T04:25:40.037 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] uuid_ioctl 2024-05-10T04:25:40.290 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_snapshot_deleted_subvolume 2024-05-10T04:25:40.555 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] fiemap-fault 2024-05-10T04:25:40.811 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] fiemap-tester 2024-05-10T04:25:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_stripealign 2024-05-10T04:25:41.428 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] open_by_handle 2024-05-10T04:25:41.777 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_mmap_dio 2024-05-10T04:25:42.039 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] xfsfind 2024-05-10T04:25:42.332 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] t_reflink_read_race 2024-05-10T04:25:42.622 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] fssum 2024-05-10T04:25:43.150 INFO:teuthology.orchestra.run.smithi080.stdout:Building log-writes 2024-05-10T04:25:43.160 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] replay-log 2024-05-10T04:25:43.574 INFO:teuthology.orchestra.run.smithi080.stdout:Building perf 2024-05-10T04:25:43.579 INFO:teuthology.orchestra.run.smithi080.stdout:Building aio-dio-regress 2024-05-10T04:25:43.590 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aio-dio-append-write-fallocate-race 2024-05-10T04:25:43.867 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aio-dio-fcntl-race 2024-05-10T04:25:44.131 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aio-dio-subblock-eof-read 2024-05-10T04:25:44.378 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aio-dio-append-write-read-race 2024-05-10T04:25:44.658 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aio-dio-invalidate-readahead 2024-05-10T04:25:44.925 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aio-dio-write-verify 2024-05-10T04:25:45.224 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-05-10T04:25:45.460 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aio-last-ref-held-by-io 2024-05-10T04:25:45.735 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aio-dio-cycle-write 2024-05-10T04:25:46.023 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aio-dio-extend-stat 2024-05-10T04:25:46.291 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-05-10T04:25:46.526 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aio-dio-hole-filling-race 2024-05-10T04:25:46.778 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aiocp 2024-05-10T04:25:47.107 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aio-dio-invalidate-failure 2024-05-10T04:25:47.369 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aiodio_sparse2 2024-05-10T04:25:47.686 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aio-dio-cow-race 2024-05-10T04:25:47.943 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] aio-dio-eof-race 2024-05-10T04:25:48.228 INFO:teuthology.orchestra.run.smithi080.stdout:Building vfs 2024-05-10T04:25:48.238 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] vfstest 2024-05-10T04:25:50.244 INFO:teuthology.orchestra.run.smithi080.stdout: [CC] mount-idmapped 2024-05-10T04:25:50.711 INFO:teuthology.orchestra.run.smithi080.stdout:Building m4 2024-05-10T04:25:50.718 INFO:teuthology.orchestra.run.smithi080.stdout:Building common 2024-05-10T04:25:50.725 INFO:teuthology.orchestra.run.smithi080.stdout:Building tests 2024-05-10T04:25:50.735 INFO:teuthology.orchestra.run.smithi080.stdout:Building perf 2024-05-10T04:25:50.745 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/perf/group.list 2024-05-10T04:25:50.774 INFO:teuthology.orchestra.run.smithi080.stdout:Building ext4 2024-05-10T04:25:50.783 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/ext4/group.list 2024-05-10T04:25:50.876 INFO:teuthology.orchestra.run.smithi080.stdout:Building ocfs2 2024-05-10T04:25:50.886 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/ocfs2/group.list 2024-05-10T04:25:50.919 INFO:teuthology.orchestra.run.smithi080.stdout:Building overlay 2024-05-10T04:25:50.929 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/overlay/group.list 2024-05-10T04:25:51.027 INFO:teuthology.orchestra.run.smithi080.stdout:Building cifs 2024-05-10T04:25:51.037 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/cifs/group.list 2024-05-10T04:25:51.068 INFO:teuthology.orchestra.run.smithi080.stdout:Building generic 2024-05-10T04:25:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/generic/group.list 2024-05-10T04:25:51.326 INFO:teuthology.orchestra.run.smithi080.stdout:Building shared 2024-05-10T04:25:51.335 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/shared/group.list 2024-05-10T04:25:51.377 INFO:teuthology.orchestra.run.smithi080.stdout:Building xfs 2024-05-10T04:25:51.389 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/xfs/group.list 2024-05-10T04:25:51.630 INFO:teuthology.orchestra.run.smithi080.stdout:Building f2fs 2024-05-10T04:25:51.640 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/f2fs/group.list 2024-05-10T04:25:51.682 INFO:teuthology.orchestra.run.smithi080.stdout:Building udf 2024-05-10T04:25:51.691 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/udf/group.list 2024-05-10T04:25:51.719 INFO:teuthology.orchestra.run.smithi080.stdout:Building ceph 2024-05-10T04:25:51.729 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/ceph/group.list 2024-05-10T04:25:51.764 INFO:teuthology.orchestra.run.smithi080.stdout:Building nfs 2024-05-10T04:25:51.774 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/nfs/group.list 2024-05-10T04:25:51.809 INFO:teuthology.orchestra.run.smithi080.stdout:Building btrfs 2024-05-10T04:25:51.820 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/btrfs/group.list 2024-05-10T04:25:51.972 INFO:teuthology.orchestra.run.smithi080.stdout:Building tmpfs 2024-05-10T04:25:51.982 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/tmpfs/group.list 2024-05-10T04:25:52.015 INFO:teuthology.orchestra.run.smithi080.stdout:Building selftest 2024-05-10T04:25:52.025 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/selftest/group.list 2024-05-10T04:25:52.060 DEBUG:teuthology.orchestra.run.smithi080:> (cd /tmp/tmp.ujcZfho4Bmxfstests-dev && exec sudo make install) 2024-05-10T04:25:52.147 INFO:teuthology.orchestra.run.smithi080.stdout:Building include 2024-05-10T04:25:52.154 INFO:teuthology.orchestra.run.smithi080.stdout:Building lib 2024-05-10T04:25:52.162 INFO:teuthology.orchestra.run.smithi080.stdout:Building ltp 2024-05-10T04:25:52.170 INFO:teuthology.orchestra.run.smithi080.stdout:Building src 2024-05-10T04:25:52.231 INFO:teuthology.orchestra.run.smithi080.stdout:Building log-writes 2024-05-10T04:25:52.238 INFO:teuthology.orchestra.run.smithi080.stdout:Building perf 2024-05-10T04:25:52.245 INFO:teuthology.orchestra.run.smithi080.stdout:Building aio-dio-regress 2024-05-10T04:25:52.253 INFO:teuthology.orchestra.run.smithi080.stdout:Building vfs 2024-05-10T04:25:52.261 INFO:teuthology.orchestra.run.smithi080.stdout:Building m4 2024-05-10T04:25:52.268 INFO:teuthology.orchestra.run.smithi080.stdout:Building common 2024-05-10T04:25:52.275 INFO:teuthology.orchestra.run.smithi080.stdout:Building tests 2024-05-10T04:25:52.285 INFO:teuthology.orchestra.run.smithi080.stdout:Building perf 2024-05-10T04:25:52.295 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/perf/group.list 2024-05-10T04:25:52.324 INFO:teuthology.orchestra.run.smithi080.stdout:Building ext4 2024-05-10T04:25:52.334 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/ext4/group.list 2024-05-10T04:25:52.425 INFO:teuthology.orchestra.run.smithi080.stdout:Building ocfs2 2024-05-10T04:25:52.435 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/ocfs2/group.list 2024-05-10T04:25:52.468 INFO:teuthology.orchestra.run.smithi080.stdout:Building overlay 2024-05-10T04:25:52.477 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/overlay/group.list 2024-05-10T04:25:52.576 INFO:teuthology.orchestra.run.smithi080.stdout:Building cifs 2024-05-10T04:25:52.586 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/cifs/group.list 2024-05-10T04:25:52.617 INFO:teuthology.orchestra.run.smithi080.stdout:Building generic 2024-05-10T04:25:52.628 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/generic/group.list 2024-05-10T04:25:52.866 INFO:teuthology.orchestra.run.smithi080.stdout:Building shared 2024-05-10T04:25:52.876 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/shared/group.list 2024-05-10T04:25:52.919 INFO:teuthology.orchestra.run.smithi080.stdout:Building xfs 2024-05-10T04:25:52.930 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/xfs/group.list 2024-05-10T04:25:53.167 INFO:teuthology.orchestra.run.smithi080.stdout:Building f2fs 2024-05-10T04:25:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/f2fs/group.list 2024-05-10T04:25:53.220 INFO:teuthology.orchestra.run.smithi080.stdout:Building udf 2024-05-10T04:25:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/udf/group.list 2024-05-10T04:25:53.257 INFO:teuthology.orchestra.run.smithi080.stdout:Building ceph 2024-05-10T04:25:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/ceph/group.list 2024-05-10T04:25:53.302 INFO:teuthology.orchestra.run.smithi080.stdout:Building nfs 2024-05-10T04:25:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/nfs/group.list 2024-05-10T04:25:53.347 INFO:teuthology.orchestra.run.smithi080.stdout:Building btrfs 2024-05-10T04:25:53.358 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/btrfs/group.list 2024-05-10T04:25:53.507 INFO:teuthology.orchestra.run.smithi080.stdout:Building tmpfs 2024-05-10T04:25:53.516 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/tmpfs/group.list 2024-05-10T04:25:53.549 INFO:teuthology.orchestra.run.smithi080.stdout:Building selftest 2024-05-10T04:25:53.559 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/selftest/group.list 2024-05-10T04:25:53.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-05-10T04:25:53.592 INFO:teuthology.orchestra.run.smithi080.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-10T04:25:53.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-05-10T04:25:53.595 INFO:teuthology.orchestra.run.smithi080.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-10T04:25:53.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-05-10T04:25:53.599 INFO:teuthology.orchestra.run.smithi080.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-05-10T04:25:53.622 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-05-10T04:25:53.798 INFO:teuthology.orchestra.run.smithi080.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-05-10T04:25:53.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-05-10T04:25:53.852 INFO:teuthology.orchestra.run.smithi080.stdout:Building log-writes 2024-05-10T04:25:53.859 INFO:teuthology.orchestra.run.smithi080.stdout:Building perf 2024-05-10T04:25:53.866 INFO:teuthology.orchestra.run.smithi080.stdout:Building aio-dio-regress 2024-05-10T04:25:53.874 INFO:teuthology.orchestra.run.smithi080.stdout:Building vfs 2024-05-10T04:25:53.880 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake -C log-writes install 2024-05-10T04:25:53.882 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-05-10T04:25:53.906 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-05-10T04:25:53.929 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake -C perf install 2024-05-10T04:25:53.932 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-05-10T04:25:53.955 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2024-05-10T04:25:54.017 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-05-10T04:25:54.020 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-05-10T04:25:54.043 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aiocp aio-dio-invalidate-failure aiodio_sparse2 aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2024-05-10T04:25:54.142 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:25:54.146 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:25:54.193 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake -C vfs install 2024-05-10T04:25:54.196 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-05-10T04:25:54.219 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-05-10T04:25:54.251 INFO:teuthology.orchestra.run.smithi080.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-05-10T04:25:54.275 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-fault fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-05-10T04:25:57.409 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-05-10T04:25:57.653 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-05-10T04:25:57.709 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-05-10T04:25:57.711 INFO:teuthology.orchestra.run.smithi080.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-10T04:25:57.711 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-05-10T04:25:57.714 INFO:teuthology.orchestra.run.smithi080.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-05-10T04:25:57.737 INFO:teuthology.orchestra.run.smithi080.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-05-10T04:25:58.129 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-05-10T04:25:58.131 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/btrfs/ install 2024-05-10T04:25:58.136 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/btrfs/group.list 2024-05-10T04:25:58.284 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-05-10T04:25:58.308 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 320 330 /var/lib/xfstests/tests/btrfs 2024-05-10T04:26:00.739 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-05-10T04:26:00.763 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 012.out 175.out 193.out 240.out 282.out 252.out 280.out 140.out 308.out 208.out 202.out 008.out 040.out 304.out 004.out 233.out 194.out 234.out 295.out 174.out 143.out 033.out 082.out 148.out 088.out 089.out 296.out 137.out 096.out 125.out 256.out 110.out 085.out 181.out 152.out 315.out 015.out 192.out 075.out 178.out 052.out 228.out 128.out 276.out 225.out 273.out 251.out 176.out 209.out 109.out 151.out 206.out 215.out 115.out 250.out 191.out 281.out 266.out 051.out 244.out 219.out 119.out 019.out 232.out 230.out 120.out 020.out 102.out 002.out 171.out 261.out 135.out 317.out 156.out 217.out 017.out 046.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 177.out 029.out 229.out 103.out 254.out 111.out 011.out 243.out 183.out 043.out 134.out 170.out 078.out 095.out 034.out 065.out 161.out 316.out 216.out 116.out 055.out 155.out 118.out 310.out 301.out 010.out 238.out 114.out 237.out 097.out 160.out 091.out 274.out 264.out 061.out 083.out 300.out 200.out 100.out 025.out 258.out 286.out 185.out 269.out 039.out 045.out 222.out 298.out 169.out 098.out 290.out 080.out 070.out 060.out 306.out 207.out 106.out 009.out 167.out 133.out 117.out 236.out 311.out 246.out 211.out 158.out 312.out 182.out 066.out 146.out 204.out 104.out 059.out 186.out 086.out 241.out 235.out 253.out 165.out 124.out 303.out 024.out 172.out 063.out 058.out 262.out 042.out 297.out 153.out 014.out 283.out 199.out 278.out 041.out 247.out 309.out 053.out 279.out 157.out 164.out 239.out 139.out 267.out 141.out 314.out 212.out 214.out 074.out 223.out 150.out 132.out 179.out 023.out 032.out 277.out 136.out 005.out 036.out 198.out 108.out 144.out 190.out 173.out 050.out 305.out 205.out 105.out 257.out 291.out 187.out 265.out 285.out 260.out 123.out 056.out 201.out 101.out 001.out 287.out 142.out 037.out 231.out 081.out 069.out 163.out 044.out 131.out 213.out 113.out 031.out 027.out 057.out 272.out 268.out 184.out 259.out 210.out 330.out 067.out 227.out 197.out 263.out 127.out 071.out 076.out 292.out 130.out 073.out 099.out 092.out 030.out 203.out 003.out 035.out 245.out 122.out 145.out 159.out 249.out 166.out 022.out 289.out 006.out 284.out 255.out 302.out 090.out 224.out 154.out 271.out 149.out 064.out 077.out 218.out 307.out 018.out 047.out 168.out 007.out 293.out 093.out 079.out 054.out 049.out 226.out 138.out 126.out 313.out 026.out 016.out 180.out 270.out 013.out 188.out 299.out 275.out 221.out 087.out 294.out 121.out 112.out 094.out 021.out 195.out 028.out 107.out 248.out 162.out 147.out 288.out 196.out 242.out 189.out 320.out 220.out /var/lib/xfstests/tests/btrfs 2024-05-10T04:26:03.200 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/ceph/ install 2024-05-10T04:26:03.204 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/ceph/group.list 2024-05-10T04:26:03.239 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-05-10T04:26:03.261 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-05-10T04:26:03.315 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-05-10T04:26:03.338 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 005.out 003.out 004.out 001.out 002.out /var/lib/xfstests/tests/ceph 2024-05-10T04:26:03.392 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/cifs/ install 2024-05-10T04:26:03.396 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/cifs/group.list 2024-05-10T04:26:03.427 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-05-10T04:26:03.448 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-05-10T04:26:03.471 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-05-10T04:26:03.494 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-05-10T04:26:03.517 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/ext4/ install 2024-05-10T04:26:03.522 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/ext4/group.list 2024-05-10T04:26:03.612 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-05-10T04:26:03.634 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-05-10T04:26:04.164 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-05-10T04:26:04.187 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 059.out 049.out 032.out 039.out 005.out 308.out 036.out 008.out 026.out 021.out 050.out 040.out 305.out 006.out 035.out 017.out 054.out 002.out 033.out 301.out 004.out 046.out 025.out 047.out 307.out 302.out 020.out 013.out 031.out 015.out 306.out 048.out 038.out 052.out 037.out 029.out 042.out 027.out 044.out 304.out 016.out 303.out 058.out 003.out 034.out 055.out 053.out 009.out 043.out 018.out 010.out 057.out 022.out 014.out 045.out 056.out 271.out 012.out 051.out 011.out 041.out 024.out 030.out 019.out 007.out 028.out 023.out /var/lib/xfstests/tests/ext4 2024-05-10T04:26:04.740 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/f2fs/ install 2024-05-10T04:26:04.744 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/f2fs/group.list 2024-05-10T04:26:04.785 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-05-10T04:26:04.808 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-05-10T04:26:04.839 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-05-10T04:26:04.862 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-05-10T04:26:04.893 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/generic/ install 2024-05-10T04:26:04.899 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/generic/group.list 2024-05-10T04:26:05.138 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-05-10T04:26:05.161 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 741 742 743 /var/lib/xfstests/tests/generic 2024-05-10T04:26:10.849 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-05-10T04:26:10.872 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 050.out.default 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 050.cfg 035.cfg 504.out 040.out 304.out 104.out 537.out 234.out 695.out 683.out 337.out 385.out 248.out 696.out 088.out 097.out 202.out 137.out 002.out 110.out 468.out 181.out 571.out 567.out 592.out 675.out 282.out 342.out 728.out 628.out 607.out 428.out 498.out 407.out 328.out 128.out 171.out 065.out 577.out 127.out 620.out 273.out 520.out 265.out 647.out 595.out 020.out 006.out 732.out 264.out 466.out 600.out 311.out 532.out 191.out 471.out 619.out 519.out 419.out 319.out 177.out 219.out 119.out 019.out 727.out 372.out 733.out 134.out 686.out 312.out 718.out 638.out 716.out 616.out 516.out 416.out 316.out 216.out 163.out 118.out 338.out 287.out 238.out 439.out 533.out 295.out 138.out 263.out 277.out 156.out 160.out 175.out 691.out 061.out 630.out 379.out 322.out 039.out 222.out 098.out 330.out 290.out 480.out 706.out 606.out 506.out 406.out 591.out 106.out 447.out 217.out 133.out 117.out 411.out 017.out 547.out 542.out 485.out 370.out 442.out 737.out 188.out 490.out 713.out 199.out 147.out 624.out 281.out 424.out 413.out 324.out 082.out 224.out 355.out 124.out 672.out 278.out 058.out 741.out 384.out 366.out 042.out 626.out 497.out 593.out 456.out 709.out 247.out 509.out 568.out 309.out 391.out 356.out 341.out 094.out 482.out 555.out 712.out 241.out 077.out 614.out 514.out 414.out 314.out 212.out 440.out 114.out 014.out 056.out 671.out 041.out 667.out 340.out 358.out 572.out 586.out 240.out 279.out 549.out 092.out 267.out 633.out 280.out 321.out 140.out 348.out 608.out 258.out 508.out 221.out 208.out 433.out 670.out 604.out 476.out 087.out 116.out 192.out 739.out 068.out 233.out 016.out 639.out 236.out 540.out 539.out 164.out 587.out 339.out 033.out 294.out 352.out 458.out 489.out 139.out 652.out 651.out 178.out 646.out 390.out 399.out 220.out 552.out 036.out 357.out 169.out 064.out 193.out 186.out 452.out 069.out 513.out 252.out 167.out 724.out 306.out 687.out 663.out 375.out 622.out 184.out 697.out 095.out 725.out 109.out 174.out 625.out 736.out 297.out 488.out 425.out 673.out 496.out 325.out 551.out 225.out 636.out 125.out 715.out 085.out 544.out 415.out 152.out 658.out 246.out 578.out 451.out 015.out 392.out 682.out 472.out 684.out 642.out 550.out 052.out 534.out 444.out 276.out 437.out 450.out 463.out 227.out 349.out 644.out 674.out 487.out 292.out 457.out 615.out 395.out 515.out 389.out 315.out 344.out 215.out 115.out 381.out 351.out 250.out 656.out 594.out 475.out 518.out 244.out 637.out 336.out 566.out 579.out 705.out 144.out 505.out 205.out 136.out 408.out 363.out 176.out 198.out 723.out 108.out 008.out 680.out 605.out 405.out 305.out 105.out 005.out 367.out 523.out 650.out 719.out 323.out 685.out 562.out 382.out 183.out 388.out 123.out 158.out 688.out 432.out 237.out 481.out 574.out 044.out 332.out 661.out 027.out 232.out 478.out 612.out 584.out 462.out 597.out 350.out 693.out 483.out 051.out 099.out 660.out 063.out 435.out 561.out 214.out 668.out 648.out 362.out 387.out 194.out 438.out 076.out 289.out 699.out 545.out 690.out 284.out 302.out 548.out 560.out 521.out 474.out 707.out 151.out 477.out 307.out 655.out 256.out 007.out 448.out 380.out 093.out 479.out 426.out 150.out 326.out 226.out 454.out 126.out 026.out 580.out 460.out 694.out 347.out 645.out 361.out 528.out 564.out 283.out 455.out 089.out 585.out 162.out 083.out 743.out 288.out 197.out 396.out 576.out 143.out 298.out 148.out 360.out 431.out 543.out 270.out 261.out 734.out 251.out 657.out 692.out 331.out 443.out 046.out 726.out 729.out 378.out 484.out 062.out 529.out 429.out 662.out 526.out 329.out 165.out 229.out 590.out 103.out 254.out 441.out 371.out 243.out 368.out 486.out 223.out 132.out 179.out 669.out 023.out 032.out 398.out 296.out 190.out 173.out 470.out 491.out 257.out 185.out 153.out 731.out 374.out 583.out 285.out 631.out 701.out 260.out 359.out 501.out 649.out 301.out 101.out 635.out 494.out 623.out 266.out 142.out 047.out 231.out 535.out 613.out 206.out 131.out 213.out 730.out 423.out 013.out 031.out 556.out 182.out 057.out 272.out 268.out 627.out 573.out 527.out 430.out 569.out 427.out 259.out 449.out 327.out 397.out 067.out 493.out 230.out 071.out 445.out 632.out 130.out 434.out 703.out 603.out 503.out 030.out 203.out 003.out 055.out 742.out 722.out 291.out 245.out 522.out 422.out 394.out 159.out 598.out 524.out 122.out 689.out 166.out 022.out 346.out 045.out 499.out 654.out 565.out 700.out 154.out 676.out 570.out 618.out 401.out 018.out 418.out 024.out 218.out 575.out 377.out 317.out 172.out 168.out 034.out 293.out 530.out 386.out 079.out 469.out 054.out 059.out 049.out 738.out 239.out 228.out 721.out 149.out 621.out 343.out 180.out 253.out 421.out 403.out 255.out 512.out 412.out 121.out 538.out 112.out 021.out 195.out 028.out 554.out 070.out 060.out 596.out 720.out 634.out 196.out 525.out 242.out 420.out 679.out 320.out 120.out 629.out 702.out 602.out 502.out 402.out 369.out 102.out 717.out 617.out 517.out 417.out 365.out 492.out 072.out 029.out 038.out 473.out 084.out 129.out 711.out 262.out 611.out 511.out 066.out 211.out 111.out 037.out 011.out 659.out 187.out 170.out 053.out 155.out 043.out 299.out 376.out 714.out 157.out 710.out 610.out 536.out 510.out 274.out 410.out 310.out 601.out 210.out 313.out 201.out 010.out 001.out 141.out 495.out 048.out 665.out 589.out 113.out 074.out 581.out 459.out 145.out 641.out 436.out 209.out 091.out 081.out 664.out 075.out 653.out 271.out 500.out 400.out 300.out 200.out 100.out 464.out 461.out 559.out 354.out 286.out 541.out 086.out 269.out 546.out 677.out 698.out 553.out 563.out 446.out 090.out 080.out 708.out 609.out 507.out 409.out 308.out 207.out 107.out 009.out 643.out 557.out 453.out 666.out 078.out 364.out 582.out 735.out 383.out 704.out 588.out 146.out 334.out 404.out 558.out 189.out 204.out 353.out 004.out 345.out 467.out 012.out 681.out 249.out 465.out 335.out 531.out 073.out 235.out 135.out 025.out 303.out 275.out 318.out 678.out 373.out 161.out 640.out 096.out 393.out 333.out 599.out /var/lib/xfstests/tests/generic 2024-05-10T04:26:16.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/nfs/ install 2024-05-10T04:26:16.600 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/nfs/group.list 2024-05-10T04:26:16.633 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-05-10T04:26:16.657 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-05-10T04:26:16.680 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-05-10T04:26:16.703 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-05-10T04:26:16.727 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/ocfs2/ install 2024-05-10T04:26:16.731 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/ocfs2/group.list 2024-05-10T04:26:16.762 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-05-10T04:26:16.785 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-05-10T04:26:16.809 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-05-10T04:26:16.832 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-05-10T04:26:16.855 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/overlay/ install 2024-05-10T04:26:16.860 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/overlay/group.list 2024-05-10T04:26:16.957 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-05-10T04:26:16.980 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-05-10T04:26:17.783 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-05-10T04:26:17.807 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 026.out 041.out 024.out 064.out 037.out 107.out 079.out 054.out 049.out 082.out 056.out 021.out 008.out 104.out 004.out 075.out 066.out 012.out 028.out 009.out 033.out 083.out 070.out 025.out 035.out 020.out 102.out 002.out 040.out 045.out 117.out 017.out 072.out 068.out 006.out 062.out 038.out 084.out 052.out 063.out 011.out 029.out 048.out 034.out 065.out 043.out 036.out 116.out 055.out 059.out 110.out 010.out 001.out 106.out 074.out 115.out 057.out 071.out 111.out 061.out 051.out 067.out 100.out 019.out 105.out 086.out 023.out 032.out 039.out 005.out 080.out 060.out 050.out 108.out 007.out 016.out 046.out 085.out 044.out 101.out 047.out 069.out 113.out 013.out 031.out 027.out 078.out 058.out 042.out 018.out 112.out 073.out 030.out 103.out 003.out 015.out 053.out 109.out 076.out 022.out 077.out 081.out 114.out 014.out /var/lib/xfstests/tests/overlay 2024-05-10T04:26:18.614 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/perf/ install 2024-05-10T04:26:18.619 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/perf/group.list 2024-05-10T04:26:18.645 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-05-10T04:26:18.668 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-05-10T04:26:18.691 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-05-10T04:26:18.715 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-05-10T04:26:18.738 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/selftest/ install 2024-05-10T04:26:18.743 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/selftest/group.list 2024-05-10T04:26:18.772 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-05-10T04:26:18.795 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-05-10T04:26:18.856 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-05-10T04:26:18.880 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 005.out 003.out 006.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2024-05-10T04:26:18.941 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/shared/ install 2024-05-10T04:26:18.945 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/shared/group.list 2024-05-10T04:26:18.986 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-05-10T04:26:19.009 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-05-10T04:26:19.050 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-05-10T04:26:19.073 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2024-05-10T04:26:19.111 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/tmpfs/ install 2024-05-10T04:26:19.116 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/tmpfs/group.list 2024-05-10T04:26:19.147 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-05-10T04:26:19.170 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-05-10T04:26:19.193 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-05-10T04:26:19.215 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-05-10T04:26:19.239 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/udf/ install 2024-05-10T04:26:19.243 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/udf/group.list 2024-05-10T04:26:19.269 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-05-10T04:26:19.292 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-05-10T04:26:19.315 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-05-10T04:26:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-05-10T04:26:19.361 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/xfs/ install 2024-05-10T04:26:19.367 INFO:teuthology.orchestra.run.smithi080.stdout: [GROUP] /tmp/tmp.ujcZfho4Bmxfstests-dev/tests/xfs/group.list 2024-05-10T04:26:19.602 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-05-10T04:26:19.625 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-05-10T04:26:24.247 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:26:24.252 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:26:24.959 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-05-10T04:26:24.982 INFO:teuthology.orchestra.run.smithi080.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.64 216.out.classic 071.out.32 216.out.64mblog 216.cfg 033.cfg 104.out 004.out 287.out 537.out 055.out 295.out 337.out 385.out 248.out 602.out 088.out 097.out 202.out 137.out 002.out 110.out 468.out 181.out 571.out 264.out 765.out 592.out 282.out 342.out 072.out 728.out 178.out 769.out 428.out 498.out 507.out 407.out 328.out 128.out 171.out 065.out 127.out 046.out 273.out 520.out 265.out 331.out 446.out 595.out 506.out 020.out 274.out 732.out 466.out 600.out 532.out 191.out 111.out 432.out 519.out 011.out 419.out 319.out 246.out 219.out 119.out 019.out 727.out 372.out 547.out 134.out 078.out 312.out 034.out 757.out 716.out 161.out 516.out 416.out 316.out 026.out 116.out 438.out 118.out 338.out 238.out 533.out 500.out 138.out 474.out 263.out 497.out 559.out 160.out 175.out 291.out 066.out 722.out 061.out 239.out 047.out 522.out 772.out 768.out 530.out 379.out 322.out 039.out 173.out 098.out 290.out 480.out 060.out 406.out 591.out 106.out 006.out 454.out 387.out 217.out 117.out 411.out 211.out 485.out 781.out 442.out 713.out 199.out 147.out 177.out 281.out 424.out 156.out 771.out 324.out 082.out 224.out 124.out 024.out 278.out 058.out 741.out 384.out 366.out 042.out 593.out 799.out 456.out 473.out 770.out 709.out 247.out 409.out 568.out 209.out 441.out 740.out 356.out 766.out 341.out 094.out 189.out 241.out 077.out 081.out 414.out 314.out 440.out 114.out 381.out 056.out 041.out 277.out 340.out 358.out 572.out 393.out 586.out 240.out 549.out 092.out 267.out 280.out 434.out 140.out 708.out 258.out 185.out 508.out 221.out 057.out 308.out 208.out 433.out 792.out 604.out 040.out 318.out 373.out 018.out 793.out 333.out 599.out 476.out 087.out 192.out 739.out 068.out 233.out 016.out 236.out 540.out 539.out 279.out 566.out 494.out 439.out 587.out 339.out 294.out 458.out 489.out 139.out 790.out 399.out 552.out 763.out 176.out 017.out 169.out 777.out 580.out 193.out 186.out 452.out 069.out 252.out 751.out 376.out 306.out 206.out 352.out 794.out 348.out 394.out 184.out 095.out 725.out 109.out 174.out 482.out 283.out 736.out 297.out 425.out 496.out 325.out 551.out 225.out 125.out 715.out 789.out 086.out 152.out 774.out 444.out 451.out 015.out 392.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 276.out 437.out 450.out 744.out 043.out 764.out 349.out 775.out 487.out 762.out 457.out 795.out 558.out 544.out 515.out 415.out 389.out 315.out 344.out 215.out 115.out 542.out 250.out 594.out 475.out 536.out 030.out 244.out 336.out 150.out 579.out 144.out 505.out 205.out 136.out 363.out 036.out 198.out 723.out 108.out 008.out 390.out 605.out 050.out 405.out 305.out 105.out 005.out 367.out 523.out 761.out 351.out 719.out 323.out 562.out 382.out 183.out 570.out 388.out 527.out 158.out 785.out 237.out 481.out 760.out 227.out 163.out 044.out 332.out 796.out 027.out 232.out 038.out 584.out 462.out 220.out 597.out 350.out 293.out 212.out 471.out 483.out 499.out 051.out 514.out 012.out 431.out 063.out 565.out 561.out 780.out 214.out 076.out 343.out 074.out 758.out 362.out 194.out 567.out 289.out 574.out 284.out 302.out 548.out 560.out 166.out 461.out 750.out 151.out 307.out 256.out 786.out 007.out 448.out 251.out 380.out 093.out 526.out 479.out 426.out 326.out 226.out 413.out 126.out 313.out 555.out 773.out 460.out 133.out 488.out 347.out 477.out 361.out 528.out 564.out 748.out 395.out 089.out 747.out 585.out 162.out 743.out 288.out 197.out 767.out 396.out 576.out 145.out 143.out 588.out 148.out 360.out 543.out 270.out 261.out 734.out 045.out 292.out 304.out 443.out 726.out 729.out 378.out 048.out 062.out 073.out 529.out 429.out 403.out 329.out 229.out 590.out 103.out 254.out 423.out 371.out 234.out 368.out 486.out 223.out 132.out 179.out 023.out 459.out 032.out 798.out 778.out 180.out 398.out 296.out 752.out 190.out 470.out 484.out 491.out 455.out 749.out 187.out 188.out 153.out 731.out 782.out 374.out 583.out 285.out 788.out 260.out 359.out 501.out 401.out 581.out 301.out 101.out 266.out 142.out 377.out 231.out 535.out 513.out 554.out 131.out 213.out 730.out 113.out 013.out 031.out 435.out 182.out 755.out 272.out 268.out 754.out 573.out 742.out 430.out 569.out 427.out 259.out 449.out 327.out 330.out 067.out 493.out 123.out 230.out 445.out 130.out 370.out 603.out 503.out 303.out 203.out 003.out 355.out 035.out 245.out 724.out 787.out 745.out 422.out 222.out 159.out 598.out 524.out 122.out 022.out 346.out 779.out 490.out 375.out 154.out 718.out 149.out 518.out 418.out 465.out 218.out 575.out 172.out 168.out 386.out 079.out 469.out 054.out 059.out 049.out 738.out 228.out 721.out 545.out 357.out 521.out 253.out 421.out 712.out 299.out 321.out 255.out 512.out 412.out 085.out 121.out 538.out 112.out 021.out 195.out 167.out 028.out 397.out 365.out 070.out 720.out 243.out 196.out 525.out 242.out 420.out 478.out 320.out 447.out 120.out 502.out 402.out 369.out 102.out 717.out 606.out 517.out 417.out 317.out 164.out 492.out 759.out 099.out 737.out 084.out 129.out 711.out 262.out 511.out 025.out 029.out 311.out 783.out 170.out 053.out 155.out 756.out 714.out 157.out 710.out 510.out 410.out 310.out 601.out 210.out 037.out 201.out 010.out 001.out 141.out 495.out 589.out 753.out 014.out 797.out 436.out 091.out 746.out 083.out 800.out 271.out 064.out 400.out 300.out 200.out 100.out 464.out 577.out 354.out 286.out 541.out 269.out 546.out 553.out 563.out 298.out 596.out 090.out 080.out 791.out 607.out 509.out 408.out 309.out 207.out 107.out 009.out 391.out 557.out 453.out 364.out 582.out 735.out 383.out 146.out 334.out 504.out 404.out 776.out 204.out 353.out 733.out 345.out 467.out 249.out 335.out 531.out 235.out 784.out 257.out 556.out 135.out 165.out 275.out /var/lib/xfstests/tests/xfs 2024-05-10T04:26:30.359 INFO:teuthology.orchestra.run.smithi080.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-05-10T04:26:30.383 INFO:teuthology.orchestra.run.smithi080.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-05-10T04:26:30.405 INFO:teuthology.orchestra.run.smithi080.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-05-10T04:26:30.428 INFO:teuthology.orchestra.run.smithi080.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-05-10T04:26:30.459 INFO:tasks.cephfs.test_acls:client is kernel mounted 2024-05-10T04:26:30.459 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-10T04:26:30.460 DEBUG:teuthology.orchestra.run.smithi080:running tests for ACLs from xfstests-dev> (cd /tmp/tmp.ujcZfho4Bmxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-05-10T04:26:31.043 INFO:teuthology.orchestra.run.smithi080.stdout:FSTYP -- ceph 2024-05-10T04:26:31.055 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM -- Linux/x86_64 smithi080 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 14:14:33 UTC 2024 2024-05-10T04:26:31.056 INFO:teuthology.orchestra.run.smithi080.stdout:MKFS_OPTIONS -- 172.21.15.80:6789:/scratch 2024-05-10T04:26:31.059 INFO:teuthology.orchestra.run.smithi080.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDFoD1mdOoYJRAACeUopudzFqH/0fbbz4jU0w== -o context=system_u:object_r:root_t:s0 172.21.15.80:6789:/scratch /tmp/tmp.up23bDHa8dscratch 2024-05-10T04:26:31.059 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:26:32.621 INFO:teuthology.orchestra.run.smithi080.stdout:generic/099 1s 2024-05-10T04:26:32.634 INFO:teuthology.orchestra.run.smithi080.stdout:Ran: generic/099 2024-05-10T04:26:32.634 INFO:teuthology.orchestra.run.smithi080.stdout:Passed all 1 tests 2024-05-10T04:26:32.640 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:26:32.718 INFO:tasks.cephfs.test_acls:Command return value: 0 2024-05-10T04:26:32.718 INFO:tasks.cephfs.test_acls:Command stdout - FSTYP -- ceph PLATFORM -- Linux/x86_64 smithi080 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 14:14:33 UTC 2024 MKFS_OPTIONS -- 172.21.15.80:6789:/scratch MOUNT_OPTIONS -- -o name=admin,secret=AQDFoD1mdOoYJRAACeUopudzFqH/0fbbz4jU0w== -o context=system_u:object_r:root_t:s0 172.21.15.80:6789:/scratch /tmp/tmp.up23bDHa8dscratch generic/099 1s Ran: generic/099 Passed all 1 tests 2024-05-10T04:26:32.718 INFO:tasks.cephfs.test_acls:Command stderr - 2024-05-10T04:26:32.719 DEBUG:teuthology.orchestra.run.smithi080:> sudo userdel --force --remove fsgqa 2024-05-10T04:26:34.191 DEBUG:teuthology.orchestra.run.smithi080:> sudo userdel --force --remove 123456-fsgqa 2024-05-10T04:26:37.909 DEBUG:teuthology.orchestra.run.smithi080:> sudo groupdel fsgqa 2024-05-10T04:26:38.005 INFO:teuthology.orchestra.run.smithi080.stderr:groupdel: group 'fsgqa' does not exist 2024-05-10T04:26:38.008 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T04:26:38.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:26:38.009 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.ujcZfho4Bmxfstests-dev/results) 2024-05-10T04:26:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: File: /tmp/tmp.ujcZfho4Bmxfstests-dev/results 2024-05-10T04:26:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2024-05-10T04:26:38.073 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 801h/2049d Inode: 797504 Links: 3 2024-05-10T04:26:38.073 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:26:38.073 INFO:teuthology.orchestra.run.smithi080.stdout:Context: unconfined_u:object_r:user_tmp_t:s0 2024-05-10T04:26:38.074 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-10 04:26:30.998276437 +0000 2024-05-10T04:26:38.074 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-10 04:26:32.631241002 +0000 2024-05-10T04:26:38.074 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-10 04:26:32.631241002 +0000 2024-05-10T04:26:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-05-10 04:26:30.998276437 +0000 2024-05-10T04:26:38.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:26:38.076 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2024-05-10T04:26:38.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:26:38.143 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.ujcZfho4Bmxfstests-dev/results /var/log/ceph/xfstests-dev-results) 2024-05-10T04:26:38.211 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.ujcZfho4Bmxfstests-dev to /var/log/ceph. 2024-05-10T04:26:38.211 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf /tmp/tmp.ujcZfho4Bmxfstests-dev 2024-05-10T04:26:38.485 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T04:26:38.486 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T04:26:38.593 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T04:26:38.698 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T04:26:38.698 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:26:38.698 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:26:38.741 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:26:38.741 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:26:38.824 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:26:39.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.124+0000 7f2460800700 1 Processor -- start 2024-05-10T04:26:39.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.124+0000 7f2460800700 1 -- start start 2024-05-10T04:26:39.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.126+0000 7f2460800700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f24580b5fc0 0x7f24580b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:39.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.126+0000 7f2460800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f24581620e0 0x7f24581624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:39.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.126+0000 7f2460800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24580d2730 con 0x7f24580d3460 2024-05-10T04:26:39.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.126+0000 7f2460800700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24580b3720 con 0x7f24581620e0 2024-05-10T04:26:39.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.126+0000 7f2460800700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24580d2fd0 con 0x7f24580b5fc0 2024-05-10T04:26:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.126+0000 7f245e800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f24581620e0 0x7f24581624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.126+0000 7f245de00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f24580d3460 0x7f24580b58b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:57306/0 (socket says 172.21.15.80:57306) 2024-05-10T04:26:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.126+0000 7f245de00700 1 -- 172.21.15.80:0/3190677316 learned_addr learned my addr 172.21.15.80:0/3190677316 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.126+0000 7f245e800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f24581620e0 0x7f24581624f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47658/0 (socket says 172.21.15.80:47658) 2024-05-10T04:26:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.126+0000 7f245d400700 1 --2- 172.21.15.80:0/3190677316 >> v2:172.21.15.106:3300/0 conn(0x7f24580b5fc0 0x7f24580b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.126+0000 7f245e800700 1 -- 172.21.15.80:0/3190677316 >> v2:172.21.15.106:3300/0 conn(0x7f24580b5fc0 msgr2=0x7f24580b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.126+0000 7f245e800700 1 --2- 172.21.15.80:0/3190677316 >> v2:172.21.15.106:3300/0 conn(0x7f24580b5fc0 0x7f24580b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.126+0000 7f245e800700 1 -- 172.21.15.80:0/3190677316 >> v1:172.21.15.80:6789/0 conn(0x7f24580d3460 legacy=0x7f24580b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.126+0000 7f245e800700 1 -- 172.21.15.80:0/3190677316 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2458162e10 con 0x7f24581620e0 2024-05-10T04:26:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.127+0000 7f245e800700 1 --2- 172.21.15.80:0/3190677316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24581620e0 0x7f24581624f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f245806d2e0 tx=0x7f245400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75020701dc2f987 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.127+0000 7f245ca00700 1 -- 172.21.15.80:0/3190677316 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400e070 con 0x7f24581620e0 2024-05-10T04:26:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.127+0000 7f245ca00700 1 -- 172.21.15.80:0/3190677316 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245400bbd0 con 0x7f24581620e0 2024-05-10T04:26:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.127+0000 7f245ca00700 1 -- 172.21.15.80:0/3190677316 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454012430 con 0x7f24581620e0 2024-05-10T04:26:39.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.128+0000 7f2460800700 1 -- 172.21.15.80:0/3190677316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24581620e0 msgr2=0x7f24581624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:39.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.128+0000 7f2460800700 1 --2- 172.21.15.80:0/3190677316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24581620e0 0x7f24581624f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f245806d2e0 tx=0x7f245400b330 comp rx=0 tx=0).stop 2024-05-10T04:26:39.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.128+0000 7f2460800700 1 -- 172.21.15.80:0/3190677316 shutdown_connections 2024-05-10T04:26:39.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.128+0000 7f2460800700 1 --2- 172.21.15.80:0/3190677316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24581620e0 0x7f24581624f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.128+0000 7f2460800700 1 --2- 172.21.15.80:0/3190677316 >> v2:172.21.15.106:3300/0 conn(0x7f24580b5fc0 0x7f24580b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.128+0000 7f2460800700 1 -- 172.21.15.80:0/3190677316 >> 172.21.15.80:0/3190677316 conn(0x7f24580d0a90 msgr2=0x7f24580d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:39.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.128+0000 7f2460800700 1 -- 172.21.15.80:0/3190677316 shutdown_connections 2024-05-10T04:26:39.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.128+0000 7f2460800700 1 -- 172.21.15.80:0/3190677316 wait complete. 2024-05-10T04:26:39.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.130+0000 7f2460800700 1 Processor -- start 2024-05-10T04:26:39.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.130+0000 7f2460800700 1 -- start start 2024-05-10T04:26:39.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.132+0000 7f2460800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f24580d3460 0x7f24580cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:39.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.132+0000 7f2460800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24581620e0 0x7f245815cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:39.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.132+0000 7f2460800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24580ac9d0 0x7f24580acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:39.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.132+0000 7f2460800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245815e3f0 con 0x7f24580ac9d0 2024-05-10T04:26:39.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.132+0000 7f2460800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24580cc560 con 0x7f24581620e0 2024-05-10T04:26:39.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.132+0000 7f2460800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24580ad320 con 0x7f24580d3460 2024-05-10T04:26:39.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.132+0000 7f245e800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24580ac9d0 0x7f24580acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:39.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.132+0000 7f245e800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24580ac9d0 0x7f24580acde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47666/0 (socket says 172.21.15.80:47666) 2024-05-10T04:26:39.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.132+0000 7f245e800700 1 -- 172.21.15.80:0/1713883803 learned_addr learned my addr 172.21.15.80:0/1713883803 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:39.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.132+0000 7f245d400700 1 --2- 172.21.15.80:0/1713883803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24581620e0 0x7f245815cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:39.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.132+0000 7f245de00700 1 --2- 172.21.15.80:0/1713883803 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f24580d3460 0x7f24580cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:39.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.133+0000 7f245e800700 1 -- 172.21.15.80:0/1713883803 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f24580d3460 msgr2=0x7f24580cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:39.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.133+0000 7f245e800700 1 --2- 172.21.15.80:0/1713883803 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f24580d3460 0x7f24580cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.133+0000 7f245e800700 1 -- 172.21.15.80:0/1713883803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24581620e0 msgr2=0x7f245815cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:39.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.133+0000 7f245e800700 1 --2- 172.21.15.80:0/1713883803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24581620e0 0x7f245815cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.133+0000 7f245e800700 1 -- 172.21.15.80:0/1713883803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2454009a70 con 0x7f24580ac9d0 2024-05-10T04:26:39.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.133+0000 7f245e800700 1 --2- 172.21.15.80:0/1713883803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24580ac9d0 0x7f24580acde0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f245806d660 tx=0x7f2454004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:39.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.133+0000 7f2452000700 1 -- 172.21.15.80:0/1713883803 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454012430 con 0x7f24580ac9d0 2024-05-10T04:26:39.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.133+0000 7f2452000700 1 -- 172.21.15.80:0/1713883803 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2454020070 con 0x7f24580ac9d0 2024-05-10T04:26:39.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.133+0000 7f2460800700 1 -- 172.21.15.80:0/1713883803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245815d190 con 0x7f24580ac9d0 2024-05-10T04:26:39.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.133+0000 7f2452000700 1 -- 172.21.15.80:0/1713883803 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454004280 con 0x7f24580ac9d0 2024-05-10T04:26:39.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.133+0000 7f2460800700 1 -- 172.21.15.80:0/1713883803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24580cbc30 con 0x7f24580ac9d0 2024-05-10T04:26:39.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.134+0000 7f2460800700 1 -- 172.21.15.80:0/1713883803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24580732b0 con 0x7f24580ac9d0 2024-05-10T04:26:39.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.135+0000 7f2452000700 1 -- 172.21.15.80:0/1713883803 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f24540043e0 con 0x7f24580ac9d0 2024-05-10T04:26:39.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.136+0000 7f2452000700 1 --2- 172.21.15.80:0/1713883803 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f243c06ac90 0x7f243c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:39.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.136+0000 7f2452000700 1 -- 172.21.15.80:0/1713883803 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2454022070 con 0x7f24580ac9d0 2024-05-10T04:26:39.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.137+0000 7f245de00700 1 --2- 172.21.15.80:0/1713883803 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f243c06ac90 0x7f243c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:39.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.137+0000 7f245de00700 1 --2- 172.21.15.80:0/1713883803 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f243c06ac90 0x7f243c06d1a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f244c005910 tx=0x7f244c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:39.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.142+0000 7f2452000700 1 -- 172.21.15.80:0/1713883803 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2454056710 con 0x7f24580ac9d0 2024-05-10T04:26:39.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.345+0000 7f2460800700 1 -- 172.21.15.80:0/1713883803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24580cc710 con 0x7f24580ac9d0 2024-05-10T04:26:39.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.347+0000 7f2452000700 1 -- 172.21.15.80:0/1713883803 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16101 (secure 0 0 0) 0x7f24580cc710 con 0x7f24580ac9d0 2024-05-10T04:26:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:26:39.348 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":34,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:23:55.996940+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:23:52.881736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T04:23:53.974964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:26:39.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.349+0000 7f2460800700 1 -- 172.21.15.80:0/1713883803 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f243c06ac90 msgr2=0x7f243c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.349+0000 7f2460800700 1 --2- 172.21.15.80:0/1713883803 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f243c06ac90 0x7f243c06d1a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f244c005910 tx=0x7f244c009040 comp rx=0 tx=0).stop 2024-05-10T04:26:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.349+0000 7f2460800700 1 -- 172.21.15.80:0/1713883803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24580ac9d0 msgr2=0x7f24580acde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.349+0000 7f2460800700 1 --2- 172.21.15.80:0/1713883803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24580ac9d0 0x7f24580acde0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f245806d660 tx=0x7f2454004ad0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.349+0000 7f2460800700 1 -- 172.21.15.80:0/1713883803 shutdown_connections 2024-05-10T04:26:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.349+0000 7f2460800700 1 --2- 172.21.15.80:0/1713883803 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f243c06ac90 0x7f243c06d1a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.349+0000 7f2460800700 1 --2- 172.21.15.80:0/1713883803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24580ac9d0 0x7f24580acde0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.349+0000 7f2460800700 1 --2- 172.21.15.80:0/1713883803 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f24580d3460 0x7f24580cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.349+0000 7f2460800700 1 --2- 172.21.15.80:0/1713883803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24581620e0 0x7f245815cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.349+0000 7f2460800700 1 -- 172.21.15.80:0/1713883803 >> 172.21.15.80:0/1713883803 conn(0x7f24580d0a90 msgr2=0x7f245806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.349+0000 7f2460800700 1 -- 172.21.15.80:0/1713883803 shutdown_connections 2024-05-10T04:26:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.349+0000 7f2460800700 1 -- 172.21.15.80:0/1713883803 wait complete. 2024-05-10T04:26:39.378 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:22:26.793377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:23:52.881736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:23:53.974964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:26:39.379 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:26:39.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.641+0000 7fcd13000700 1 Processor -- start 2024-05-10T04:26:39.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.641+0000 7fcd13000700 1 -- start start 2024-05-10T04:26:39.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.643+0000 7fcd13000700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcd0c0b3280 0x7fcd0c0d3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:39.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.643+0000 7fcd13000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcd0c0b5d00 0x7fcd0c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:39.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.643+0000 7fcd13000700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd0c0d38d0 con 0x7fcd0c06c2f0 2024-05-10T04:26:39.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.643+0000 7fcd13000700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0c0b6650 con 0x7fcd0c0b5d00 2024-05-10T04:26:39.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.643+0000 7fcd13000700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0c06cf70 con 0x7fcd0c0b3280 2024-05-10T04:26:39.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.643+0000 7fcd03e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcd0c0b5d00 0x7fcd0c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:39.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.644+0000 7fcd03e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcd0c0b5d00 0x7fcd0c0b6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47678/0 (socket says 172.21.15.80:47678) 2024-05-10T04:26:39.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.644+0000 7fcd03e00700 1 -- 172.21.15.80:0/2411732875 learned_addr learned my addr 172.21.15.80:0/2411732875 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:39.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.644+0000 7fcd0be00700 1 --2- 172.21.15.80:0/2411732875 >> v2:172.21.15.106:3300/0 conn(0x7fcd0c0b3280 0x7fcd0c0d3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:39.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.644+0000 7fcd03e00700 1 -- 172.21.15.80:0/2411732875 >> v2:172.21.15.106:3300/0 conn(0x7fcd0c0b3280 msgr2=0x7fcd0c0d3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:39.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.644+0000 7fcd03e00700 1 --2- 172.21.15.80:0/2411732875 >> v2:172.21.15.106:3300/0 conn(0x7fcd0c0b3280 0x7fcd0c0d3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.644+0000 7fcd03e00700 1 -- 172.21.15.80:0/2411732875 >> v1:172.21.15.106:6789/0 conn(0x7fcd0c06c2f0 legacy=0x7fcd0c06c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:39.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.644+0000 7fcd03e00700 1 -- 172.21.15.80:0/2411732875 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c06d250 con 0x7fcd0c0b5d00 2024-05-10T04:26:39.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.644+0000 7fcd03e00700 1 --2- 172.21.15.80:0/2411732875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd0c0b5d00 0x7fcd0c0b6110 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c08c9b0 tx=0x7fccf4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51645bcc61fd88b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:39.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.644+0000 7fcd0b400700 1 -- 172.21.15.80:0/2411732875 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4005e30 con 0x7fcd0c0b5d00 2024-05-10T04:26:39.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.645+0000 7fcd0b400700 1 -- 172.21.15.80:0/2411732875 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf4004030 con 0x7fcd0c0b5d00 2024-05-10T04:26:39.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.645+0000 7fcd0b400700 1 -- 172.21.15.80:0/2411732875 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf40043e0 con 0x7fcd0c0b5d00 2024-05-10T04:26:39.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.645+0000 7fcd13000700 1 -- 172.21.15.80:0/2411732875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd0c0b5d00 msgr2=0x7fcd0c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:39.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.645+0000 7fcd13000700 1 --2- 172.21.15.80:0/2411732875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd0c0b5d00 0x7fcd0c0b6110 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c08c9b0 tx=0x7fccf4009bd0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.645+0000 7fcd13000700 1 -- 172.21.15.80:0/2411732875 shutdown_connections 2024-05-10T04:26:39.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.645+0000 7fcd13000700 1 --2- 172.21.15.80:0/2411732875 >> v2:172.21.15.106:3300/0 conn(0x7fcd0c0b3280 0x7fcd0c0d3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.645+0000 7fcd13000700 1 --2- 172.21.15.80:0/2411732875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd0c0b5d00 0x7fcd0c0b6110 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.645+0000 7fcd13000700 1 -- 172.21.15.80:0/2411732875 >> 172.21.15.80:0/2411732875 conn(0x7fcd0c0d40a0 msgr2=0x7fcd0c0d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:39.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.645+0000 7fcd13000700 1 -- 172.21.15.80:0/2411732875 shutdown_connections 2024-05-10T04:26:39.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.645+0000 7fcd13000700 1 -- 172.21.15.80:0/2411732875 wait complete. 2024-05-10T04:26:39.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.647+0000 7fcd13000700 1 Processor -- start 2024-05-10T04:26:39.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.648+0000 7fcd13000700 1 -- start start 2024-05-10T04:26:39.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.649+0000 7fcd13000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd0c06c2f0 0x7fcd0c155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.649+0000 7fcd13000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd0c0b3280 0x7fcd0c0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.649+0000 7fcd13000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd0c0b5d00 0x7fcd0c0b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.649+0000 7fcd13000700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0b1cc0 con 0x7fcd0c06c2f0 2024-05-10T04:26:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.649+0000 7fcd13000700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0ad0f0 con 0x7fcd0c0b3280 2024-05-10T04:26:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.649+0000 7fcd13000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c155790 con 0x7fcd0c0b5d00 2024-05-10T04:26:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.649+0000 7fcd0be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd0c06c2f0 0x7fcd0c155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.649+0000 7fcd0be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd0c06c2f0 0x7fcd0c155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47686/0 (socket says 172.21.15.80:47686) 2024-05-10T04:26:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.649+0000 7fcd0be00700 1 -- 172.21.15.80:0/1709209788 learned_addr learned my addr 172.21.15.80:0/1709209788 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.650+0000 7fcd03e00700 1 --2- 172.21.15.80:0/1709209788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd0c0b3280 0x7fcd0c0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.650+0000 7fcd11000700 1 --2- 172.21.15.80:0/1709209788 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd0c0b5d00 0x7fcd0c0b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.650+0000 7fcd0be00700 1 -- 172.21.15.80:0/1709209788 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd0c0b5d00 msgr2=0x7fcd0c0b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.650+0000 7fcd0be00700 1 --2- 172.21.15.80:0/1709209788 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd0c0b5d00 0x7fcd0c0b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.650+0000 7fcd0be00700 1 -- 172.21.15.80:0/1709209788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd0c0b3280 msgr2=0x7fcd0c0b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:39.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.650+0000 7fcd0be00700 1 --2- 172.21.15.80:0/1709209788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd0c0b3280 0x7fcd0c0b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.650+0000 7fcd0be00700 1 -- 172.21.15.80:0/1709209788 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf4009500 con 0x7fcd0c06c2f0 2024-05-10T04:26:39.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.650+0000 7fcd03e00700 1 --2- 172.21.15.80:0/1709209788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd0c0b3280 0x7fcd0c0b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:26:39.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.650+0000 7fcd0be00700 1 --2- 172.21.15.80:0/1709209788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd0c06c2f0 0x7fcd0c155250 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00d800 tx=0x7fccfc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:39.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.650+0000 7fcd08c00700 1 -- 172.21.15.80:0/1709209788 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc0125f0 con 0x7fcd0c06c2f0 2024-05-10T04:26:39.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.650+0000 7fcd08c00700 1 -- 172.21.15.80:0/1709209788 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc012750 con 0x7fcd0c06c2f0 2024-05-10T04:26:39.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.650+0000 7fcd08c00700 1 -- 172.21.15.80:0/1709209788 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc012b00 con 0x7fcd0c06c2f0 2024-05-10T04:26:39.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.650+0000 7fcd13000700 1 -- 172.21.15.80:0/1709209788 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0c0ad340 con 0x7fcd0c06c2f0 2024-05-10T04:26:39.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.650+0000 7fcd13000700 1 -- 172.21.15.80:0/1709209788 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0c0ad900 con 0x7fcd0c06c2f0 2024-05-10T04:26:39.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.652+0000 7fcd13000700 1 -- 172.21.15.80:0/1709209788 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0c0732b0 con 0x7fcd0c06c2f0 2024-05-10T04:26:39.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.653+0000 7fcd08c00700 1 -- 172.21.15.80:0/1709209788 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fccfc012c60 con 0x7fcd0c06c2f0 2024-05-10T04:26:39.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.653+0000 7fcd08c00700 1 --2- 172.21.15.80:0/1709209788 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcce806acc0 0x7fcce806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:39.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.654+0000 7fcd08c00700 1 -- 172.21.15.80:0/1709209788 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fccfc089780 con 0x7fcd0c06c2f0 2024-05-10T04:26:39.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.654+0000 7fcd03e00700 1 --2- 172.21.15.80:0/1709209788 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcce806acc0 0x7fcce806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:39.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.655+0000 7fcd03e00700 1 --2- 172.21.15.80:0/1709209788 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcce806acc0 0x7fcce806d1d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c08c9b0 tx=0x7fccf4008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:39.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.658+0000 7fcd08c00700 1 -- 172.21.15.80:0/1709209788 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fccfc0548d0 con 0x7fcd0c06c2f0 2024-05-10T04:26:39.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.863+0000 7fcd13000700 1 -- 172.21.15.80:0/1709209788 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd0c0cabc0 con 0x7fcd0c06c2f0 2024-05-10T04:26:39.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.863+0000 7fcd08c00700 1 -- 172.21.15.80:0/1709209788 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fccfc057ef0 con 0x7fcd0c06c2f0 2024-05-10T04:26:39.865 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-10T04:26:39.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.866+0000 7fcd13000700 1 -- 172.21.15.80:0/1709209788 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcce806acc0 msgr2=0x7fcce806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.866+0000 7fcd13000700 1 --2- 172.21.15.80:0/1709209788 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcce806acc0 0x7fcce806d1d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c08c9b0 tx=0x7fccf4008070 comp rx=0 tx=0).stop 2024-05-10T04:26:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.866+0000 7fcd13000700 1 -- 172.21.15.80:0/1709209788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd0c06c2f0 msgr2=0x7fcd0c155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.866+0000 7fcd13000700 1 --2- 172.21.15.80:0/1709209788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd0c06c2f0 0x7fcd0c155250 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00d800 tx=0x7fccfc00dbc0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.866+0000 7fcd13000700 1 -- 172.21.15.80:0/1709209788 shutdown_connections 2024-05-10T04:26:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.866+0000 7fcd13000700 1 --2- 172.21.15.80:0/1709209788 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fcce806acc0 0x7fcce806d1d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.866+0000 7fcd13000700 1 --2- 172.21.15.80:0/1709209788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd0c06c2f0 0x7fcd0c155250 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.866+0000 7fcd13000700 1 --2- 172.21.15.80:0/1709209788 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd0c0b5d00 0x7fcd0c0b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.866+0000 7fcd13000700 1 --2- 172.21.15.80:0/1709209788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd0c0b3280 0x7fcd0c0b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.866+0000 7fcd13000700 1 -- 172.21.15.80:0/1709209788 >> 172.21.15.80:0/1709209788 conn(0x7fcd0c0d40a0 msgr2=0x7fcd0c0b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.866+0000 7fcd13000700 1 -- 172.21.15.80:0/1709209788 shutdown_connections 2024-05-10T04:26:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:39.866+0000 7fcd13000700 1 -- 172.21.15.80:0/1709209788 wait complete. 2024-05-10T04:26:39.893 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:26:40.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.155+0000 7fa3b0e00700 1 Processor -- start 2024-05-10T04:26:40.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.155+0000 7fa3b0e00700 1 -- start start 2024-05-10T04:26:40.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.157+0000 7fa3b0e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3ac1637d0 0x7fa3ac165bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:40.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.157+0000 7fa3b0e00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ac0cc5f0 con 0x7fa3ac0cc1e0 2024-05-10T04:26:40.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.157+0000 7fa3b0e00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ac06d6f0 con 0x7fa3ac071f20 2024-05-10T04:26:40.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.157+0000 7fa3b0e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac06e610 con 0x7fa3ac1637d0 2024-05-10T04:26:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.157+0000 7fa3a9e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa3ac0cc1e0 0x7fa3ac15b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:57314/0 (socket says 172.21.15.80:57314) 2024-05-10T04:26:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.157+0000 7fa3a9e00700 1 -- 172.21.15.80:0/1429953183 learned_addr learned my addr 172.21.15.80:0/1429953183 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.157+0000 7fa3a8a00700 1 -- 172.21.15.80:0/1429953183 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768688155 0 0) 0x7fa3ac0cc5f0 con 0x7fa3ac0cc1e0 2024-05-10T04:26:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.157+0000 7fa3a8a00700 1 -- 172.21.15.80:0/1429953183 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3900035b0 con 0x7fa3ac0cc1e0 2024-05-10T04:26:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.157+0000 7fa3aa800700 1 --2- 172.21.15.80:0/1429953183 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3ac1637d0 0x7fa3ac165bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.158+0000 7fa3a8a00700 1 -- 172.21.15.80:0/1429953183 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1443306356 0 0) 0x7fa3900035b0 con 0x7fa3ac0cc1e0 2024-05-10T04:26:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.158+0000 7fa3a8a00700 1 -- 172.21.15.80:0/1429953183 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3ac1637d0 msgr2=0x7fa3ac165bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.158+0000 7fa3a8a00700 1 --2- 172.21.15.80:0/1429953183 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3ac1637d0 0x7fa3ac165bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.158+0000 7fa3a8a00700 1 -- 172.21.15.80:0/1429953183 >> v1:172.21.15.106:6789/0 conn(0x7fa3ac071f20 legacy=0x7fa3ac072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.158+0000 7fa3a8a00700 1 -- 172.21.15.80:0/1429953183 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac06d990 con 0x7fa3ac0cc1e0 2024-05-10T04:26:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.158+0000 7fa3a8a00700 1 -- 172.21.15.80:0/1429953183 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7fa39c001670 con 0x7fa3ac0cc1e0 2024-05-10T04:26:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.158+0000 7fa3a8a00700 1 -- 172.21.15.80:0/1429953183 >> v1:172.21.15.80:6789/0 conn(0x7fa3ac0cc1e0 legacy=0x7fa3ac15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.158+0000 7fa3a8a00700 1 --2- 172.21.15.80:0/1429953183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa390003a30 0x7fa390003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.158+0000 7fa3a8a00700 1 --2- 172.21.15.80:0/1429953183 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3ac1637d0 0x7fa390004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.158+0000 7fa3a8a00700 1 --2- 172.21.15.80:0/1429953183 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa390004d90 0x7fa3900051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.158+0000 7fa3a8a00700 1 -- 172.21.15.80:0/1429953183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac06e610 con 0x7fa390003a30 2024-05-10T04:26:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.158+0000 7fa3a8a00700 1 -- 172.21.15.80:0/1429953183 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa390005ba0 con 0x7fa390004d90 2024-05-10T04:26:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.158+0000 7fa3a8a00700 1 -- 172.21.15.80:0/1429953183 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa390005d60 con 0x7fa3ac1637d0 2024-05-10T04:26:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.158+0000 7fa3a9e00700 1 --2- 172.21.15.80:0/1429953183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa390003a30 0x7fa390003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.158+0000 7fa3a9400700 1 --2- 172.21.15.80:0/1429953183 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3ac1637d0 0x7fa390004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.158+0000 7fa3aa800700 1 --2- 172.21.15.80:0/1429953183 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa390004d90 0x7fa3900051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.159+0000 7fa3a9e00700 1 -- 172.21.15.80:0/1429953183 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3ac1637d0 msgr2=0x7fa390004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.159+0000 7fa3a9e00700 1 --2- 172.21.15.80:0/1429953183 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3ac1637d0 0x7fa390004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.159+0000 7fa3a9e00700 1 -- 172.21.15.80:0/1429953183 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa390004d90 msgr2=0x7fa3900051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.159+0000 7fa3a9e00700 1 --2- 172.21.15.80:0/1429953183 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa390004d90 0x7fa3900051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.159+0000 7fa3a9e00700 1 -- 172.21.15.80:0/1429953183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3900035b0 con 0x7fa390003a30 2024-05-10T04:26:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.159+0000 7fa3aa800700 1 --2- 172.21.15.80:0/1429953183 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa390004d90 0x7fa3900051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:26:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.159+0000 7fa3a9e00700 1 --2- 172.21.15.80:0/1429953183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa390003a30 0x7fa390003ea0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00c240 tx=0x7fa390005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc47848905a49c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:40.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.159+0000 7fa3a8a00700 1 -- 172.21.15.80:0/1429953183 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c007c10 con 0x7fa390003a30 2024-05-10T04:26:40.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.159+0000 7fa3a8a00700 1 -- 172.21.15.80:0/1429953183 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c00ce00 con 0x7fa390003a30 2024-05-10T04:26:40.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.159+0000 7fa3a8a00700 1 -- 172.21.15.80:0/1429953183 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c005ba0 con 0x7fa390003a30 2024-05-10T04:26:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.160+0000 7fa3b0e00700 1 -- 172.21.15.80:0/1429953183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa390003a30 msgr2=0x7fa390003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.160+0000 7fa3b0e00700 1 --2- 172.21.15.80:0/1429953183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa390003a30 0x7fa390003ea0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00c240 tx=0x7fa390005880 comp rx=0 tx=0).stop 2024-05-10T04:26:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.160+0000 7fa3aa800700 1 -- 172.21.15.80:0/1429953183 reap_dead start 2024-05-10T04:26:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.160+0000 7fa3b0e00700 1 -- 172.21.15.80:0/1429953183 shutdown_connections 2024-05-10T04:26:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.160+0000 7fa3b0e00700 1 -- 172.21.15.80:0/1429953183 >> 172.21.15.80:0/1429953183 conn(0x7fa3ac0b1830 msgr2=0x7fa3ac0b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.160+0000 7fa3b0e00700 1 -- 172.21.15.80:0/1429953183 shutdown_connections 2024-05-10T04:26:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.160+0000 7fa3b0e00700 1 -- 172.21.15.80:0/1429953183 wait complete. 2024-05-10T04:26:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.162+0000 7fa3b0e00700 1 Processor -- start 2024-05-10T04:26:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.162+0000 7fa3b0e00700 1 -- start start 2024-05-10T04:26:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.164+0000 7fa3b0e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa390003a30 0x7fa3ac148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.164+0000 7fa3b0e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3ac1492e0 0x7fa3ac15c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.164+0000 7fa3b0e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3ac1496f0 0x7fa3ac15cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.164+0000 7fa3b0e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac160770 con 0x7fa3ac1492e0 2024-05-10T04:26:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.164+0000 7fa3b0e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac162000 con 0x7fa3ac1496f0 2024-05-10T04:26:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.164+0000 7fa3b0e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac1632f0 con 0x7fa390003a30 2024-05-10T04:26:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.164+0000 7fa3a9400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3ac1492e0 0x7fa3ac15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.164+0000 7fa3a9400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3ac1492e0 0x7fa3ac15c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47708/0 (socket says 172.21.15.80:47708) 2024-05-10T04:26:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.164+0000 7fa3a9400700 1 -- 172.21.15.80:0/2786816047 learned_addr learned my addr 172.21.15.80:0/2786816047 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.164+0000 7fa3a9e00700 1 --2- 172.21.15.80:0/2786816047 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa390003a30 0x7fa3ac148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.164+0000 7fa3aa800700 1 --2- 172.21.15.80:0/2786816047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3ac1496f0 0x7fa3ac15cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.165+0000 7fa3a9400700 1 -- 172.21.15.80:0/2786816047 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa390003a30 msgr2=0x7fa3ac148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.165+0000 7fa3a9400700 1 --2- 172.21.15.80:0/2786816047 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa390003a30 0x7fa3ac148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.165+0000 7fa3a9400700 1 -- 172.21.15.80:0/2786816047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3ac1496f0 msgr2=0x7fa3ac15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.165+0000 7fa3a9400700 1 --2- 172.21.15.80:0/2786816047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3ac1496f0 0x7fa3ac15cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.165+0000 7fa3a9400700 1 -- 172.21.15.80:0/2786816047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac161d50 con 0x7fa3ac1492e0 2024-05-10T04:26:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.165+0000 7fa3a9400700 1 --2- 172.21.15.80:0/2786816047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3ac1492e0 0x7fa3ac15c850 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa39800f7f0 tx=0x7fa39800fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.165+0000 7fa3a2000700 1 -- 172.21.15.80:0/2786816047 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980052e0 con 0x7fa3ac1492e0 2024-05-10T04:26:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.165+0000 7fa3a2000700 1 -- 172.21.15.80:0/2786816047 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa398005440 con 0x7fa3ac1492e0 2024-05-10T04:26:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.165+0000 7fa3b0e00700 1 -- 172.21.15.80:0/2786816047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ac162250 con 0x7fa3ac1492e0 2024-05-10T04:26:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.165+0000 7fa3a2000700 1 -- 172.21.15.80:0/2786816047 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980038c0 con 0x7fa3ac1492e0 2024-05-10T04:26:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.165+0000 7fa3b0e00700 1 -- 172.21.15.80:0/2786816047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ac162810 con 0x7fa3ac1492e0 2024-05-10T04:26:40.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.166+0000 7fa3b0e00700 1 -- 172.21.15.80:0/2786816047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ac163140 con 0x7fa3ac1492e0 2024-05-10T04:26:40.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.168+0000 7fa3a2000700 1 -- 172.21.15.80:0/2786816047 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa398003a20 con 0x7fa3ac1492e0 2024-05-10T04:26:40.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.168+0000 7fa3a2000700 1 --2- 172.21.15.80:0/2786816047 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa38c06ac90 0x7fa38c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:40.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.169+0000 7fa3a2000700 1 -- 172.21.15.80:0/2786816047 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa398089130 con 0x7fa3ac1492e0 2024-05-10T04:26:40.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.169+0000 7fa3a9e00700 1 --2- 172.21.15.80:0/2786816047 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa38c06ac90 0x7fa38c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:40.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.170+0000 7fa3a9e00700 1 --2- 172.21.15.80:0/2786816047 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa38c06ac90 0x7fa38c06d1a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa39c015040 tx=0x7fa39c007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:40.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.173+0000 7fa3a2000700 1 -- 172.21.15.80:0/2786816047 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa3980541e0 con 0x7fa3ac1492e0 2024-05-10T04:26:40.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.375+0000 7fa3b0e00700 1 -- 172.21.15.80:0/2786816047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3ac074af0 con 0x7fa3ac1492e0 2024-05-10T04:26:40.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.375+0000 7fa3a2000700 1 -- 172.21.15.80:0/2786816047 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa398057800 con 0x7fa3ac1492e0 2024-05-10T04:26:40.377 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-10T04:26:40.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.378+0000 7fa3b0e00700 1 -- 172.21.15.80:0/2786816047 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa38c06ac90 msgr2=0x7fa38c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:40.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.378+0000 7fa3b0e00700 1 --2- 172.21.15.80:0/2786816047 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa38c06ac90 0x7fa38c06d1a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa39c015040 tx=0x7fa39c007000 comp rx=0 tx=0).stop 2024-05-10T04:26:40.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.378+0000 7fa3b0e00700 1 -- 172.21.15.80:0/2786816047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3ac1492e0 msgr2=0x7fa3ac15c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:40.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.378+0000 7fa3b0e00700 1 --2- 172.21.15.80:0/2786816047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3ac1492e0 0x7fa3ac15c850 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa39800f7f0 tx=0x7fa39800fb00 comp rx=0 tx=0).stop 2024-05-10T04:26:40.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.378+0000 7fa3b0e00700 1 -- 172.21.15.80:0/2786816047 shutdown_connections 2024-05-10T04:26:40.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.378+0000 7fa3b0e00700 1 --2- 172.21.15.80:0/2786816047 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa38c06ac90 0x7fa38c06d1a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:40.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.378+0000 7fa3b0e00700 1 --2- 172.21.15.80:0/2786816047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3ac1496f0 0x7fa3ac15cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:40.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.378+0000 7fa3b0e00700 1 --2- 172.21.15.80:0/2786816047 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa390003a30 0x7fa3ac148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:40.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.378+0000 7fa3b0e00700 1 --2- 172.21.15.80:0/2786816047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3ac1492e0 0x7fa3ac15c850 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:40.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.378+0000 7fa3b0e00700 1 -- 172.21.15.80:0/2786816047 >> 172.21.15.80:0/2786816047 conn(0x7fa3ac0b1830 msgr2=0x7fa3ac074390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:40.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.378+0000 7fa3b0e00700 1 -- 172.21.15.80:0/2786816047 shutdown_connections 2024-05-10T04:26:40.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.378+0000 7fa3b0e00700 1 -- 172.21.15.80:0/2786816047 wait complete. 2024-05-10T04:26:40.404 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:26:40.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.668+0000 7ff967c00700 1 Processor -- start 2024-05-10T04:26:40.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.668+0000 7ff967c00700 1 -- start start 2024-05-10T04:26:40.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.670+0000 7ff967c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9600b5d00 0x7ff9600b6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:40.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.670+0000 7ff967c00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9600b6650 con 0x7ff9600b3280 2024-05-10T04:26:40.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.670+0000 7ff967c00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96006cf70 con 0x7ff96006c2f0 2024-05-10T04:26:40.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.670+0000 7ff967c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96006d250 con 0x7ff9600b5d00 2024-05-10T04:26:40.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.670+0000 7ff965200700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff9600b3280 0x7ff9600d3390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:57328/0 (socket says 172.21.15.80:57328) 2024-05-10T04:26:40.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.670+0000 7ff965200700 1 -- 172.21.15.80:0/3541045517 learned_addr learned my addr 172.21.15.80:0/3541045517 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:40.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.670+0000 7ff95fe00700 1 --2- 172.21.15.80:0/3541045517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9600b5d00 0x7ff9600b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:40.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.670+0000 7ff95f400700 1 -- 172.21.15.80:0/3541045517 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818737917 0 0) 0x7ff9600b6650 con 0x7ff9600b3280 2024-05-10T04:26:40.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.670+0000 7ff95f400700 1 -- 172.21.15.80:0/3541045517 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9480035b0 con 0x7ff9600b3280 2024-05-10T04:26:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.671+0000 7ff95f400700 1 -- 172.21.15.80:0/3541045517 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440174626 0 0) 0x7ff96006cf70 con 0x7ff96006c2f0 2024-05-10T04:26:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.671+0000 7ff95f400700 1 -- 172.21.15.80:0/3541045517 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9600b6650 con 0x7ff96006c2f0 2024-05-10T04:26:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.671+0000 7ff95f400700 1 -- 172.21.15.80:0/3541045517 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 477203174 0 0) 0x7ff9480035b0 con 0x7ff9600b3280 2024-05-10T04:26:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.671+0000 7ff95fe00700 1 -- 172.21.15.80:0/3541045517 >> v1:172.21.15.106:6789/0 conn(0x7ff96006c2f0 legacy=0x7ff96006c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.671+0000 7ff95fe00700 1 -- 172.21.15.80:0/3541045517 >> v1:172.21.15.80:6789/0 conn(0x7ff9600b3280 legacy=0x7ff9600d3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.671+0000 7ff95fe00700 1 -- 172.21.15.80:0/3541045517 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9600d28b0 con 0x7ff9600b5d00 2024-05-10T04:26:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.671+0000 7ff95fe00700 1 --2- 172.21.15.80:0/3541045517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9600b5d00 0x7ff9600b6110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009850 tx=0x7ff94c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10b2168e7505c378 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.671+0000 7ff95f400700 1 -- 172.21.15.80:0/3541045517 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954001690 con 0x7ff9600b5d00 2024-05-10T04:26:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.671+0000 7ff95f400700 1 -- 172.21.15.80:0/3541045517 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c005c30 con 0x7ff9600b5d00 2024-05-10T04:26:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.671+0000 7ff95f400700 1 -- 172.21.15.80:0/3541045517 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c004030 con 0x7ff9600b5d00 2024-05-10T04:26:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.672+0000 7ff967c00700 1 -- 172.21.15.80:0/3541045517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9600b5d00 msgr2=0x7ff9600b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.672+0000 7ff967c00700 1 --2- 172.21.15.80:0/3541045517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9600b5d00 0x7ff9600b6110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009850 tx=0x7ff94c009b60 comp rx=0 tx=0).stop 2024-05-10T04:26:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.672+0000 7ff967c00700 1 -- 172.21.15.80:0/3541045517 shutdown_connections 2024-05-10T04:26:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.672+0000 7ff967c00700 1 --2- 172.21.15.80:0/3541045517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9600b5d00 0x7ff9600b6110 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.672+0000 7ff967c00700 1 -- 172.21.15.80:0/3541045517 >> 172.21.15.80:0/3541045517 conn(0x7ff9600d40a0 msgr2=0x7ff9600d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.672+0000 7ff967c00700 1 -- 172.21.15.80:0/3541045517 shutdown_connections 2024-05-10T04:26:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.672+0000 7ff967c00700 1 -- 172.21.15.80:0/3541045517 wait complete. 2024-05-10T04:26:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.674+0000 7ff967c00700 1 Processor -- start 2024-05-10T04:26:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.675+0000 7ff967c00700 1 -- start start 2024-05-10T04:26:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.676+0000 7ff967c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff96006c2f0 0x7ff9600ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.676+0000 7ff967c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9600b3280 0x7ff96015ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:40.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.676+0000 7ff967c00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9600b5d00 0x7ff9601f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:40.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.676+0000 7ff967c00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9601f4ab0 con 0x7ff9600b3280 2024-05-10T04:26:40.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.676+0000 7ff967c00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9601f7b40 con 0x7ff9600b5d00 2024-05-10T04:26:40.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.676+0000 7ff967c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600ae8c0 con 0x7ff96006c2f0 2024-05-10T04:26:40.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.676+0000 7ff95fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9600b3280 0x7ff96015ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:40.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.676+0000 7ff95fe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9600b3280 0x7ff96015ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47712/0 (socket says 172.21.15.80:47712) 2024-05-10T04:26:40.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.676+0000 7ff95fe00700 1 -- 172.21.15.80:0/1578873867 learned_addr learned my addr 172.21.15.80:0/1578873867 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:40.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.676+0000 7ff965200700 1 --2- 172.21.15.80:0/1578873867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff96006c2f0 0x7ff9600ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:40.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.676+0000 7ff965c00700 1 --2- 172.21.15.80:0/1578873867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9600b5d00 0x7ff9601f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:40.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.677+0000 7ff95fe00700 1 -- 172.21.15.80:0/1578873867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff96006c2f0 msgr2=0x7ff9600ad970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.677+0000 7ff95fe00700 1 --2- 172.21.15.80:0/1578873867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff96006c2f0 0x7ff9600ad970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.677+0000 7ff95fe00700 1 -- 172.21.15.80:0/1578873867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9600b5d00 msgr2=0x7ff9601f4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.677+0000 7ff95fe00700 1 --2- 172.21.15.80:0/1578873867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9600b5d00 0x7ff9601f4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.677+0000 7ff95fe00700 1 -- 172.21.15.80:0/1578873867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c009430 con 0x7ff9600b3280 2024-05-10T04:26:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.677+0000 7ff965c00700 1 --2- 172.21.15.80:0/1578873867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9600b5d00 0x7ff9601f4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:26:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.677+0000 7ff95fe00700 1 --2- 172.21.15.80:0/1578873867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9600b3280 0x7ff96015ef30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff9600b6ab0 tx=0x7ff94c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.677+0000 7ff95cc00700 1 -- 172.21.15.80:0/1578873867 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c003ab0 con 0x7ff9600b3280 2024-05-10T04:26:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.677+0000 7ff95cc00700 1 -- 172.21.15.80:0/1578873867 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c003c10 con 0x7ff9600b3280 2024-05-10T04:26:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.677+0000 7ff967c00700 1 -- 172.21.15.80:0/1578873867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9601f7d90 con 0x7ff9600b3280 2024-05-10T04:26:40.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.677+0000 7ff95cc00700 1 -- 172.21.15.80:0/1578873867 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c01d430 con 0x7ff9600b3280 2024-05-10T04:26:40.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.677+0000 7ff967c00700 1 -- 172.21.15.80:0/1578873867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9601f8350 con 0x7ff9600b3280 2024-05-10T04:26:40.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.678+0000 7ff967c00700 1 -- 172.21.15.80:0/1578873867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9600732b0 con 0x7ff9600b3280 2024-05-10T04:26:40.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.679+0000 7ff95cc00700 1 -- 172.21.15.80:0/1578873867 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff94c01d590 con 0x7ff9600b3280 2024-05-10T04:26:40.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.681+0000 7ff95cc00700 1 --2- 172.21.15.80:0/1578873867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff94006ac90 0x7ff94006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:40.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.681+0000 7ff95cc00700 1 -- 172.21.15.80:0/1578873867 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff94c08a670 con 0x7ff9600b3280 2024-05-10T04:26:40.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.681+0000 7ff965200700 1 --2- 172.21.15.80:0/1578873867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff94006ac90 0x7ff94006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:40.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.682+0000 7ff965200700 1 --2- 172.21.15.80:0/1578873867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff94006ac90 0x7ff94006d1a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff954000f60 tx=0x7ff9540016d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:40.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.686+0000 7ff95cc00700 1 -- 172.21.15.80:0/1578873867 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff94c055960 con 0x7ff9600b3280 2024-05-10T04:26:40.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.891+0000 7ff967c00700 1 -- 172.21.15.80:0/1578873867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff960074af0 con 0x7ff9600b3280 2024-05-10T04:26:40.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.891+0000 7ff95cc00700 1 -- 172.21.15.80:0/1578873867 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff94c058f80 con 0x7ff9600b3280 2024-05-10T04:26:40.893 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-10T04:26:40.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.894+0000 7ff967c00700 1 -- 172.21.15.80:0/1578873867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff94006ac90 msgr2=0x7ff94006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:40.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.894+0000 7ff967c00700 1 --2- 172.21.15.80:0/1578873867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff94006ac90 0x7ff94006d1a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff954000f60 tx=0x7ff9540016d0 comp rx=0 tx=0).stop 2024-05-10T04:26:40.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.894+0000 7ff967c00700 1 -- 172.21.15.80:0/1578873867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9600b3280 msgr2=0x7ff96015ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:40.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.894+0000 7ff967c00700 1 --2- 172.21.15.80:0/1578873867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9600b3280 0x7ff96015ef30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff9600b6ab0 tx=0x7ff94c004750 comp rx=0 tx=0).stop 2024-05-10T04:26:40.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.894+0000 7ff967c00700 1 -- 172.21.15.80:0/1578873867 shutdown_connections 2024-05-10T04:26:40.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.894+0000 7ff967c00700 1 --2- 172.21.15.80:0/1578873867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff94006ac90 0x7ff94006d1a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:40.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.894+0000 7ff967c00700 1 --2- 172.21.15.80:0/1578873867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9600b5d00 0x7ff9601f4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:40.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.894+0000 7ff967c00700 1 --2- 172.21.15.80:0/1578873867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff96006c2f0 0x7ff9600ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:40.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.894+0000 7ff967c00700 1 --2- 172.21.15.80:0/1578873867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9600b3280 0x7ff96015ef30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:40.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.894+0000 7ff967c00700 1 -- 172.21.15.80:0/1578873867 >> 172.21.15.80:0/1578873867 conn(0x7ff9600d40a0 msgr2=0x7ff96006c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:40.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.894+0000 7ff967c00700 1 -- 172.21.15.80:0/1578873867 shutdown_connections 2024-05-10T04:26:40.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:40.894+0000 7ff967c00700 1 -- 172.21.15.80:0/1578873867 wait complete. 2024-05-10T04:26:40.923 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T04:26:41.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.185+0000 7f1342800700 1 Processor -- start 2024-05-10T04:26:41.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.185+0000 7f1342800700 1 -- start start 2024-05-10T04:26:41.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.187+0000 7f1342800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f133c0b98e0 0x7f133c0d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:41.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.187+0000 7f1342800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c0d0c90 0x7f133c15d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:41.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.187+0000 7f1342800700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133c0d2e50 con 0x7f133c0b6230 2024-05-10T04:26:41.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.187+0000 7f1342800700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c0d3130 con 0x7f133c0b98e0 2024-05-10T04:26:41.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.187+0000 7f1342800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0d3410 con 0x7f133c0d0c90 2024-05-10T04:26:41.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.187+0000 7f1341400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f133c0b98e0 0x7f133c0d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:41.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.187+0000 7f1341400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f133c0b98e0 0x7f133c0d2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47726/0 (socket says 172.21.15.80:47726) 2024-05-10T04:26:41.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.187+0000 7f1341400700 1 -- 172.21.15.80:0/2215363728 learned_addr learned my addr 172.21.15.80:0/2215363728 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:41.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.187+0000 7f1341e00700 1 --2- 172.21.15.80:0/2215363728 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c0d0c90 0x7f133c15d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:41.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.187+0000 7f1341400700 1 -- 172.21.15.80:0/2215363728 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c0d0c90 msgr2=0x7f133c15d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:41.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.187+0000 7f1341400700 1 --2- 172.21.15.80:0/2215363728 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c0d0c90 0x7f133c15d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:41.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.187+0000 7f1341400700 1 -- 172.21.15.80:0/2215363728 >> v1:172.21.15.106:6789/0 conn(0x7f133c0b6230 legacy=0x7f133c0d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:41.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.187+0000 7f1341400700 1 -- 172.21.15.80:0/2215363728 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c0b7470 con 0x7f133c0b98e0 2024-05-10T04:26:41.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.187+0000 7f1341400700 1 --2- 172.21.15.80:0/2215363728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f133c0b98e0 0x7f133c0d2520 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f13300098f0 tx=0x7f1330009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81da231da9088fc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:41.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.187+0000 7f133be00700 1 -- 172.21.15.80:0/2215363728 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133000b8a0 con 0x7f133c0b98e0 2024-05-10T04:26:41.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.187+0000 7f133be00700 1 -- 172.21.15.80:0/2215363728 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133000ba00 con 0x7f133c0b98e0 2024-05-10T04:26:41.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.187+0000 7f133be00700 1 -- 172.21.15.80:0/2215363728 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133000bd90 con 0x7f133c0b98e0 2024-05-10T04:26:41.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.188+0000 7f1342800700 1 -- 172.21.15.80:0/2215363728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f133c0b98e0 msgr2=0x7f133c0d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:41.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.188+0000 7f1342800700 1 --2- 172.21.15.80:0/2215363728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f133c0b98e0 0x7f133c0d2520 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f13300098f0 tx=0x7f1330009c00 comp rx=0 tx=0).stop 2024-05-10T04:26:41.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.188+0000 7f1342800700 1 -- 172.21.15.80:0/2215363728 shutdown_connections 2024-05-10T04:26:41.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.188+0000 7f1342800700 1 --2- 172.21.15.80:0/2215363728 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c0d0c90 0x7f133c15d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:41.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.188+0000 7f1342800700 1 --2- 172.21.15.80:0/2215363728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f133c0b98e0 0x7f133c0d2520 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:41.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.188+0000 7f1342800700 1 -- 172.21.15.80:0/2215363728 >> 172.21.15.80:0/2215363728 conn(0x7f133c0676c0 msgr2=0x7f133c06c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:41.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.188+0000 7f1342800700 1 -- 172.21.15.80:0/2215363728 shutdown_connections 2024-05-10T04:26:41.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.188+0000 7f1342800700 1 -- 172.21.15.80:0/2215363728 wait complete. 2024-05-10T04:26:41.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.190+0000 7f1342800700 1 Processor -- start 2024-05-10T04:26:41.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.190+0000 7f1342800700 1 -- start start 2024-05-10T04:26:41.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.192+0000 7f1342800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f133c0b6230 0x7f133c0aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:41.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.192+0000 7f1342800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f133c0b98e0 0x7f133c1f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:41.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.192+0000 7f1342800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c0d0c90 0x7f133c15cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:41.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.192+0000 7f1342800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c1f4a60 con 0x7f133c0b6230 2024-05-10T04:26:41.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.192+0000 7f1342800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0ab5b0 con 0x7f133c0b98e0 2024-05-10T04:26:41.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.192+0000 7f1342800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0ab360 con 0x7f133c0d0c90 2024-05-10T04:26:41.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.192+0000 7f1341400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f133c0b6230 0x7f133c0aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:41.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.192+0000 7f1341400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f133c0b6230 0x7f133c0aae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47736/0 (socket says 172.21.15.80:47736) 2024-05-10T04:26:41.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.192+0000 7f1341400700 1 -- 172.21.15.80:0/4168261518 learned_addr learned my addr 172.21.15.80:0/4168261518 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:41.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.192+0000 7f1341400700 1 -- 172.21.15.80:0/4168261518 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c0d0c90 msgr2=0x7f133c15cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:41.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.192+0000 7f1341400700 1 --2- 172.21.15.80:0/4168261518 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c0d0c90 0x7f133c15cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:41.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.192+0000 7f1341400700 1 -- 172.21.15.80:0/4168261518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f133c0b98e0 msgr2=0x7f133c1f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:41.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.192+0000 7f1341400700 1 --2- 172.21.15.80:0/4168261518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f133c0b98e0 0x7f133c1f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:41.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.192+0000 7f1341400700 1 -- 172.21.15.80:0/4168261518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1330009550 con 0x7f133c0b6230 2024-05-10T04:26:41.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.192+0000 7f1341400700 1 --2- 172.21.15.80:0/4168261518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f133c0b6230 0x7f133c0aae20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1330014040 tx=0x7f1330004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:41.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.193+0000 7f1339600700 1 -- 172.21.15.80:0/4168261518 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300036a0 con 0x7f133c0b6230 2024-05-10T04:26:41.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.193+0000 7f1339600700 1 -- 172.21.15.80:0/4168261518 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133001e070 con 0x7f133c0b6230 2024-05-10T04:26:41.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.193+0000 7f1342800700 1 -- 172.21.15.80:0/4168261518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c1f4580 con 0x7f133c0b6230 2024-05-10T04:26:41.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.193+0000 7f1339600700 1 -- 172.21.15.80:0/4168261518 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330003a60 con 0x7f133c0b6230 2024-05-10T04:26:41.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.193+0000 7f1342800700 1 -- 172.21.15.80:0/4168261518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c1e8e00 con 0x7f133c0b6230 2024-05-10T04:26:41.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.194+0000 7f1342800700 1 -- 172.21.15.80:0/4168261518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c1e9cf0 con 0x7f133c0b6230 2024-05-10T04:26:41.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.195+0000 7f1339600700 1 -- 172.21.15.80:0/4168261518 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1330003bc0 con 0x7f133c0b6230 2024-05-10T04:26:41.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.196+0000 7f1339600700 1 --2- 172.21.15.80:0/4168261518 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f131c06acc0 0x7f131c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:41.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.196+0000 7f1339600700 1 -- 172.21.15.80:0/4168261518 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1330020070 con 0x7f133c0b6230 2024-05-10T04:26:41.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.196+0000 7f1340a00700 1 --2- 172.21.15.80:0/4168261518 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f131c06acc0 0x7f131c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:41.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.197+0000 7f1340a00700 1 --2- 172.21.15.80:0/4168261518 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f131c06acc0 0x7f131c06d1d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1328000f60 tx=0x7f1328007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.202+0000 7f1339600700 1 -- 172.21.15.80:0/4168261518 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1330055a00 con 0x7f133c0b6230 2024-05-10T04:26:41.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.420+0000 7f1342800700 1 -- 172.21.15.80:0/4168261518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f133c074af0 con 0x7f133c0b6230 2024-05-10T04:26:41.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.420+0000 7f1339600700 1 -- 172.21.15.80:0/4168261518 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1330015080 con 0x7f133c0b6230 2024-05-10T04:26:41.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.423+0000 7f1342800700 1 -- 172.21.15.80:0/4168261518 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f131c06acc0 msgr2=0x7f131c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:41.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.423+0000 7f1342800700 1 --2- 172.21.15.80:0/4168261518 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f131c06acc0 0x7f131c06d1d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1328000f60 tx=0x7f1328007a40 comp rx=0 tx=0).stop 2024-05-10T04:26:41.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.423+0000 7f1342800700 1 -- 172.21.15.80:0/4168261518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f133c0b6230 msgr2=0x7f133c0aae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:41.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.423+0000 7f1342800700 1 --2- 172.21.15.80:0/4168261518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f133c0b6230 0x7f133c0aae20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1330014040 tx=0x7f1330004750 comp rx=0 tx=0).stop 2024-05-10T04:26:41.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.423+0000 7f1342800700 1 -- 172.21.15.80:0/4168261518 shutdown_connections 2024-05-10T04:26:41.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.423+0000 7f1342800700 1 --2- 172.21.15.80:0/4168261518 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f131c06acc0 0x7f131c06d1d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:41.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.423+0000 7f1342800700 1 --2- 172.21.15.80:0/4168261518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f133c0b6230 0x7f133c0aae20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:41.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.423+0000 7f1342800700 1 --2- 172.21.15.80:0/4168261518 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c0d0c90 0x7f133c15cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:41.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.423+0000 7f1342800700 1 --2- 172.21.15.80:0/4168261518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f133c0b98e0 0x7f133c1f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:41.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.423+0000 7f1342800700 1 -- 172.21.15.80:0/4168261518 >> 172.21.15.80:0/4168261518 conn(0x7f133c0676c0 msgr2=0x7f133c0b7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:41.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.423+0000 7f1342800700 1 -- 172.21.15.80:0/4168261518 shutdown_connections 2024-05-10T04:26:41.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.423+0000 7f1342800700 1 -- 172.21.15.80:0/4168261518 wait complete. 2024-05-10T04:26:41.425 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-05-10T04:26:41.450 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T04:26:41.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:26:41.450 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T04:26:41.521 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-05-10T04:26:41.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:26:41.522 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T04:26:41.564 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:26:41.564 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:26:41.611 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16343288k,nr_inodes=4085822,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275204k,mode=700,uid=1000,gid=1304 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2024-05-10T04:26:41.612 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:26:41.612 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:26:41.654 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16343248k,nr_inodes=4085812,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275196k,mode=700,uid=1000,gid=1304 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2024-05-10T04:26:41.655 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:26:41.656 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:26:41.700 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16343288k,nr_inodes=4085822,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275204k,mode=700,uid=1000,gid=1304 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2024-05-10T04:26:41.700 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:26:41.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.959+0000 7f607a000700 1 Processor -- start 2024-05-10T04:26:41.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.960+0000 7f607a000700 1 -- start start 2024-05-10T04:26:41.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.961+0000 7f607a000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f60740b6270 0x7f60740b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:41.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.961+0000 7f607a000700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60740b20e0 con 0x7f607406b340 2024-05-10T04:26:41.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.961+0000 7f607a000700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607415e8b0 con 0x7f60740cb0e0 2024-05-10T04:26:41.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.961+0000 7f607a000700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60740b13c0 con 0x7f60740b6270 2024-05-10T04:26:41.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.962+0000 7f606be00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f607406b340 0x7f6074161fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:57330/0 (socket says 172.21.15.80:57330) 2024-05-10T04:26:41.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.962+0000 7f6073e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f60740b6270 0x7f60740b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:41.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.962+0000 7f606be00700 1 -- 172.21.15.80:0/3095625882 learned_addr learned my addr 172.21.15.80:0/3095625882 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:41.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.962+0000 7f6073e00700 1 -- 172.21.15.80:0/3095625882 >> v1:172.21.15.106:6789/0 conn(0x7f60740cb0e0 legacy=0x7f607406ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:41.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.962+0000 7f6073e00700 1 -- 172.21.15.80:0/3095625882 >> v1:172.21.15.80:6789/0 conn(0x7f607406b340 legacy=0x7f6074161fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:41.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.962+0000 7f6073e00700 1 -- 172.21.15.80:0/3095625882 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60740d1970 con 0x7f60740b6270 2024-05-10T04:26:41.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.962+0000 7f6073e00700 1 --2- 172.21.15.80:0/3095625882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60740b6270 0x7f60740b5cb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f606c009d90 tx=0x7f606c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead192991e9c6e3a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:41.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.963+0000 7f6072a00700 1 -- 172.21.15.80:0/3095625882 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c00e070 con 0x7f60740b6270 2024-05-10T04:26:41.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.963+0000 7f6072a00700 1 -- 172.21.15.80:0/3095625882 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c00bbd0 con 0x7f60740b6270 2024-05-10T04:26:41.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.963+0000 7f6072a00700 1 -- 172.21.15.80:0/3095625882 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c012430 con 0x7f60740b6270 2024-05-10T04:26:41.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.963+0000 7f607a000700 1 -- 172.21.15.80:0/3095625882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60740b6270 msgr2=0x7f60740b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:41.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.963+0000 7f607a000700 1 --2- 172.21.15.80:0/3095625882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60740b6270 0x7f60740b5cb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f606c009d90 tx=0x7f606c00b330 comp rx=0 tx=0).stop 2024-05-10T04:26:41.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.964+0000 7f607a000700 1 -- 172.21.15.80:0/3095625882 shutdown_connections 2024-05-10T04:26:41.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.964+0000 7f607a000700 1 --2- 172.21.15.80:0/3095625882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60740b6270 0x7f60740b5cb0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:41.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.964+0000 7f607a000700 1 -- 172.21.15.80:0/3095625882 >> 172.21.15.80:0/3095625882 conn(0x7f60740d0a90 msgr2=0x7f60740d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:41.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.964+0000 7f607a000700 1 -- 172.21.15.80:0/3095625882 shutdown_connections 2024-05-10T04:26:41.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.964+0000 7f607a000700 1 -- 172.21.15.80:0/3095625882 wait complete. 2024-05-10T04:26:41.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.966+0000 7f607a000700 1 Processor -- start 2024-05-10T04:26:41.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.966+0000 7f607a000700 1 -- start start 2024-05-10T04:26:41.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.967+0000 7f607a000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60740b6270 0x7f607415b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:41.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.967+0000 7f607a000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60740cb0e0 0x7f60740aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:41.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.968+0000 7f607a000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f607406f900 0x7f607406fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:41.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.968+0000 7f607a000700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60740adb80 con 0x7f60740cb0e0 2024-05-10T04:26:41.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.968+0000 7f607a000700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60740afa10 con 0x7f60740b6270 2024-05-10T04:26:41.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.968+0000 7f607a000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607415bc30 con 0x7f607406f900 2024-05-10T04:26:41.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.968+0000 7f606be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60740cb0e0 0x7f60740aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:41.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.968+0000 7f606be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60740cb0e0 0x7f60740aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47760/0 (socket says 172.21.15.80:47760) 2024-05-10T04:26:41.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.968+0000 7f606be00700 1 -- 172.21.15.80:0/4290210029 learned_addr learned my addr 172.21.15.80:0/4290210029 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:41.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.968+0000 7f6073400700 1 --2- 172.21.15.80:0/4290210029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60740b6270 0x7f607415b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:41.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.968+0000 7f6073e00700 1 --2- 172.21.15.80:0/4290210029 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f607406f900 0x7f607406fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:41.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.968+0000 7f606be00700 1 -- 172.21.15.80:0/4290210029 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f607406f900 msgr2=0x7f607406fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:41.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.968+0000 7f606be00700 1 --2- 172.21.15.80:0/4290210029 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f607406f900 0x7f607406fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:41.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.968+0000 7f606be00700 1 -- 172.21.15.80:0/4290210029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60740b6270 msgr2=0x7f607415b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:41.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.968+0000 7f606be00700 1 --2- 172.21.15.80:0/4290210029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60740b6270 0x7f607415b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:41.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.968+0000 7f606be00700 1 -- 172.21.15.80:0/4290210029 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c009a70 con 0x7f60740cb0e0 2024-05-10T04:26:41.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.969+0000 7f606be00700 1 --2- 172.21.15.80:0/4290210029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60740cb0e0 0x7f60740aebb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f605c00c480 tx=0x7f605c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:41.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.969+0000 7f606b400700 1 -- 172.21.15.80:0/4290210029 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c005d70 con 0x7f60740cb0e0 2024-05-10T04:26:41.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.969+0000 7f606b400700 1 -- 172.21.15.80:0/4290210029 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c0070d0 con 0x7f60740cb0e0 2024-05-10T04:26:41.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.969+0000 7f607a000700 1 -- 172.21.15.80:0/4290210029 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6074070250 con 0x7f60740cb0e0 2024-05-10T04:26:41.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.969+0000 7f606b400700 1 -- 172.21.15.80:0/4290210029 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c007440 con 0x7f60740cb0e0 2024-05-10T04:26:41.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.969+0000 7f607a000700 1 -- 172.21.15.80:0/4290210029 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60741f44f0 con 0x7f60740cb0e0 2024-05-10T04:26:41.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.970+0000 7f607a000700 1 -- 172.21.15.80:0/4290210029 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60740af4e0 con 0x7f60740cb0e0 2024-05-10T04:26:41.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.971+0000 7f606b400700 1 -- 172.21.15.80:0/4290210029 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f605c0075a0 con 0x7f60740cb0e0 2024-05-10T04:26:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.972+0000 7f606b400700 1 --2- 172.21.15.80:0/4290210029 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f605006ac90 0x7f605006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.972+0000 7f606b400700 1 -- 172.21.15.80:0/4290210029 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f605c0888a0 con 0x7f60740cb0e0 2024-05-10T04:26:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.972+0000 7f6073400700 1 --2- 172.21.15.80:0/4290210029 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f605006ac90 0x7f605006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:41.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.973+0000 7f6073400700 1 --2- 172.21.15.80:0/4290210029 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f605006ac90 0x7f605006d1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6064000f60 tx=0x7f6064009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:41.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:41.977+0000 7f606b400700 1 -- 172.21.15.80:0/4290210029 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f605c053a90 con 0x7f60740cb0e0 2024-05-10T04:26:42.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.229+0000 7f607a000700 1 -- 172.21.15.80:0/4290210029 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60741f4fd0 con 0x7f60740cb0e0 2024-05-10T04:26:42.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.229+0000 7f606b400700 1 -- 172.21.15.80:0/4290210029 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f605c017090 con 0x7f60740cb0e0 2024-05-10T04:26:42.229 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:26:42.230 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6834/607016626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":607016626},{"type":"v1","addr":"172.21.15.80:6834","nonce":607016626}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4981,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1819064685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1819064685},{"type":"v1","addr":"172.21.15.106:6836","nonce":1819064685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4984,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3006235418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3006235418},{"type":"v1","addr":"172.21.15.106:6837","nonce":3006235418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:23:54.993823+0000","modified":"2024-05-10T04:23:58.429131+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6835/707679728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":707679728},{"type":"v1","addr":"172.21.15.80:6835","nonce":707679728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-10T04:26:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.231+0000 7f607a000700 1 -- 172.21.15.80:0/4290210029 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f605006ac90 msgr2=0x7f605006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.231+0000 7f607a000700 1 --2- 172.21.15.80:0/4290210029 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f605006ac90 0x7f605006d1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6064000f60 tx=0x7f6064009040 comp rx=0 tx=0).stop 2024-05-10T04:26:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.232+0000 7f607a000700 1 -- 172.21.15.80:0/4290210029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60740cb0e0 msgr2=0x7f60740aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.232+0000 7f607a000700 1 --2- 172.21.15.80:0/4290210029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60740cb0e0 0x7f60740aebb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f605c00c480 tx=0x7f605c00c840 comp rx=0 tx=0).stop 2024-05-10T04:26:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.232+0000 7f607a000700 1 -- 172.21.15.80:0/4290210029 shutdown_connections 2024-05-10T04:26:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.232+0000 7f607a000700 1 --2- 172.21.15.80:0/4290210029 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f605006ac90 0x7f605006d1a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:42.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.232+0000 7f607a000700 1 --2- 172.21.15.80:0/4290210029 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f607406f900 0x7f607406fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:42.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.232+0000 7f607a000700 1 --2- 172.21.15.80:0/4290210029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60740b6270 0x7f607415b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:42.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.232+0000 7f607a000700 1 --2- 172.21.15.80:0/4290210029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60740cb0e0 0x7f60740aebb0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:42.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.232+0000 7f607a000700 1 -- 172.21.15.80:0/4290210029 >> 172.21.15.80:0/4290210029 conn(0x7f60740d0a90 msgr2=0x7f60740cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:42.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.232+0000 7f607a000700 1 -- 172.21.15.80:0/4290210029 shutdown_connections 2024-05-10T04:26:42.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.232+0000 7f607a000700 1 -- 172.21.15.80:0/4290210029 wait complete. 2024-05-10T04:26:42.233 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 16 2024-05-10T04:26:42.257 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:26:42.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.518+0000 7f99f6800700 1 Processor -- start 2024-05-10T04:26:42.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.519+0000 7f99f6800700 1 -- start start 2024-05-10T04:26:42.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.520+0000 7f99f6800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99f00b9420 0x7f99f00d2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:42.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.520+0000 7f99f6800700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f99f00d3220 0x7f99f00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:42.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.520+0000 7f99f6800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f00d2850 con 0x7f99f00cf360 2024-05-10T04:26:42.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.520+0000 7f99f6800700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f00d3630 con 0x7f99f00d3220 2024-05-10T04:26:42.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.520+0000 7f99f6800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f00d25b0 con 0x7f99f00b9420 2024-05-10T04:26:42.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.521+0000 7f99f5400700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f99f00cf360 0x7f99f0161d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:57346/0 (socket says 172.21.15.80:57346) 2024-05-10T04:26:42.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.521+0000 7f99f5400700 1 -- 172.21.15.80:0/4225159412 learned_addr learned my addr 172.21.15.80:0/4225159412 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:42.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.521+0000 7f99f4a00700 1 --2- 172.21.15.80:0/4225159412 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99f00b9420 0x7f99f00d2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:42.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.521+0000 7f99f5e00700 1 --2- 172.21.15.80:0/4225159412 >> v2:172.21.15.106:3300/0 conn(0x7f99f00d3220 0x7f99f00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:42.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.521+0000 7f99efe00700 1 -- 172.21.15.80:0/4225159412 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591953547 0 0) 0x7f99f00d2850 con 0x7f99f00cf360 2024-05-10T04:26:42.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.521+0000 7f99efe00700 1 -- 172.21.15.80:0/4225159412 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99d80035b0 con 0x7f99f00cf360 2024-05-10T04:26:42.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.521+0000 7f99f4a00700 1 -- 172.21.15.80:0/4225159412 >> v2:172.21.15.106:3300/0 conn(0x7f99f00d3220 msgr2=0x7f99f00b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:42.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.521+0000 7f99f4a00700 1 --2- 172.21.15.80:0/4225159412 >> v2:172.21.15.106:3300/0 conn(0x7f99f00d3220 0x7f99f00b7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:42.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.521+0000 7f99f4a00700 1 -- 172.21.15.80:0/4225159412 >> v1:172.21.15.80:6789/0 conn(0x7f99f00cf360 legacy=0x7f99f0161d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:42.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.521+0000 7f99f4a00700 1 -- 172.21.15.80:0/4225159412 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f00cf770 con 0x7f99f00b9420 2024-05-10T04:26:42.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.522+0000 7f99f4a00700 1 --2- 172.21.15.80:0/4225159412 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99f00b9420 0x7f99f00d2ce0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f99dc009840 tx=0x7f99dc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f224207ffb16af83 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:42.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.522+0000 7f99efe00700 1 -- 172.21.15.80:0/4225159412 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc011830 con 0x7f99f00b9420 2024-05-10T04:26:42.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.522+0000 7f99efe00700 1 -- 172.21.15.80:0/4225159412 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc011990 con 0x7f99f00b9420 2024-05-10T04:26:42.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.522+0000 7f99efe00700 1 -- 172.21.15.80:0/4225159412 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc011d20 con 0x7f99f00b9420 2024-05-10T04:26:42.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.523+0000 7f99f6800700 1 -- 172.21.15.80:0/4225159412 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99f00b9420 msgr2=0x7f99f00d2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:42.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.523+0000 7f99f6800700 1 --2- 172.21.15.80:0/4225159412 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99f00b9420 0x7f99f00d2ce0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f99dc009840 tx=0x7f99dc009b50 comp rx=0 tx=0).stop 2024-05-10T04:26:42.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.523+0000 7f99f6800700 1 -- 172.21.15.80:0/4225159412 shutdown_connections 2024-05-10T04:26:42.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.523+0000 7f99f6800700 1 --2- 172.21.15.80:0/4225159412 >> v2:172.21.15.106:3300/0 conn(0x7f99f00d3220 0x7f99f00b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:42.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.523+0000 7f99f6800700 1 --2- 172.21.15.80:0/4225159412 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99f00b9420 0x7f99f00d2ce0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:42.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.523+0000 7f99f6800700 1 -- 172.21.15.80:0/4225159412 >> 172.21.15.80:0/4225159412 conn(0x7f99f006c4e0 msgr2=0x7f99f006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:42.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.523+0000 7f99f6800700 1 -- 172.21.15.80:0/4225159412 shutdown_connections 2024-05-10T04:26:42.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.523+0000 7f99f6800700 1 -- 172.21.15.80:0/4225159412 wait complete. 2024-05-10T04:26:42.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.525+0000 7f99f6800700 1 Processor -- start 2024-05-10T04:26:42.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.525+0000 7f99f6800700 1 -- start start 2024-05-10T04:26:42.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f6800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99f00b9420 0x7f99f015a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:42.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f6800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99f00cf360 0x7f99f014be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:42.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f6800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99f00d3220 0x7f99f0157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:42.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f6800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f015af20 con 0x7f99f00b9420 2024-05-10T04:26:42.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f6800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f0157f20 con 0x7f99f00d3220 2024-05-10T04:26:42.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f6800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f00cb7e0 con 0x7f99f00cf360 2024-05-10T04:26:42.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f5400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99f00b9420 0x7f99f015a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:42.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f5400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99f00b9420 0x7f99f015a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47770/0 (socket says 172.21.15.80:47770) 2024-05-10T04:26:42.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f5400700 1 -- 172.21.15.80:0/1160499920 learned_addr learned my addr 172.21.15.80:0/1160499920 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:42.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f5e00700 1 --2- 172.21.15.80:0/1160499920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99f00d3220 0x7f99f0157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:42.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f4a00700 1 --2- 172.21.15.80:0/1160499920 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99f00cf360 0x7f99f014be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:42.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f5400700 1 -- 172.21.15.80:0/1160499920 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99f00cf360 msgr2=0x7f99f014be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:42.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f5400700 1 --2- 172.21.15.80:0/1160499920 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99f00cf360 0x7f99f014be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:42.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f5400700 1 -- 172.21.15.80:0/1160499920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99f00d3220 msgr2=0x7f99f0157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:42.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f5400700 1 --2- 172.21.15.80:0/1160499920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99f00d3220 0x7f99f0157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:42.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f5400700 1 -- 172.21.15.80:0/1160499920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc0094a0 con 0x7f99f00b9420 2024-05-10T04:26:42.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f4a00700 1 --2- 172.21.15.80:0/1160499920 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99f00cf360 0x7f99f014be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:26:42.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.527+0000 7f99f5e00700 1 --2- 172.21.15.80:0/1160499920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99f00d3220 0x7f99f0157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:26:42.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.528+0000 7f99f5400700 1 --2- 172.21.15.80:0/1160499920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99f00b9420 0x7f99f015a950 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f99e4001eb0 tx=0x7f99e400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:42.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.528+0000 7f99ed600700 1 -- 172.21.15.80:0/1160499920 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e4005d70 con 0x7f99f00b9420 2024-05-10T04:26:42.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.528+0000 7f99ed600700 1 -- 172.21.15.80:0/1160499920 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e40070d0 con 0x7f99f00b9420 2024-05-10T04:26:42.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.528+0000 7f99ed600700 1 -- 172.21.15.80:0/1160499920 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e4007460 con 0x7f99f00b9420 2024-05-10T04:26:42.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.528+0000 7f99f6800700 1 -- 172.21.15.80:0/1160499920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f00cabd0 con 0x7f99f00b9420 2024-05-10T04:26:42.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.528+0000 7f99f6800700 1 -- 172.21.15.80:0/1160499920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f00cb190 con 0x7f99f00b9420 2024-05-10T04:26:42.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.529+0000 7f99f6800700 1 -- 172.21.15.80:0/1160499920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f0074af0 con 0x7f99f00b9420 2024-05-10T04:26:42.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.530+0000 7f99ed600700 1 -- 172.21.15.80:0/1160499920 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f99e40075c0 con 0x7f99f00b9420 2024-05-10T04:26:42.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.531+0000 7f99ed600700 1 --2- 172.21.15.80:0/1160499920 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f99d006ac90 0x7f99d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:42.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.531+0000 7f99ed600700 1 -- 172.21.15.80:0/1160499920 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99e40888f0 con 0x7f99f00b9420 2024-05-10T04:26:42.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.532+0000 7f99f4a00700 1 --2- 172.21.15.80:0/1160499920 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f99d006ac90 0x7f99d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:42.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.532+0000 7f99f4a00700 1 --2- 172.21.15.80:0/1160499920 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f99d006ac90 0x7f99d006d1a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f99dc000c00 tx=0x7f99dc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:42.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.536+0000 7f99ed600700 1 -- 172.21.15.80:0/1160499920 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f99e4053a40 con 0x7f99f00b9420 2024-05-10T04:26:42.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.741+0000 7f99f6800700 1 -- 172.21.15.80:0/1160499920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99f006cb00 con 0x7f99f00b9420 2024-05-10T04:26:42.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.743+0000 7f99ed600700 1 -- 172.21.15.80:0/1160499920 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16101 (secure 0 0 0) 0x7f99e4017020 con 0x7f99f00b9420 2024-05-10T04:26:42.743 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:26:42.743 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":34,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:23:55.996940+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:23:52.881736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T04:23:53.974964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:26:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.745+0000 7f99f6800700 1 -- 172.21.15.80:0/1160499920 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f99d006ac90 msgr2=0x7f99d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.745+0000 7f99f6800700 1 --2- 172.21.15.80:0/1160499920 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f99d006ac90 0x7f99d006d1a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f99dc000c00 tx=0x7f99dc008030 comp rx=0 tx=0).stop 2024-05-10T04:26:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.745+0000 7f99f6800700 1 -- 172.21.15.80:0/1160499920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99f00b9420 msgr2=0x7f99f015a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.745+0000 7f99f6800700 1 --2- 172.21.15.80:0/1160499920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99f00b9420 0x7f99f015a950 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f99e4001eb0 tx=0x7f99e400c860 comp rx=0 tx=0).stop 2024-05-10T04:26:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.745+0000 7f99f6800700 1 -- 172.21.15.80:0/1160499920 shutdown_connections 2024-05-10T04:26:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.745+0000 7f99f6800700 1 --2- 172.21.15.80:0/1160499920 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f99d006ac90 0x7f99d006d1a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.745+0000 7f99f6800700 1 --2- 172.21.15.80:0/1160499920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99f00b9420 0x7f99f015a950 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.745+0000 7f99f6800700 1 --2- 172.21.15.80:0/1160499920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99f00d3220 0x7f99f0157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.745+0000 7f99f6800700 1 --2- 172.21.15.80:0/1160499920 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99f00cf360 0x7f99f014be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.745+0000 7f99f6800700 1 -- 172.21.15.80:0/1160499920 >> 172.21.15.80:0/1160499920 conn(0x7f99f006c4e0 msgr2=0x7f99f00b76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.746+0000 7f99f6800700 1 -- 172.21.15.80:0/1160499920 shutdown_connections 2024-05-10T04:26:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:42.746+0000 7f99f6800700 1 -- 172.21.15.80:0/1160499920 wait complete. 2024-05-10T04:26:42.772 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:22:26.793377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:23:52.881736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:23:53.974964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:26:42.773 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:26:43.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.037+0000 7f1b13200700 1 Processor -- start 2024-05-10T04:26:43.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.038+0000 7f1b13200700 1 -- start start 2024-05-10T04:26:43.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.039+0000 7f1b13200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1b140cdb30 0x7f1b140cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:43.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.039+0000 7f1b13200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b140b1cd0 0x7f1b140d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:43.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.039+0000 7f1b13200700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b140d05b0 con 0x7f1b140b12f0 2024-05-10T04:26:43.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.039+0000 7f1b13200700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b140ce0a0 con 0x7f1b140cdb30 2024-05-10T04:26:43.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.039+0000 7f1b13200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b140caf90 con 0x7f1b140b1cd0 2024-05-10T04:26:43.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.039+0000 7f1b11400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1b140cdb30 0x7f1b140cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:43.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.039+0000 7f1b11e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1b140b12f0 0x7f1b140b37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58756/0 (socket says 172.21.15.80:58756) 2024-05-10T04:26:43.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.040+0000 7f1b11e00700 1 -- 172.21.15.80:0/1932966818 learned_addr learned my addr 172.21.15.80:0/1932966818 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:43.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.040+0000 7f1b12800700 1 --2- 172.21.15.80:0/1932966818 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b140b1cd0 0x7f1b140d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:43.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.040+0000 7f1b11400700 1 -- 172.21.15.80:0/1932966818 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b140b1cd0 msgr2=0x7f1b140d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:43.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.040+0000 7f1b11400700 1 --2- 172.21.15.80:0/1932966818 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b140b1cd0 0x7f1b140d0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.040+0000 7f1b11400700 1 -- 172.21.15.80:0/1932966818 >> v1:172.21.15.80:6789/0 conn(0x7f1b140b12f0 legacy=0x7f1b140b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:43.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.040+0000 7f1b11400700 1 -- 172.21.15.80:0/1932966818 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b140cb270 con 0x7f1b140cdb30 2024-05-10T04:26:43.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.040+0000 7f1b10a00700 1 -- 172.21.15.80:0/1932966818 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233781734 0 0) 0x7f1b140d05b0 con 0x7f1b140b12f0 2024-05-10T04:26:43.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.040+0000 7f1b11400700 1 --2- 172.21.15.80:0/1932966818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b140cdb30 0x7f1b140cfb30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009840 tx=0x7f1b00009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1149662f8eb8892 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:43.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.041+0000 7f1b10a00700 1 -- 172.21.15.80:0/1932966818 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00011830 con 0x7f1b140cdb30 2024-05-10T04:26:43.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.041+0000 7f1b10a00700 1 -- 172.21.15.80:0/1932966818 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b00011990 con 0x7f1b140cdb30 2024-05-10T04:26:43.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.041+0000 7f1b10a00700 1 -- 172.21.15.80:0/1932966818 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00011d20 con 0x7f1b140cdb30 2024-05-10T04:26:43.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.041+0000 7f1b13200700 1 -- 172.21.15.80:0/1932966818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b140cdb30 msgr2=0x7f1b140cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:43.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.041+0000 7f1b13200700 1 --2- 172.21.15.80:0/1932966818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b140cdb30 0x7f1b140cfb30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009840 tx=0x7f1b00009b50 comp rx=0 tx=0).stop 2024-05-10T04:26:43.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.041+0000 7f1b13200700 1 -- 172.21.15.80:0/1932966818 shutdown_connections 2024-05-10T04:26:43.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.041+0000 7f1b13200700 1 --2- 172.21.15.80:0/1932966818 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b140b1cd0 0x7f1b140d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.041+0000 7f1b13200700 1 --2- 172.21.15.80:0/1932966818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b140cdb30 0x7f1b140cfb30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.041+0000 7f1b13200700 1 -- 172.21.15.80:0/1932966818 >> 172.21.15.80:0/1932966818 conn(0x7f1b140b24d0 msgr2=0x7f1b140b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:43.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.042+0000 7f1b13200700 1 -- 172.21.15.80:0/1932966818 shutdown_connections 2024-05-10T04:26:43.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.042+0000 7f1b13200700 1 -- 172.21.15.80:0/1932966818 wait complete. 2024-05-10T04:26:43.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.044+0000 7f1b13200700 1 Processor -- start 2024-05-10T04:26:43.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.044+0000 7f1b13200700 1 -- start start 2024-05-10T04:26:43.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.045+0000 7f1b13200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b140b1cd0 0x7f1b140afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:43.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.045+0000 7f1b13200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b140cdb30 0x7f1b14154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:43.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.046+0000 7f1b13200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b1409b9c0 0x7f1b14160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:43.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.046+0000 7f1b13200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b141f5110 con 0x7f1b1409b9c0 2024-05-10T04:26:43.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.046+0000 7f1b13200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b140b0060 con 0x7f1b140b1cd0 2024-05-10T04:26:43.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.046+0000 7f1b13200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b14154570 con 0x7f1b140cdb30 2024-05-10T04:26:43.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.046+0000 7f1b12800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b1409b9c0 0x7f1b14160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:43.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.046+0000 7f1b12800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b1409b9c0 0x7f1b14160800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43828/0 (socket says 172.21.15.80:43828) 2024-05-10T04:26:43.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.046+0000 7f1b12800700 1 -- 172.21.15.80:0/38570739 learned_addr learned my addr 172.21.15.80:0/38570739 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:43.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.046+0000 7f1b11400700 1 --2- 172.21.15.80:0/38570739 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b140cdb30 0x7f1b14154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:43.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.046+0000 7f1b11e00700 1 --2- 172.21.15.80:0/38570739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b140b1cd0 0x7f1b140afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:43.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.046+0000 7f1b12800700 1 -- 172.21.15.80:0/38570739 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b140cdb30 msgr2=0x7f1b14154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:43.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.046+0000 7f1b12800700 1 --2- 172.21.15.80:0/38570739 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b140cdb30 0x7f1b14154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.046+0000 7f1b12800700 1 -- 172.21.15.80:0/38570739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b140b1cd0 msgr2=0x7f1b140afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:43.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.046+0000 7f1b12800700 1 --2- 172.21.15.80:0/38570739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b140b1cd0 0x7f1b140afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.046+0000 7f1b12800700 1 -- 172.21.15.80:0/38570739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b000094a0 con 0x7f1b1409b9c0 2024-05-10T04:26:43.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.046+0000 7f1b11e00700 1 --2- 172.21.15.80:0/38570739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b140b1cd0 0x7f1b140afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:26:43.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.047+0000 7f1b12800700 1 --2- 172.21.15.80:0/38570739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b1409b9c0 0x7f1b14160800 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00ef90 tx=0x7f1b0c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:43.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.047+0000 7f1b0a000700 1 -- 172.21.15.80:0/38570739 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c009b20 con 0x7f1b1409b9c0 2024-05-10T04:26:43.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.047+0000 7f1b0a000700 1 -- 172.21.15.80:0/38570739 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c00f040 con 0x7f1b1409b9c0 2024-05-10T04:26:43.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.047+0000 7f1b13200700 1 -- 172.21.15.80:0/38570739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1409a960 con 0x7f1b1409b9c0 2024-05-10T04:26:43.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.047+0000 7f1b0a000700 1 -- 172.21.15.80:0/38570739 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c00cd20 con 0x7f1b1409b9c0 2024-05-10T04:26:43.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.047+0000 7f1b13200700 1 -- 172.21.15.80:0/38570739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1409aee0 con 0x7f1b1409b9c0 2024-05-10T04:26:43.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.048+0000 7f1b13200700 1 -- 172.21.15.80:0/38570739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1406ce20 con 0x7f1b1409b9c0 2024-05-10T04:26:43.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.049+0000 7f1b0a000700 1 -- 172.21.15.80:0/38570739 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1b0c014480 con 0x7f1b1409b9c0 2024-05-10T04:26:43.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.050+0000 7f1b0a000700 1 --2- 172.21.15.80:0/38570739 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1af406acc0 0x7f1af406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:43.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.051+0000 7f1b0a000700 1 -- 172.21.15.80:0/38570739 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b0c089e00 con 0x7f1b1409b9c0 2024-05-10T04:26:43.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.051+0000 7f1b11e00700 1 --2- 172.21.15.80:0/38570739 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1af406acc0 0x7f1af406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:43.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.052+0000 7f1b11e00700 1 --2- 172.21.15.80:0/38570739 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1af406acc0 0x7f1af406d1d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1b04000f60 tx=0x7f1b04007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:43.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.055+0000 7f1b0a000700 1 -- 172.21.15.80:0/38570739 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1b0c054f40 con 0x7f1b1409b9c0 2024-05-10T04:26:43.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.261+0000 7f1b13200700 1 -- 172.21.15.80:0/38570739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b14074af0 con 0x7f1b1409b9c0 2024-05-10T04:26:43.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.262+0000 7f1b0a000700 1 -- 172.21.15.80:0/38570739 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b0c018020 con 0x7f1b1409b9c0 2024-05-10T04:26:43.262 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-10T04:26:43.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.265+0000 7f1b13200700 1 -- 172.21.15.80:0/38570739 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1af406acc0 msgr2=0x7f1af406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:43.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.265+0000 7f1b13200700 1 --2- 172.21.15.80:0/38570739 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1af406acc0 0x7f1af406d1d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1b04000f60 tx=0x7f1b04007d30 comp rx=0 tx=0).stop 2024-05-10T04:26:43.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.265+0000 7f1b13200700 1 -- 172.21.15.80:0/38570739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b1409b9c0 msgr2=0x7f1b14160800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:43.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.265+0000 7f1b13200700 1 --2- 172.21.15.80:0/38570739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b1409b9c0 0x7f1b14160800 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00ef90 tx=0x7f1b0c009f60 comp rx=0 tx=0).stop 2024-05-10T04:26:43.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.265+0000 7f1b13200700 1 -- 172.21.15.80:0/38570739 shutdown_connections 2024-05-10T04:26:43.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.265+0000 7f1b13200700 1 --2- 172.21.15.80:0/38570739 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f1af406acc0 0x7f1af406d1d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.265+0000 7f1b13200700 1 --2- 172.21.15.80:0/38570739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b1409b9c0 0x7f1b14160800 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.265+0000 7f1b13200700 1 --2- 172.21.15.80:0/38570739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b140b1cd0 0x7f1b140afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.265+0000 7f1b13200700 1 --2- 172.21.15.80:0/38570739 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b140cdb30 0x7f1b14154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.265+0000 7f1b13200700 1 -- 172.21.15.80:0/38570739 >> 172.21.15.80:0/38570739 conn(0x7f1b140b24d0 msgr2=0x7f1b1406fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:43.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.265+0000 7f1b13200700 1 -- 172.21.15.80:0/38570739 shutdown_connections 2024-05-10T04:26:43.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.265+0000 7f1b13200700 1 -- 172.21.15.80:0/38570739 wait complete. 2024-05-10T04:26:43.292 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:26:43.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.554+0000 7fa27f200700 1 Processor -- start 2024-05-10T04:26:43.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.554+0000 7fa27f200700 1 -- start start 2024-05-10T04:26:43.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.555+0000 7fa27f200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa27815e610 0x7fa2780b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:43.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.555+0000 7fa27f200700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa2780b7910 0x7fa27806c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:43.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.556+0000 7fa27f200700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2780d2c00 con 0x7fa278162150 2024-05-10T04:26:43.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.556+0000 7fa27f200700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa27815ea20 con 0x7fa2780b7910 2024-05-10T04:26:43.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.556+0000 7fa27f200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa278162630 con 0x7fa27815e610 2024-05-10T04:26:43.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.556+0000 7fa277e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa278162150 0x7fa2780cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58770/0 (socket says 172.21.15.80:58770) 2024-05-10T04:26:43.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.556+0000 7fa277e00700 1 -- 172.21.15.80:0/3447012136 learned_addr learned my addr 172.21.15.80:0/3447012136 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:43.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.556+0000 7fa277400700 1 --2- 172.21.15.80:0/3447012136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa27815e610 0x7fa2780b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:43.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.556+0000 7fa27d200700 1 --2- 172.21.15.80:0/3447012136 >> v2:172.21.15.106:3300/0 conn(0x7fa2780b7910 0x7fa27806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:43.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.556+0000 7fa276a00700 1 -- 172.21.15.80:0/3447012136 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850039073 0 0) 0x7fa2780d2c00 con 0x7fa278162150 2024-05-10T04:26:43.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.556+0000 7fa276a00700 1 -- 172.21.15.80:0/3447012136 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa25c0035b0 con 0x7fa278162150 2024-05-10T04:26:43.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.557+0000 7fa27d200700 1 -- 172.21.15.80:0/3447012136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa27815e610 msgr2=0x7fa2780b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:43.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.557+0000 7fa27d200700 1 --2- 172.21.15.80:0/3447012136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa27815e610 0x7fa2780b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.557+0000 7fa27d200700 1 -- 172.21.15.80:0/3447012136 >> v1:172.21.15.80:6789/0 conn(0x7fa278162150 legacy=0x7fa2780cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:43.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.557+0000 7fa27d200700 1 -- 172.21.15.80:0/3447012136 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa278162910 con 0x7fa2780b7910 2024-05-10T04:26:43.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.557+0000 7fa277400700 1 --2- 172.21.15.80:0/3447012136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa27815e610 0x7fa2780b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:26:43.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.557+0000 7fa27d200700 1 --2- 172.21.15.80:0/3447012136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2780b7910 0x7fa27806c160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa270009d90 tx=0x7fa27000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e004667101b52796 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:43.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.557+0000 7fa276a00700 1 -- 172.21.15.80:0/3447012136 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27000e070 con 0x7fa2780b7910 2024-05-10T04:26:43.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.557+0000 7fa276a00700 1 -- 172.21.15.80:0/3447012136 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27000bb20 con 0x7fa2780b7910 2024-05-10T04:26:43.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.557+0000 7fa276a00700 1 -- 172.21.15.80:0/3447012136 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270012430 con 0x7fa2780b7910 2024-05-10T04:26:43.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.558+0000 7fa27f200700 1 -- 172.21.15.80:0/3447012136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2780b7910 msgr2=0x7fa27806c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:43.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.558+0000 7fa27f200700 1 --2- 172.21.15.80:0/3447012136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2780b7910 0x7fa27806c160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa270009d90 tx=0x7fa27000b330 comp rx=0 tx=0).stop 2024-05-10T04:26:43.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.558+0000 7fa27f200700 1 -- 172.21.15.80:0/3447012136 shutdown_connections 2024-05-10T04:26:43.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.558+0000 7fa27f200700 1 --2- 172.21.15.80:0/3447012136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2780b7910 0x7fa27806c160 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.558+0000 7fa27f200700 1 --2- 172.21.15.80:0/3447012136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa27815e610 0x7fa2780b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.558+0000 7fa27f200700 1 -- 172.21.15.80:0/3447012136 >> 172.21.15.80:0/3447012136 conn(0x7fa2780d3e10 msgr2=0x7fa2780d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:43.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.558+0000 7fa27f200700 1 -- 172.21.15.80:0/3447012136 shutdown_connections 2024-05-10T04:26:43.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.558+0000 7fa27f200700 1 -- 172.21.15.80:0/3447012136 wait complete. 2024-05-10T04:26:43.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.560+0000 7fa27f200700 1 Processor -- start 2024-05-10T04:26:43.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.560+0000 7fa27f200700 1 -- start start 2024-05-10T04:26:43.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.562+0000 7fa27f200700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2780b7910 0x7fa2780ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:43.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.562+0000 7fa27f200700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa27815e610 0x7fa2780cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:43.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.562+0000 7fa27f200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa278162150 0x7fa278160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:43.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.562+0000 7fa27f200700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa278158030 con 0x7fa278162150 2024-05-10T04:26:43.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.562+0000 7fa27f200700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa278149120 con 0x7fa2780b7910 2024-05-10T04:26:43.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.562+0000 7fa27f200700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780cd720 con 0x7fa27815e610 2024-05-10T04:26:43.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.562+0000 7fa27d200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa278162150 0x7fa278160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:43.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.562+0000 7fa277400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa27815e610 0x7fa2780cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:43.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.562+0000 7fa277400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa27815e610 0x7fa2780cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:51632/0 (socket says 172.21.15.80:51632) 2024-05-10T04:26:43.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.562+0000 7fa277e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2780b7910 0x7fa2780ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:43.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.562+0000 7fa277400700 1 -- 172.21.15.80:0/2788270995 learned_addr learned my addr 172.21.15.80:0/2788270995 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:43.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.562+0000 7fa27d200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa278162150 0x7fa278160770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43836/0 (socket says 172.21.15.80:43836) 2024-05-10T04:26:43.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.563+0000 7fa27d200700 1 -- 172.21.15.80:0/2788270995 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa27815e610 msgr2=0x7fa2780cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:43.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.563+0000 7fa27d200700 1 --2- 172.21.15.80:0/2788270995 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa27815e610 0x7fa2780cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.563+0000 7fa27d200700 1 -- 172.21.15.80:0/2788270995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2780b7910 msgr2=0x7fa2780ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:43.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.563+0000 7fa27d200700 1 --2- 172.21.15.80:0/2788270995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2780b7910 0x7fa2780ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.563+0000 7fa27d200700 1 -- 172.21.15.80:0/2788270995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2640094a0 con 0x7fa278162150 2024-05-10T04:26:43.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.563+0000 7fa27d200700 1 --2- 172.21.15.80:0/2788270995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa278162150 0x7fa278160770 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa270016000 tx=0x7fa270004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:43.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.563+0000 7fa26fe00700 1 -- 172.21.15.80:0/2788270995 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270012430 con 0x7fa278162150 2024-05-10T04:26:43.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.563+0000 7fa26fe00700 1 -- 172.21.15.80:0/2788270995 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa270020070 con 0x7fa278162150 2024-05-10T04:26:43.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.563+0000 7fa27f200700 1 -- 172.21.15.80:0/2788270995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa270009a70 con 0x7fa278162150 2024-05-10T04:26:43.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.563+0000 7fa26fe00700 1 -- 172.21.15.80:0/2788270995 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2700098f0 con 0x7fa278162150 2024-05-10T04:26:43.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.564+0000 7fa27f200700 1 -- 172.21.15.80:0/2788270995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2780ce2a0 con 0x7fa278162150 2024-05-10T04:26:43.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.565+0000 7fa27f200700 1 -- 172.21.15.80:0/2788270995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa278074af0 con 0x7fa278162150 2024-05-10T04:26:43.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.566+0000 7fa26fe00700 1 -- 172.21.15.80:0/2788270995 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa270004040 con 0x7fa278162150 2024-05-10T04:26:43.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.566+0000 7fa26fe00700 1 --2- 172.21.15.80:0/2788270995 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa25806ac90 0x7fa25806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:43.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.566+0000 7fa26fe00700 1 -- 172.21.15.80:0/2788270995 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa270022070 con 0x7fa278162150 2024-05-10T04:26:43.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.567+0000 7fa277e00700 1 --2- 172.21.15.80:0/2788270995 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa25806ac90 0x7fa25806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:43.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.568+0000 7fa277e00700 1 --2- 172.21.15.80:0/2788270995 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa25806ac90 0x7fa25806d1a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa268007fd0 tx=0x7fa268007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:43.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.571+0000 7fa26fe00700 1 -- 172.21.15.80:0/2788270995 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa2700562a0 con 0x7fa278162150 2024-05-10T04:26:43.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.774+0000 7fa27f200700 1 -- 172.21.15.80:0/2788270995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2780b3550 con 0x7fa278162150 2024-05-10T04:26:43.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.774+0000 7fa26fe00700 1 -- 172.21.15.80:0/2788270995 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa2700598c0 con 0x7fa278162150 2024-05-10T04:26:43.775 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-10T04:26:43.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.776+0000 7fa27f200700 1 -- 172.21.15.80:0/2788270995 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa25806ac90 msgr2=0x7fa25806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:43.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.776+0000 7fa27f200700 1 --2- 172.21.15.80:0/2788270995 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa25806ac90 0x7fa25806d1a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa268007fd0 tx=0x7fa268007dc0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.776+0000 7fa27f200700 1 -- 172.21.15.80:0/2788270995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa278162150 msgr2=0x7fa278160770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:43.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.776+0000 7fa27f200700 1 --2- 172.21.15.80:0/2788270995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa278162150 0x7fa278160770 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa270016000 tx=0x7fa270004ad0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.777+0000 7fa27f200700 1 -- 172.21.15.80:0/2788270995 shutdown_connections 2024-05-10T04:26:43.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.777+0000 7fa27f200700 1 --2- 172.21.15.80:0/2788270995 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa25806ac90 0x7fa25806d1a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.777+0000 7fa27f200700 1 --2- 172.21.15.80:0/2788270995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa278162150 0x7fa278160770 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.777+0000 7fa27f200700 1 --2- 172.21.15.80:0/2788270995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2780b7910 0x7fa2780ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.777+0000 7fa27f200700 1 --2- 172.21.15.80:0/2788270995 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa27815e610 0x7fa2780cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:43.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.777+0000 7fa27f200700 1 -- 172.21.15.80:0/2788270995 >> 172.21.15.80:0/2788270995 conn(0x7fa2780d3e10 msgr2=0x7fa27815bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:43.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.777+0000 7fa27f200700 1 -- 172.21.15.80:0/2788270995 shutdown_connections 2024-05-10T04:26:43.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:43.777+0000 7fa27f200700 1 -- 172.21.15.80:0/2788270995 wait complete. 2024-05-10T04:26:43.804 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:26:44.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.065+0000 7f0f2ec00700 1 Processor -- start 2024-05-10T04:26:44.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.066+0000 7f0f2ec00700 1 -- start start 2024-05-10T04:26:44.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.067+0000 7f0f2ec00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f28162a10 0x7f0f280b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:44.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.067+0000 7f0f2ec00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f280d0a00 0x7f0f280d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:44.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.067+0000 7f0f2ec00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f28162e20 con 0x7f0f2815f610 2024-05-10T04:26:44.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.067+0000 7f0f2ec00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f280b34c0 con 0x7f0f28162a10 2024-05-10T04:26:44.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.067+0000 7f0f2ec00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f280d1350 con 0x7f0f280d0a00 2024-05-10T04:26:44.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.068+0000 7f0f2d800700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0f2815f610 0x7f0f280cea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58780/0 (socket says 172.21.15.80:58780) 2024-05-10T04:26:44.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.068+0000 7f0f2ce00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f28162a10 0x7f0f280b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:44.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.068+0000 7f0f2d800700 1 -- 172.21.15.80:0/3982364922 learned_addr learned my addr 172.21.15.80:0/3982364922 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:44.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.068+0000 7f0f2e200700 1 --2- 172.21.15.80:0/3982364922 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f280d0a00 0x7f0f280d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:44.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.068+0000 7f0f2ce00700 1 -- 172.21.15.80:0/3982364922 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f280d0a00 msgr2=0x7f0f280d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:44.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.068+0000 7f0f2ce00700 1 --2- 172.21.15.80:0/3982364922 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f280d0a00 0x7f0f280d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:44.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.068+0000 7f0f2ce00700 1 -- 172.21.15.80:0/3982364922 >> v1:172.21.15.80:6789/0 conn(0x7f0f2815f610 legacy=0x7f0f280cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:44.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.068+0000 7f0f2ce00700 1 -- 172.21.15.80:0/3982364922 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f280cf160 con 0x7f0f28162a10 2024-05-10T04:26:44.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.068+0000 7f0f27e00700 1 -- 172.21.15.80:0/3982364922 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227844856 0 0) 0x7f0f28162e20 con 0x7f0f2815f610 2024-05-10T04:26:44.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.068+0000 7f0f2ce00700 1 --2- 172.21.15.80:0/3982364922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f28162a10 0x7f0f280b2f80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0f280b3600 tx=0x7f0f14009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c3391764a94729 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:44.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.069+0000 7f0f27e00700 1 -- 172.21.15.80:0/3982364922 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14004020 con 0x7f0f28162a10 2024-05-10T04:26:44.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.069+0000 7f0f27e00700 1 -- 172.21.15.80:0/3982364922 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f14004180 con 0x7f0f28162a10 2024-05-10T04:26:44.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.069+0000 7f0f27e00700 1 -- 172.21.15.80:0/3982364922 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14004530 con 0x7f0f28162a10 2024-05-10T04:26:44.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.069+0000 7f0f2ec00700 1 -- 172.21.15.80:0/3982364922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f28162a10 msgr2=0x7f0f280b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:44.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.069+0000 7f0f2ec00700 1 --2- 172.21.15.80:0/3982364922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f28162a10 0x7f0f280b2f80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0f280b3600 tx=0x7f0f14009b20 comp rx=0 tx=0).stop 2024-05-10T04:26:44.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.069+0000 7f0f2ec00700 1 -- 172.21.15.80:0/3982364922 shutdown_connections 2024-05-10T04:26:44.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.069+0000 7f0f2ec00700 1 --2- 172.21.15.80:0/3982364922 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f280d0a00 0x7f0f280d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:44.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.069+0000 7f0f2ec00700 1 --2- 172.21.15.80:0/3982364922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f28162a10 0x7f0f280b2f80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:44.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.069+0000 7f0f2ec00700 1 -- 172.21.15.80:0/3982364922 >> 172.21.15.80:0/3982364922 conn(0x7f0f2806c4e0 msgr2=0x7f0f2806c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:44.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.070+0000 7f0f2ec00700 1 -- 172.21.15.80:0/3982364922 shutdown_connections 2024-05-10T04:26:44.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.070+0000 7f0f2ec00700 1 -- 172.21.15.80:0/3982364922 wait complete. 2024-05-10T04:26:44.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.072+0000 7f0f2ec00700 1 Processor -- start 2024-05-10T04:26:44.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.072+0000 7f0f2ec00700 1 -- start start 2024-05-10T04:26:44.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.073+0000 7f0f2ec00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f280d0a00 0x7f0f280b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:44.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.073+0000 7f0f2ec00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f2815f610 0x7f0f280c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:44.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.073+0000 7f0f2ec00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f28162a10 0x7f0f280c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:44.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.073+0000 7f0f2ec00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f281f4010 con 0x7f0f28162a10 2024-05-10T04:26:44.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.073+0000 7f0f2ec00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f280b47b0 con 0x7f0f280d0a00 2024-05-10T04:26:44.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.073+0000 7f0f2ec00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f280b5330 con 0x7f0f2815f610 2024-05-10T04:26:44.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.074+0000 7f0f2e200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f28162a10 0x7f0f280c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:44.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.074+0000 7f0f2e200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f28162a10 0x7f0f280c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43868/0 (socket says 172.21.15.80:43868) 2024-05-10T04:26:44.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.074+0000 7f0f2e200700 1 -- 172.21.15.80:0/2430303165 learned_addr learned my addr 172.21.15.80:0/2430303165 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:44.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.074+0000 7f0f2ce00700 1 --2- 172.21.15.80:0/2430303165 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f2815f610 0x7f0f280c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:44.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.074+0000 7f0f2d800700 1 --2- 172.21.15.80:0/2430303165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f280d0a00 0x7f0f280b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:44.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.074+0000 7f0f2e200700 1 -- 172.21.15.80:0/2430303165 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f2815f610 msgr2=0x7f0f280c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:44.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.074+0000 7f0f2e200700 1 --2- 172.21.15.80:0/2430303165 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f2815f610 0x7f0f280c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:44.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.074+0000 7f0f2e200700 1 -- 172.21.15.80:0/2430303165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f280d0a00 msgr2=0x7f0f280b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:44.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.074+0000 7f0f2e200700 1 --2- 172.21.15.80:0/2430303165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f280d0a00 0x7f0f280b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:44.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.074+0000 7f0f2e200700 1 -- 172.21.15.80:0/2430303165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f140094a0 con 0x7f0f28162a10 2024-05-10T04:26:44.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.074+0000 7f0f2ce00700 1 --2- 172.21.15.80:0/2430303165 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f2815f610 0x7f0f280c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:26:44.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.074+0000 7f0f2d800700 1 --2- 172.21.15.80:0/2430303165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f280d0a00 0x7f0f280b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:26:44.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.074+0000 7f0f2e200700 1 --2- 172.21.15.80:0/2430303165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f28162a10 0x7f0f280c93f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0f20007d80 tx=0x7f0f2000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:44.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.074+0000 7f0f25600700 1 -- 172.21.15.80:0/2430303165 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2000ede0 con 0x7f0f28162a10 2024-05-10T04:26:44.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.075+0000 7f0f25600700 1 -- 172.21.15.80:0/2430303165 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f20014420 con 0x7f0f28162a10 2024-05-10T04:26:44.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.075+0000 7f0f25600700 1 -- 172.21.15.80:0/2430303165 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f200147d0 con 0x7f0f28162a10 2024-05-10T04:26:44.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.075+0000 7f0f2ec00700 1 -- 172.21.15.80:0/2430303165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f280b4a00 con 0x7f0f28162a10 2024-05-10T04:26:44.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.075+0000 7f0f2ec00700 1 -- 172.21.15.80:0/2430303165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f280b4fc0 con 0x7f0f28162a10 2024-05-10T04:26:44.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.076+0000 7f0f2ec00700 1 -- 172.21.15.80:0/2430303165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f28074af0 con 0x7f0f28162a10 2024-05-10T04:26:44.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.077+0000 7f0f25600700 1 -- 172.21.15.80:0/2430303165 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0f20014930 con 0x7f0f28162a10 2024-05-10T04:26:44.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.078+0000 7f0f25600700 1 --2- 172.21.15.80:0/2430303165 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0f0806acc0 0x7f0f0806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:44.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.078+0000 7f0f25600700 1 -- 172.21.15.80:0/2430303165 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f20089a50 con 0x7f0f28162a10 2024-05-10T04:26:44.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.078+0000 7f0f2d800700 1 --2- 172.21.15.80:0/2430303165 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0f0806acc0 0x7f0f0806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:44.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.079+0000 7f0f2d800700 1 --2- 172.21.15.80:0/2430303165 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0f0806acc0 0x7f0f0806d1d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c007fd0 tx=0x7f0f1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:44.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.082+0000 7f0f25600700 1 -- 172.21.15.80:0/2430303165 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0f20054c20 con 0x7f0f28162a10 2024-05-10T04:26:44.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.292+0000 7f0f2ec00700 1 -- 172.21.15.80:0/2430303165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f280d2080 con 0x7f0f28162a10 2024-05-10T04:26:44.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.293+0000 7f0f25600700 1 -- 172.21.15.80:0/2430303165 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f20058240 con 0x7f0f28162a10 2024-05-10T04:26:44.294 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-10T04:26:44.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.295+0000 7f0f2ec00700 1 -- 172.21.15.80:0/2430303165 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0f0806acc0 msgr2=0x7f0f0806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:44.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.295+0000 7f0f2ec00700 1 --2- 172.21.15.80:0/2430303165 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0f0806acc0 0x7f0f0806d1d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c007fd0 tx=0x7f0f1c009040 comp rx=0 tx=0).stop 2024-05-10T04:26:44.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.295+0000 7f0f2ec00700 1 -- 172.21.15.80:0/2430303165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f28162a10 msgr2=0x7f0f280c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:44.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.295+0000 7f0f2ec00700 1 --2- 172.21.15.80:0/2430303165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f28162a10 0x7f0f280c93f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0f20007d80 tx=0x7f0f2000e3c0 comp rx=0 tx=0).stop 2024-05-10T04:26:44.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.295+0000 7f0f2ec00700 1 -- 172.21.15.80:0/2430303165 shutdown_connections 2024-05-10T04:26:44.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.295+0000 7f0f2ec00700 1 --2- 172.21.15.80:0/2430303165 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0f0806acc0 0x7f0f0806d1d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:44.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.295+0000 7f0f2ec00700 1 --2- 172.21.15.80:0/2430303165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f28162a10 0x7f0f280c93f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:44.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.295+0000 7f0f2ec00700 1 --2- 172.21.15.80:0/2430303165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f280d0a00 0x7f0f280b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:44.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.295+0000 7f0f2ec00700 1 --2- 172.21.15.80:0/2430303165 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f2815f610 0x7f0f280c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:44.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.295+0000 7f0f2ec00700 1 -- 172.21.15.80:0/2430303165 >> 172.21.15.80:0/2430303165 conn(0x7f0f2806c4e0 msgr2=0x7f0f2815df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:44.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.295+0000 7f0f2ec00700 1 -- 172.21.15.80:0/2430303165 shutdown_connections 2024-05-10T04:26:44.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.295+0000 7f0f2ec00700 1 -- 172.21.15.80:0/2430303165 wait complete. 2024-05-10T04:26:44.323 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:26:44.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.580+0000 7f5066600700 1 Processor -- start 2024-05-10T04:26:44.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.580+0000 7f5066600700 1 -- start start 2024-05-10T04:26:44.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.582+0000 7f5066600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f50601627f0 0x7f50600b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:44.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.582+0000 7f5066600700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50600d2730 con 0x7f50600b5fc0 2024-05-10T04:26:44.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.582+0000 7f5066600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50600d2fd0 con 0x7f50600d3460 2024-05-10T04:26:44.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.582+0000 7f5066600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5060162c00 con 0x7f50601627f0 2024-05-10T04:26:44.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.582+0000 7f5057e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f50600b5fc0 0x7f50601620e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58790/0 (socket says 172.21.15.80:58790) 2024-05-10T04:26:44.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.582+0000 7f5057e00700 1 -- 172.21.15.80:0/3715557536 learned_addr learned my addr 172.21.15.80:0/3715557536 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:44.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.582+0000 7f505fe00700 1 --2- 172.21.15.80:0/3715557536 >> v2:172.21.15.80:3300/0 conn(0x7f50601627f0 0x7f50600b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:44.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.583+0000 7f505fe00700 1 -- 172.21.15.80:0/3715557536 >> v1:172.21.15.106:6789/0 conn(0x7f50600d3460 legacy=0x7f50600b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:44.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.583+0000 7f505fe00700 1 -- 172.21.15.80:0/3715557536 >> v1:172.21.15.80:6789/0 conn(0x7f50600b5fc0 legacy=0x7f50601620e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:44.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.583+0000 7f505fe00700 1 -- 172.21.15.80:0/3715557536 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5060162e10 con 0x7f50601627f0 2024-05-10T04:26:44.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.583+0000 7f505ea00700 1 -- 172.21.15.80:0/3715557536 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751237545 0 0) 0x7f50600d2730 con 0x7f50600b5fc0 2024-05-10T04:26:44.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.583+0000 7f505fe00700 1 --2- 172.21.15.80:0/3715557536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50601627f0 0x7f50600b31e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5058009d90 tx=0x7f505800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee23d01da9dd076f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:44.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.583+0000 7f505ea00700 1 -- 172.21.15.80:0/3715557536 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505800e070 con 0x7f50601627f0 2024-05-10T04:26:44.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.583+0000 7f505ea00700 1 -- 172.21.15.80:0/3715557536 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505800bbd0 con 0x7f50601627f0 2024-05-10T04:26:44.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.583+0000 7f505ea00700 1 -- 172.21.15.80:0/3715557536 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058012430 con 0x7f50601627f0 2024-05-10T04:26:44.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.584+0000 7f5066600700 1 -- 172.21.15.80:0/3715557536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50601627f0 msgr2=0x7f50600b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:44.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.584+0000 7f5066600700 1 --2- 172.21.15.80:0/3715557536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50601627f0 0x7f50600b31e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5058009d90 tx=0x7f505800b330 comp rx=0 tx=0).stop 2024-05-10T04:26:44.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.584+0000 7f5066600700 1 -- 172.21.15.80:0/3715557536 shutdown_connections 2024-05-10T04:26:44.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.584+0000 7f5066600700 1 --2- 172.21.15.80:0/3715557536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50601627f0 0x7f50600b31e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:44.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.584+0000 7f5066600700 1 -- 172.21.15.80:0/3715557536 >> 172.21.15.80:0/3715557536 conn(0x7f50600d0a90 msgr2=0x7f50600d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:44.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.584+0000 7f5066600700 1 -- 172.21.15.80:0/3715557536 shutdown_connections 2024-05-10T04:26:44.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.584+0000 7f5066600700 1 -- 172.21.15.80:0/3715557536 wait complete. 2024-05-10T04:26:44.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.587+0000 7f5066600700 1 Processor -- start 2024-05-10T04:26:44.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.587+0000 7f5066600700 1 -- start start 2024-05-10T04:26:44.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.588+0000 7f5066600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50600d3460 0x7f506015ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:44.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.588+0000 7f5066600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50601627f0 0x7f5060158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:44.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.588+0000 7f5066600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5060156d90 0x7f50601571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:44.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.588+0000 7f5066600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50601f56c0 con 0x7f50601627f0 2024-05-10T04:26:44.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.588+0000 7f5066600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5060159940 con 0x7f50600d3460 2024-05-10T04:26:44.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.588+0000 7f5066600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506015a7a0 con 0x7f5060156d90 2024-05-10T04:26:44.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.588+0000 7f5057e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50601627f0 0x7f5060158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:44.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.589+0000 7f5057e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50601627f0 0x7f5060158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43888/0 (socket says 172.21.15.80:43888) 2024-05-10T04:26:44.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.589+0000 7f5057e00700 1 -- 172.21.15.80:0/2316321384 learned_addr learned my addr 172.21.15.80:0/2316321384 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:44.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.589+0000 7f505f400700 1 --2- 172.21.15.80:0/2316321384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50600d3460 0x7f506015ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:44.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.589+0000 7f505fe00700 1 --2- 172.21.15.80:0/2316321384 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5060156d90 0x7f50601571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:44.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.589+0000 7f5057e00700 1 -- 172.21.15.80:0/2316321384 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5060156d90 msgr2=0x7f50601571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:44.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.589+0000 7f5057e00700 1 --2- 172.21.15.80:0/2316321384 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5060156d90 0x7f50601571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:44.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.589+0000 7f5057e00700 1 -- 172.21.15.80:0/2316321384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50600d3460 msgr2=0x7f506015ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:44.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.589+0000 7f5057e00700 1 --2- 172.21.15.80:0/2316321384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50600d3460 0x7f506015ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:44.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.589+0000 7f5057e00700 1 -- 172.21.15.80:0/2316321384 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5058009a70 con 0x7f50601627f0 2024-05-10T04:26:44.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.589+0000 7f505fe00700 1 --2- 172.21.15.80:0/2316321384 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5060156d90 0x7f50601571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:26:44.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.589+0000 7f5057e00700 1 --2- 172.21.15.80:0/2316321384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50601627f0 0x7f5060158d90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f504800c520 tx=0x7f504800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:44.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.589+0000 7f5057400700 1 -- 172.21.15.80:0/2316321384 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048004c80 con 0x7f50601627f0 2024-05-10T04:26:44.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.589+0000 7f5057400700 1 -- 172.21.15.80:0/2316321384 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5048004de0 con 0x7f50601627f0 2024-05-10T04:26:44.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.590+0000 7f5066600700 1 -- 172.21.15.80:0/2316321384 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5060159660 con 0x7f50601627f0 2024-05-10T04:26:44.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.590+0000 7f5057400700 1 -- 172.21.15.80:0/2316321384 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048007310 con 0x7f50601627f0 2024-05-10T04:26:44.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.590+0000 7f5066600700 1 -- 172.21.15.80:0/2316321384 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5060159e70 con 0x7f50601627f0 2024-05-10T04:26:44.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.591+0000 7f5066600700 1 -- 172.21.15.80:0/2316321384 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50600732b0 con 0x7f50601627f0 2024-05-10T04:26:44.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.592+0000 7f5057400700 1 -- 172.21.15.80:0/2316321384 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5048007470 con 0x7f50601627f0 2024-05-10T04:26:44.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.593+0000 7f5057400700 1 --2- 172.21.15.80:0/2316321384 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f503c06acc0 0x7f503c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:44.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.593+0000 7f5057400700 1 -- 172.21.15.80:0/2316321384 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5048088f80 con 0x7f50601627f0 2024-05-10T04:26:44.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.594+0000 7f505f400700 1 --2- 172.21.15.80:0/2316321384 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f503c06acc0 0x7f503c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:44.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.594+0000 7f505f400700 1 --2- 172.21.15.80:0/2316321384 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f503c06acc0 0x7f503c06d1d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5050007fd0 tx=0x7f5050009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:44.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.598+0000 7f5057400700 1 -- 172.21.15.80:0/2316321384 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f50480540c0 con 0x7f50601627f0 2024-05-10T04:26:44.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.845+0000 7f5066600700 1 -- 172.21.15.80:0/2316321384 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50600d3c10 con 0x7f50601627f0 2024-05-10T04:26:44.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.845+0000 7f5057400700 1 -- 172.21.15.80:0/2316321384 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f50480576e0 con 0x7f50601627f0 2024-05-10T04:26:44.847 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:26:44.847 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6834/607016626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":607016626},{"type":"v1","addr":"172.21.15.80:6834","nonce":607016626}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4981,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1819064685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1819064685},{"type":"v1","addr":"172.21.15.106:6836","nonce":1819064685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4984,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3006235418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3006235418},{"type":"v1","addr":"172.21.15.106:6837","nonce":3006235418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:23:54.993823+0000","modified":"2024-05-10T04:23:58.429131+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6835/707679728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":707679728},{"type":"v1","addr":"172.21.15.80:6835","nonce":707679728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-10T04:26:44.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.848+0000 7f5066600700 1 -- 172.21.15.80:0/2316321384 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f503c06acc0 msgr2=0x7f503c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:44.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.848+0000 7f5066600700 1 --2- 172.21.15.80:0/2316321384 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f503c06acc0 0x7f503c06d1d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5050007fd0 tx=0x7f5050009040 comp rx=0 tx=0).stop 2024-05-10T04:26:44.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.848+0000 7f5066600700 1 -- 172.21.15.80:0/2316321384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50601627f0 msgr2=0x7f5060158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:44.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.848+0000 7f5066600700 1 --2- 172.21.15.80:0/2316321384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50601627f0 0x7f5060158d90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f504800c520 tx=0x7f504800c830 comp rx=0 tx=0).stop 2024-05-10T04:26:44.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.848+0000 7f5066600700 1 -- 172.21.15.80:0/2316321384 shutdown_connections 2024-05-10T04:26:44.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.848+0000 7f5066600700 1 --2- 172.21.15.80:0/2316321384 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f503c06acc0 0x7f503c06d1d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:44.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.848+0000 7f5066600700 1 --2- 172.21.15.80:0/2316321384 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5060156d90 0x7f50601571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:44.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.848+0000 7f5066600700 1 --2- 172.21.15.80:0/2316321384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50600d3460 0x7f506015ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:44.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.848+0000 7f5066600700 1 --2- 172.21.15.80:0/2316321384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50601627f0 0x7f5060158d90 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:44.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.848+0000 7f5066600700 1 -- 172.21.15.80:0/2316321384 >> 172.21.15.80:0/2316321384 conn(0x7f50600d0a90 msgr2=0x7f50600d46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:44.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.848+0000 7f5066600700 1 -- 172.21.15.80:0/2316321384 shutdown_connections 2024-05-10T04:26:44.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:44.848+0000 7f5066600700 1 -- 172.21.15.80:0/2316321384 wait complete. 2024-05-10T04:26:44.851 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 16 2024-05-10T04:26:44.874 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:26:45.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.134+0000 7f98ece00700 1 Processor -- start 2024-05-10T04:26:45.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.134+0000 7f98ece00700 1 -- start start 2024-05-10T04:26:45.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.136+0000 7f98ece00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f98e80b2f50 0x7f98e8161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:45.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.136+0000 7f98ece00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f98e80d3030 0x7f98e80d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:45.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.136+0000 7f98ece00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e80d28c0 con 0x7f98e80d0630 2024-05-10T04:26:45.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.136+0000 7f98ece00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e80b3360 con 0x7f98e80d3030 2024-05-10T04:26:45.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.136+0000 7f98ece00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e81624e0 con 0x7f98e80b2f50 2024-05-10T04:26:45.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.136+0000 7f98e5400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f98e80d3030 0x7f98e80d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.136+0000 7f98e5400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f98e80d3030 0x7f98e80d3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43904/0 (socket says 172.21.15.80:43904) 2024-05-10T04:26:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.136+0000 7f98e5400700 1 -- 172.21.15.80:0/503756564 learned_addr learned my addr 172.21.15.80:0/503756564 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.136+0000 7f98e5e00700 1 --2- 172.21.15.80:0/503756564 >> v2:172.21.15.106:3300/0 conn(0x7f98e80b2f50 0x7f98e8161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.136+0000 7f98e5400700 1 -- 172.21.15.80:0/503756564 >> v2:172.21.15.106:3300/0 conn(0x7f98e80b2f50 msgr2=0x7f98e8161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.136+0000 7f98e5400700 1 --2- 172.21.15.80:0/503756564 >> v2:172.21.15.106:3300/0 conn(0x7f98e80b2f50 0x7f98e8161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.137+0000 7f98e5400700 1 -- 172.21.15.80:0/503756564 >> v1:172.21.15.106:6789/0 conn(0x7f98e80d0630 legacy=0x7f98e80d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.137+0000 7f98e5400700 1 -- 172.21.15.80:0/503756564 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e80d2ba0 con 0x7f98e80d3030 2024-05-10T04:26:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.137+0000 7f98e5400700 1 --2- 172.21.15.80:0/503756564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98e80d3030 0x7f98e80d3440 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f98e806d410 tx=0x7f98d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d4e091f27552f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.137+0000 7f98e4a00700 1 -- 172.21.15.80:0/503756564 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d400b860 con 0x7f98e80d3030 2024-05-10T04:26:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.137+0000 7f98e4a00700 1 -- 172.21.15.80:0/503756564 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d400b9c0 con 0x7f98e80d3030 2024-05-10T04:26:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.137+0000 7f98e4a00700 1 -- 172.21.15.80:0/503756564 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d400bd50 con 0x7f98e80d3030 2024-05-10T04:26:45.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.138+0000 7f98ece00700 1 -- 172.21.15.80:0/503756564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98e80d3030 msgr2=0x7f98e80d3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:45.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.138+0000 7f98ece00700 1 --2- 172.21.15.80:0/503756564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98e80d3030 0x7f98e80d3440 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f98e806d410 tx=0x7f98d4009c00 comp rx=0 tx=0).stop 2024-05-10T04:26:45.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.138+0000 7f98ece00700 1 -- 172.21.15.80:0/503756564 shutdown_connections 2024-05-10T04:26:45.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.138+0000 7f98ece00700 1 --2- 172.21.15.80:0/503756564 >> v2:172.21.15.106:3300/0 conn(0x7f98e80b2f50 0x7f98e8161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.138+0000 7f98ece00700 1 --2- 172.21.15.80:0/503756564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98e80d3030 0x7f98e80d3440 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.138+0000 7f98ece00700 1 -- 172.21.15.80:0/503756564 >> 172.21.15.80:0/503756564 conn(0x7f98e806c3f0 msgr2=0x7f98e806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:45.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.138+0000 7f98ece00700 1 -- 172.21.15.80:0/503756564 shutdown_connections 2024-05-10T04:26:45.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.138+0000 7f98ece00700 1 -- 172.21.15.80:0/503756564 wait complete. 2024-05-10T04:26:45.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.140+0000 7f98ece00700 1 Processor -- start 2024-05-10T04:26:45.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.140+0000 7f98ece00700 1 -- start start 2024-05-10T04:26:45.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.142+0000 7f98ece00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f98e80b2f50 0x7f98e81eaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:45.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.142+0000 7f98ece00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98e80d0630 0x7f98e8144040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:45.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.142+0000 7f98ece00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98e80d3030 0x7f98e8144580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:45.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.142+0000 7f98ece00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e8153970 con 0x7f98e80d0630 2024-05-10T04:26:45.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.142+0000 7f98ece00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e8145380 con 0x7f98e80d3030 2024-05-10T04:26:45.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.142+0000 7f98ece00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e8159820 con 0x7f98e80b2f50 2024-05-10T04:26:45.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.142+0000 7f98e5400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98e80d0630 0x7f98e8144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:45.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.142+0000 7f98e5400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98e80d0630 0x7f98e8144040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43916/0 (socket says 172.21.15.80:43916) 2024-05-10T04:26:45.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.142+0000 7f98e5400700 1 -- 172.21.15.80:0/3160634867 learned_addr learned my addr 172.21.15.80:0/3160634867 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:45.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.142+0000 7f98e5e00700 1 --2- 172.21.15.80:0/3160634867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f98e80b2f50 0x7f98e81eaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:45.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.142+0000 7f98e6800700 1 --2- 172.21.15.80:0/3160634867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98e80d3030 0x7f98e8144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:45.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.143+0000 7f98e5400700 1 -- 172.21.15.80:0/3160634867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f98e80b2f50 msgr2=0x7f98e81eaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:45.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.143+0000 7f98e5400700 1 --2- 172.21.15.80:0/3160634867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f98e80b2f50 0x7f98e81eaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.143+0000 7f98e5400700 1 -- 172.21.15.80:0/3160634867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98e80d3030 msgr2=0x7f98e8144580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:45.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.143+0000 7f98e5400700 1 --2- 172.21.15.80:0/3160634867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98e80d3030 0x7f98e8144580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.143+0000 7f98e5400700 1 -- 172.21.15.80:0/3160634867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d4009550 con 0x7f98e80d0630 2024-05-10T04:26:45.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.143+0000 7f98e5400700 1 --2- 172.21.15.80:0/3160634867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98e80d0630 0x7f98e8144040 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009130 tx=0x7f98d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:45.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.143+0000 7f98de000700 1 -- 172.21.15.80:0/3160634867 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d4004450 con 0x7f98e80d0630 2024-05-10T04:26:45.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.143+0000 7f98de000700 1 -- 172.21.15.80:0/3160634867 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d401e070 con 0x7f98e80d0630 2024-05-10T04:26:45.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.143+0000 7f98de000700 1 -- 172.21.15.80:0/3160634867 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40038c0 con 0x7f98e80d0630 2024-05-10T04:26:45.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.143+0000 7f98ece00700 1 -- 172.21.15.80:0/3160634867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e8143b40 con 0x7f98e80d0630 2024-05-10T04:26:45.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.143+0000 7f98ece00700 1 -- 172.21.15.80:0/3160634867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e8159d50 con 0x7f98e80d0630 2024-05-10T04:26:45.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.144+0000 7f98ece00700 1 -- 172.21.15.80:0/3160634867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e8074af0 con 0x7f98e80d0630 2024-05-10T04:26:45.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.145+0000 7f98de000700 1 -- 172.21.15.80:0/3160634867 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f98d4003a20 con 0x7f98e80d0630 2024-05-10T04:26:45.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.146+0000 7f98de000700 1 --2- 172.21.15.80:0/3160634867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f98c806ac90 0x7f98c806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:45.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.146+0000 7f98de000700 1 -- 172.21.15.80:0/3160634867 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98d4020070 con 0x7f98e80d0630 2024-05-10T04:26:45.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.147+0000 7f98e5e00700 1 --2- 172.21.15.80:0/3160634867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f98c806ac90 0x7f98c806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:45.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.147+0000 7f98e5e00700 1 --2- 172.21.15.80:0/3160634867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f98c806ac90 0x7f98c806d1a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f98d8006b20 tx=0x7f98d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:45.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.151+0000 7f98de000700 1 -- 172.21.15.80:0/3160634867 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f98d40558d0 con 0x7f98e80d0630 2024-05-10T04:26:45.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.355+0000 7f98ece00700 1 -- 172.21.15.80:0/3160634867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98e80b34a0 con 0x7f98e80d0630 2024-05-10T04:26:45.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.356+0000 7f98de000700 1 -- 172.21.15.80:0/3160634867 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16101 (secure 0 0 0) 0x7f98d4015090 con 0x7f98e80d0630 2024-05-10T04:26:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:26:45.359 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":34,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:23:55.996940+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:23:52.881736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T04:23:53.974964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:26:45.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.359+0000 7f98ece00700 1 -- 172.21.15.80:0/3160634867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f98c806ac90 msgr2=0x7f98c806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:45.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.359+0000 7f98ece00700 1 --2- 172.21.15.80:0/3160634867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f98c806ac90 0x7f98c806d1a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f98d8006b20 tx=0x7f98d8008040 comp rx=0 tx=0).stop 2024-05-10T04:26:45.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.359+0000 7f98ece00700 1 -- 172.21.15.80:0/3160634867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98e80d0630 msgr2=0x7f98e8144040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:45.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.359+0000 7f98ece00700 1 --2- 172.21.15.80:0/3160634867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98e80d0630 0x7f98e8144040 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009130 tx=0x7f98d4004750 comp rx=0 tx=0).stop 2024-05-10T04:26:45.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.359+0000 7f98ece00700 1 -- 172.21.15.80:0/3160634867 shutdown_connections 2024-05-10T04:26:45.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.359+0000 7f98ece00700 1 --2- 172.21.15.80:0/3160634867 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f98c806ac90 0x7f98c806d1a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.359+0000 7f98ece00700 1 --2- 172.21.15.80:0/3160634867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98e80d3030 0x7f98e8144580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.359+0000 7f98ece00700 1 --2- 172.21.15.80:0/3160634867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f98e80b2f50 0x7f98e81eaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.359+0000 7f98ece00700 1 --2- 172.21.15.80:0/3160634867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98e80d0630 0x7f98e8144040 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.359+0000 7f98ece00700 1 -- 172.21.15.80:0/3160634867 >> 172.21.15.80:0/3160634867 conn(0x7f98e806c3f0 msgr2=0x7f98e80cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:45.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.359+0000 7f98ece00700 1 -- 172.21.15.80:0/3160634867 shutdown_connections 2024-05-10T04:26:45.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.359+0000 7f98ece00700 1 -- 172.21.15.80:0/3160634867 wait complete. 2024-05-10T04:26:45.385 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T04:26:45.386 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:26:45.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.645+0000 7f37ffe00700 1 Processor -- start 2024-05-10T04:26:45.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.645+0000 7f37ffe00700 1 -- start start 2024-05-10T04:26:45.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.647+0000 7f37ffe00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f38000cf360 0x7f38000b9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:45.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.647+0000 7f37ffe00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38000b7120 0x7f38000b7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:45.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.647+0000 7f37ffe00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38000d2850 con 0x7f3800161d10 2024-05-10T04:26:45.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.647+0000 7f37ffe00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38000d25b0 con 0x7f38000cf360 2024-05-10T04:26:45.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.647+0000 7f37ffe00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38000b7a70 con 0x7f38000b7120 2024-05-10T04:26:45.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.647+0000 7f37f7e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3800161d10 0x7f38000d2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58794/0 (socket says 172.21.15.80:58794) 2024-05-10T04:26:45.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.647+0000 7f37fea00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f38000cf360 0x7f38000b9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:45.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.647+0000 7f37f7e00700 1 -- 172.21.15.80:0/3177529766 learned_addr learned my addr 172.21.15.80:0/3177529766 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.648+0000 7f37ff400700 1 --2- 172.21.15.80:0/3177529766 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38000b7120 0x7f38000b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.648+0000 7f37fe000700 1 -- 172.21.15.80:0/3177529766 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425145080 0 0) 0x7f38000d2850 con 0x7f3800161d10 2024-05-10T04:26:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.648+0000 7f37fe000700 1 -- 172.21.15.80:0/3177529766 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37e40035b0 con 0x7f3800161d10 2024-05-10T04:26:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.648+0000 7f37fea00700 1 -- 172.21.15.80:0/3177529766 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38000b7120 msgr2=0x7f38000b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.648+0000 7f37fea00700 1 --2- 172.21.15.80:0/3177529766 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38000b7120 0x7f38000b7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.648+0000 7f37fea00700 1 -- 172.21.15.80:0/3177529766 >> v1:172.21.15.80:6789/0 conn(0x7f3800161d10 legacy=0x7f38000d2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.648+0000 7f37fea00700 1 -- 172.21.15.80:0/3177529766 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38000cf770 con 0x7f38000cf360 2024-05-10T04:26:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.648+0000 7f37fea00700 1 --2- 172.21.15.80:0/3177529766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38000cf360 0x7f38000b9420 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009840 tx=0x7f37f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e95b19411578a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.648+0000 7f37fe000700 1 -- 172.21.15.80:0/3177529766 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0011830 con 0x7f38000cf360 2024-05-10T04:26:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.649+0000 7f37fe000700 1 -- 172.21.15.80:0/3177529766 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f0011990 con 0x7f38000cf360 2024-05-10T04:26:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.649+0000 7f37fe000700 1 -- 172.21.15.80:0/3177529766 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0011d20 con 0x7f38000cf360 2024-05-10T04:26:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.649+0000 7f37ffe00700 1 -- 172.21.15.80:0/3177529766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38000cf360 msgr2=0x7f38000b9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.649+0000 7f37ffe00700 1 --2- 172.21.15.80:0/3177529766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38000cf360 0x7f38000b9420 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009840 tx=0x7f37f0009b50 comp rx=0 tx=0).stop 2024-05-10T04:26:45.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.649+0000 7f37ffe00700 1 -- 172.21.15.80:0/3177529766 shutdown_connections 2024-05-10T04:26:45.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.649+0000 7f37ffe00700 1 --2- 172.21.15.80:0/3177529766 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38000b7120 0x7f38000b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.649+0000 7f37ffe00700 1 --2- 172.21.15.80:0/3177529766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38000cf360 0x7f38000b9420 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.649+0000 7f37ffe00700 1 -- 172.21.15.80:0/3177529766 >> 172.21.15.80:0/3177529766 conn(0x7f380006c4e0 msgr2=0x7f380006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:45.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.649+0000 7f37ffe00700 1 -- 172.21.15.80:0/3177529766 shutdown_connections 2024-05-10T04:26:45.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.649+0000 7f37ffe00700 1 -- 172.21.15.80:0/3177529766 wait complete. 2024-05-10T04:26:45.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.652+0000 7f37ffe00700 1 Processor -- start 2024-05-10T04:26:45.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.652+0000 7f37ffe00700 1 -- start start 2024-05-10T04:26:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.653+0000 7f37ffe00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38000b7120 0x7f3800157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.653+0000 7f37ffe00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38000cf360 0x7f380015b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.653+0000 7f37ffe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3800161d10 0x7f38000cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.653+0000 7f37ffe00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380015b800 con 0x7f3800161d10 2024-05-10T04:26:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.653+0000 7f37ffe00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3800157fa0 con 0x7f38000b7120 2024-05-10T04:26:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.653+0000 7f37ffe00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3800153230 con 0x7f38000cf360 2024-05-10T04:26:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.653+0000 7f37ff400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3800161d10 0x7f38000cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.654+0000 7f37ff400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3800161d10 0x7f38000cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43934/0 (socket says 172.21.15.80:43934) 2024-05-10T04:26:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.654+0000 7f37ff400700 1 -- 172.21.15.80:0/2242539929 learned_addr learned my addr 172.21.15.80:0/2242539929 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.654+0000 7f37f7e00700 1 --2- 172.21.15.80:0/2242539929 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38000cf360 0x7f380015b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.654+0000 7f37fea00700 1 --2- 172.21.15.80:0/2242539929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38000b7120 0x7f3800157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.654+0000 7f37ff400700 1 -- 172.21.15.80:0/2242539929 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38000cf360 msgr2=0x7f380015b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:45.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.654+0000 7f37ff400700 1 --2- 172.21.15.80:0/2242539929 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38000cf360 0x7f380015b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.654+0000 7f37ff400700 1 -- 172.21.15.80:0/2242539929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38000b7120 msgr2=0x7f3800157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:45.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.654+0000 7f37ff400700 1 --2- 172.21.15.80:0/2242539929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38000b7120 0x7f3800157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.654+0000 7f37ff400700 1 -- 172.21.15.80:0/2242539929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f00094a0 con 0x7f3800161d10 2024-05-10T04:26:45.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.654+0000 7f37f7e00700 1 --2- 172.21.15.80:0/2242539929 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38000cf360 0x7f380015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:26:45.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.654+0000 7f37fea00700 1 --2- 172.21.15.80:0/2242539929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38000b7120 0x7f3800157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:26:45.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.654+0000 7f37ff400700 1 --2- 172.21.15.80:0/2242539929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3800161d10 0x7f38000cbee0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f37f800efc0 tx=0x7f37f800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:45.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.654+0000 7f37f7400700 1 -- 172.21.15.80:0/2242539929 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f8009b20 con 0x7f3800161d10 2024-05-10T04:26:45.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.654+0000 7f37f7400700 1 -- 172.21.15.80:0/2242539929 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f800f040 con 0x7f3800161d10 2024-05-10T04:26:45.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.654+0000 7f37f7400700 1 -- 172.21.15.80:0/2242539929 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f8009e50 con 0x7f3800161d10 2024-05-10T04:26:45.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.654+0000 7f37ffe00700 1 -- 172.21.15.80:0/2242539929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38000cae40 con 0x7f3800161d10 2024-05-10T04:26:45.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.655+0000 7f37ffe00700 1 -- 172.21.15.80:0/2242539929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38000cb400 con 0x7f3800161d10 2024-05-10T04:26:45.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.655+0000 7f37ffe00700 1 -- 172.21.15.80:0/2242539929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38000b28c0 con 0x7f3800161d10 2024-05-10T04:26:45.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.656+0000 7f37f7400700 1 -- 172.21.15.80:0/2242539929 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f37f8014480 con 0x7f3800161d10 2024-05-10T04:26:45.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.657+0000 7f37f7400700 1 --2- 172.21.15.80:0/2242539929 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f37dc06acc0 0x7f37dc06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:45.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.657+0000 7f37f7400700 1 -- 172.21.15.80:0/2242539929 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37f8089ec0 con 0x7f3800161d10 2024-05-10T04:26:45.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.658+0000 7f37fea00700 1 --2- 172.21.15.80:0/2242539929 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f37dc06acc0 0x7f37dc06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:45.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.658+0000 7f37fea00700 1 --2- 172.21.15.80:0/2242539929 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f37dc06acc0 0x7f37dc06d1d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009840 tx=0x7f37f0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:45.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.662+0000 7f37f7400700 1 -- 172.21.15.80:0/2242539929 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f37f8055000 con 0x7f3800161d10 2024-05-10T04:26:45.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.911+0000 7f37ffe00700 1 -- 172.21.15.80:0/2242539929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3800074af0 con 0x7f3800161d10 2024-05-10T04:26:45.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.912+0000 7f37f7400700 1 -- 172.21.15.80:0/2242539929 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f37f8018020 con 0x7f3800161d10 2024-05-10T04:26:45.913 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:26:45.913 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6834/607016626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":607016626},{"type":"v1","addr":"172.21.15.80:6834","nonce":607016626}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4981,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1819064685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1819064685},{"type":"v1","addr":"172.21.15.106:6836","nonce":1819064685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4984,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3006235418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3006235418},{"type":"v1","addr":"172.21.15.106:6837","nonce":3006235418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:23:54.993823+0000","modified":"2024-05-10T04:23:58.429131+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6835/707679728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":707679728},{"type":"v1","addr":"172.21.15.80:6835","nonce":707679728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-10T04:26:45.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.914+0000 7f37ffe00700 1 -- 172.21.15.80:0/2242539929 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f37dc06acc0 msgr2=0x7f37dc06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:45.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.914+0000 7f37ffe00700 1 --2- 172.21.15.80:0/2242539929 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f37dc06acc0 0x7f37dc06d1d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009840 tx=0x7f37f0008030 comp rx=0 tx=0).stop 2024-05-10T04:26:45.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.914+0000 7f37ffe00700 1 -- 172.21.15.80:0/2242539929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3800161d10 msgr2=0x7f38000cbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:45.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.914+0000 7f37ffe00700 1 --2- 172.21.15.80:0/2242539929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3800161d10 0x7f38000cbee0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f37f800efc0 tx=0x7f37f800c3a0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.914+0000 7f37ffe00700 1 -- 172.21.15.80:0/2242539929 shutdown_connections 2024-05-10T04:26:45.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.914+0000 7f37ffe00700 1 --2- 172.21.15.80:0/2242539929 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f37dc06acc0 0x7f37dc06d1d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.914+0000 7f37ffe00700 1 --2- 172.21.15.80:0/2242539929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3800161d10 0x7f38000cbee0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.914+0000 7f37ffe00700 1 --2- 172.21.15.80:0/2242539929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38000b7120 0x7f3800157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.914+0000 7f37ffe00700 1 --2- 172.21.15.80:0/2242539929 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38000cf360 0x7f380015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:45.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.914+0000 7f37ffe00700 1 -- 172.21.15.80:0/2242539929 >> 172.21.15.80:0/2242539929 conn(0x7f380006c4e0 msgr2=0x7f380006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:45.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.914+0000 7f37ffe00700 1 -- 172.21.15.80:0/2242539929 shutdown_connections 2024-05-10T04:26:45.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:45.914+0000 7f37ffe00700 1 -- 172.21.15.80:0/2242539929 wait complete. 2024-05-10T04:26:45.917 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 16 2024-05-10T04:26:45.941 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:26:46.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.199+0000 7fa671600700 1 Processor -- start 2024-05-10T04:26:46.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.200+0000 7fa671600700 1 -- start start 2024-05-10T04:26:46.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.201+0000 7fa671600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa66c1627f0 0x7fa66c0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:46.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.201+0000 7fa671600700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c0d2730 con 0x7fa66c0b5fc0 2024-05-10T04:26:46.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.201+0000 7fa671600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c0d2fd0 con 0x7fa66c0d3460 2024-05-10T04:26:46.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.201+0000 7fa671600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c162c00 con 0x7fa66c1627f0 2024-05-10T04:26:46.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.201+0000 7fa663e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa66c0b5fc0 0x7fa66c1620e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58808/0 (socket says 172.21.15.80:58808) 2024-05-10T04:26:46.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.201+0000 7fa663e00700 1 -- 172.21.15.80:0/1088707175 learned_addr learned my addr 172.21.15.80:0/1088707175 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:46.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.202+0000 7fa66a000700 1 -- 172.21.15.80:0/1088707175 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2531029270 0 0) 0x7fa66c0d2730 con 0x7fa66c0b5fc0 2024-05-10T04:26:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.202+0000 7fa66a000700 1 -- 172.21.15.80:0/1088707175 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6500035b0 con 0x7fa66c0b5fc0 2024-05-10T04:26:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.202+0000 7fa66b400700 1 --2- 172.21.15.80:0/1088707175 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa66c1627f0 0x7fa66c0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.202+0000 7fa66a000700 1 -- 172.21.15.80:0/1088707175 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1509272867 0 0) 0x7fa6500035b0 con 0x7fa66c0b5fc0 2024-05-10T04:26:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.202+0000 7fa66a000700 1 -- 172.21.15.80:0/1088707175 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa66c1627f0 msgr2=0x7fa66c0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.202+0000 7fa66a000700 1 --2- 172.21.15.80:0/1088707175 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa66c1627f0 0x7fa66c0b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.202+0000 7fa66a000700 1 -- 172.21.15.80:0/1088707175 >> v1:172.21.15.106:6789/0 conn(0x7fa66c0d3460 legacy=0x7fa66c0b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.202+0000 7fa66a000700 1 -- 172.21.15.80:0/1088707175 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c162e10 con 0x7fa66c0b5fc0 2024-05-10T04:26:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.202+0000 7fa66a000700 1 -- 172.21.15.80:0/1088707175 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7fa654001670 con 0x7fa66c0b5fc0 2024-05-10T04:26:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.202+0000 7fa66a000700 1 -- 172.21.15.80:0/1088707175 >> v1:172.21.15.80:6789/0 conn(0x7fa66c0b5fc0 legacy=0x7fa66c1620e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.202+0000 7fa66a000700 1 --2- 172.21.15.80:0/1088707175 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa66c1627f0 0x7fa650003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.202+0000 7fa66a000700 1 --2- 172.21.15.80:0/1088707175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa650004000 0x7fa650004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.203+0000 7fa66a000700 1 --2- 172.21.15.80:0/1088707175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa650004d90 0x7fa650005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.203+0000 7fa66a000700 1 -- 172.21.15.80:0/1088707175 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c162c00 con 0x7fa650004000 2024-05-10T04:26:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.203+0000 7fa66a000700 1 -- 172.21.15.80:0/1088707175 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65000bc00 con 0x7fa650004d90 2024-05-10T04:26:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.203+0000 7fa66a000700 1 -- 172.21.15.80:0/1088707175 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65000bdc0 con 0x7fa66c1627f0 2024-05-10T04:26:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.203+0000 7fa663e00700 1 --2- 172.21.15.80:0/1088707175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa650004000 0x7fa650004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.203+0000 7fa66aa00700 1 --2- 172.21.15.80:0/1088707175 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa66c1627f0 0x7fa650003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.203+0000 7fa66b400700 1 --2- 172.21.15.80:0/1088707175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa650004d90 0x7fa650005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.203+0000 7fa663e00700 1 -- 172.21.15.80:0/1088707175 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa66c1627f0 msgr2=0x7fa650003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.203+0000 7fa663e00700 1 --2- 172.21.15.80:0/1088707175 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa66c1627f0 0x7fa650003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.203+0000 7fa663e00700 1 -- 172.21.15.80:0/1088707175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa650004d90 msgr2=0x7fa650005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.203+0000 7fa663e00700 1 --2- 172.21.15.80:0/1088707175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa650004d90 0x7fa650005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.203+0000 7fa663e00700 1 -- 172.21.15.80:0/1088707175 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6500035b0 con 0x7fa650004000 2024-05-10T04:26:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.203+0000 7fa66b400700 1 --2- 172.21.15.80:0/1088707175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa650004d90 0x7fa650005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:26:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.203+0000 7fa663e00700 1 --2- 172.21.15.80:0/1088707175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa650004000 0x7fa650004850 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa654001eb0 tx=0x7fa650005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c96862d2a2d252a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.204+0000 7fa66a000700 1 -- 172.21.15.80:0/1088707175 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654007b70 con 0x7fa650004000 2024-05-10T04:26:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.204+0000 7fa66a000700 1 -- 172.21.15.80:0/1088707175 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65400ccf0 con 0x7fa650004000 2024-05-10T04:26:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.204+0000 7fa66a000700 1 -- 172.21.15.80:0/1088707175 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654005ba0 con 0x7fa650004000 2024-05-10T04:26:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.204+0000 7fa671600700 1 -- 172.21.15.80:0/1088707175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa650004000 msgr2=0x7fa650004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.204+0000 7fa671600700 1 --2- 172.21.15.80:0/1088707175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa650004000 0x7fa650004850 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa654001eb0 tx=0x7fa650005880 comp rx=0 tx=0).stop 2024-05-10T04:26:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.204+0000 7fa66b400700 1 -- 172.21.15.80:0/1088707175 reap_dead start 2024-05-10T04:26:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.204+0000 7fa671600700 1 -- 172.21.15.80:0/1088707175 shutdown_connections 2024-05-10T04:26:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.204+0000 7fa671600700 1 -- 172.21.15.80:0/1088707175 >> 172.21.15.80:0/1088707175 conn(0x7fa66c0d0a90 msgr2=0x7fa66c0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.205+0000 7fa671600700 1 -- 172.21.15.80:0/1088707175 shutdown_connections 2024-05-10T04:26:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.205+0000 7fa671600700 1 -- 172.21.15.80:0/1088707175 wait complete. 2024-05-10T04:26:46.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.207+0000 7fa671600700 1 Processor -- start 2024-05-10T04:26:46.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.207+0000 7fa671600700 1 -- start start 2024-05-10T04:26:46.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.208+0000 7fa671600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa650004000 0x7fa66c142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:46.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.208+0000 7fa671600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa66c0cdc90 0x7fa66c160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:46.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.208+0000 7fa671600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa66c1611f0 0x7fa66c144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:46.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.208+0000 7fa671600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c1436b0 con 0x7fa66c1611f0 2024-05-10T04:26:46.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.208+0000 7fa671600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c15a130 con 0x7fa66c0cdc90 2024-05-10T04:26:46.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.208+0000 7fa671600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c156eb0 con 0x7fa650004000 2024-05-10T04:26:46.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.209+0000 7fa66b400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa66c1611f0 0x7fa66c144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:46.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.209+0000 7fa66b400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa66c1611f0 0x7fa66c144e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43940/0 (socket says 172.21.15.80:43940) 2024-05-10T04:26:46.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.209+0000 7fa66b400700 1 -- 172.21.15.80:0/1973645353 learned_addr learned my addr 172.21.15.80:0/1973645353 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:46.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.209+0000 7fa66aa00700 1 --2- 172.21.15.80:0/1973645353 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa650004000 0x7fa66c142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:46.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.209+0000 7fa663e00700 1 --2- 172.21.15.80:0/1973645353 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa66c0cdc90 0x7fa66c160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:46.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.209+0000 7fa66b400700 1 -- 172.21.15.80:0/1973645353 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa650004000 msgr2=0x7fa66c142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:46.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.209+0000 7fa66b400700 1 --2- 172.21.15.80:0/1973645353 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa650004000 0x7fa66c142db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.209+0000 7fa66b400700 1 -- 172.21.15.80:0/1973645353 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa66c0cdc90 msgr2=0x7fa66c160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:46.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.209+0000 7fa66b400700 1 --2- 172.21.15.80:0/1973645353 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa66c0cdc90 0x7fa66c160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.209+0000 7fa66b400700 1 -- 172.21.15.80:0/1973645353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c160820 con 0x7fa66c1611f0 2024-05-10T04:26:46.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.209+0000 7fa66b400700 1 --2- 172.21.15.80:0/1973645353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa66c1611f0 0x7fa66c144e10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0ce430 tx=0x7fa6640104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:46.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.210+0000 7fa662a00700 1 -- 172.21.15.80:0/1973645353 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66401b070 con 0x7fa66c1611f0 2024-05-10T04:26:46.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.210+0000 7fa662a00700 1 -- 172.21.15.80:0/1973645353 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66400f040 con 0x7fa66c1611f0 2024-05-10T04:26:46.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.210+0000 7fa671600700 1 -- 172.21.15.80:0/1973645353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66c1576c0 con 0x7fa66c1611f0 2024-05-10T04:26:46.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.210+0000 7fa662a00700 1 -- 172.21.15.80:0/1973645353 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66400e050 con 0x7fa66c1611f0 2024-05-10T04:26:46.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.210+0000 7fa671600700 1 -- 172.21.15.80:0/1973645353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66c1573e0 con 0x7fa66c1611f0 2024-05-10T04:26:46.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.211+0000 7fa671600700 1 -- 172.21.15.80:0/1973645353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66c0732b0 con 0x7fa66c1611f0 2024-05-10T04:26:46.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.212+0000 7fa662a00700 1 -- 172.21.15.80:0/1973645353 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa664003a20 con 0x7fa66c1611f0 2024-05-10T04:26:46.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.213+0000 7fa662a00700 1 --2- 172.21.15.80:0/1973645353 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa64806ac90 0x7fa64806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:46.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.213+0000 7fa662a00700 1 -- 172.21.15.80:0/1973645353 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa664089580 con 0x7fa66c1611f0 2024-05-10T04:26:46.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.213+0000 7fa66aa00700 1 --2- 172.21.15.80:0/1973645353 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa64806ac90 0x7fa64806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:46.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.214+0000 7fa66aa00700 1 --2- 172.21.15.80:0/1973645353 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa64806ac90 0x7fa64806d1a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa65c000c00 tx=0x7fa65c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:46.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.218+0000 7fa662a00700 1 -- 172.21.15.80:0/1973645353 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa6640546c0 con 0x7fa66c1611f0 2024-05-10T04:26:46.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.469+0000 7fa671600700 1 -- 172.21.15.80:0/1973645353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa66c1605d0 con 0x7fa66c1611f0 2024-05-10T04:26:46.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.470+0000 7fa662a00700 1 -- 172.21.15.80:0/1973645353 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4734 (secure 0 0 0) 0x7fa664057ce0 con 0x7fa66c1611f0 2024-05-10T04:26:46.471 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:26:46.471 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6834/607016626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":607016626},{"type":"v1","addr":"172.21.15.80:6834","nonce":607016626}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4981,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1819064685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1819064685},{"type":"v1","addr":"172.21.15.106:6836","nonce":1819064685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4984,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3006235418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3006235418},{"type":"v1","addr":"172.21.15.106:6837","nonce":3006235418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:23:54.993823+0000","modified":"2024-05-10T04:23:58.429131+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6835/707679728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":707679728},{"type":"v1","addr":"172.21.15.80:6835","nonce":707679728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-10T04:26:46.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.472+0000 7fa671600700 1 -- 172.21.15.80:0/1973645353 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa64806ac90 msgr2=0x7fa64806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:46.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.472+0000 7fa671600700 1 --2- 172.21.15.80:0/1973645353 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa64806ac90 0x7fa64806d1a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa65c000c00 tx=0x7fa65c009040 comp rx=0 tx=0).stop 2024-05-10T04:26:46.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.472+0000 7fa671600700 1 -- 172.21.15.80:0/1973645353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa66c1611f0 msgr2=0x7fa66c144e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:46.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.472+0000 7fa671600700 1 --2- 172.21.15.80:0/1973645353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa66c1611f0 0x7fa66c144e10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0ce430 tx=0x7fa6640104a0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.473+0000 7fa671600700 1 -- 172.21.15.80:0/1973645353 shutdown_connections 2024-05-10T04:26:46.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.473+0000 7fa671600700 1 --2- 172.21.15.80:0/1973645353 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa64806ac90 0x7fa64806d1a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.473+0000 7fa671600700 1 --2- 172.21.15.80:0/1973645353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa66c1611f0 0x7fa66c144e10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.473+0000 7fa671600700 1 --2- 172.21.15.80:0/1973645353 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa650004000 0x7fa66c142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.473+0000 7fa671600700 1 --2- 172.21.15.80:0/1973645353 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa66c0cdc90 0x7fa66c160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.473+0000 7fa671600700 1 -- 172.21.15.80:0/1973645353 >> 172.21.15.80:0/1973645353 conn(0x7fa66c0d0a90 msgr2=0x7fa66c0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:46.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.473+0000 7fa671600700 1 -- 172.21.15.80:0/1973645353 shutdown_connections 2024-05-10T04:26:46.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.473+0000 7fa671600700 1 -- 172.21.15.80:0/1973645353 wait complete. 2024-05-10T04:26:46.475 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 16 2024-05-10T04:26:46.502 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:26:46.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.760+0000 7fc787000700 1 Processor -- start 2024-05-10T04:26:46.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.760+0000 7fc787000700 1 -- start start 2024-05-10T04:26:46.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.762+0000 7fc787000700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc7800b6300 0x7fc7800b3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:46.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.762+0000 7fc787000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc7800d2710 0x7fc7800d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:46.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.762+0000 7fc787000700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78015f960 con 0x7fc780162bc0 2024-05-10T04:26:46.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.762+0000 7fc787000700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78015f680 con 0x7fc7800d2710 2024-05-10T04:26:46.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.762+0000 7fc787000700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7801620e0 con 0x7fc7800b6300 2024-05-10T04:26:46.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.762+0000 7fc785000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc7800d2710 0x7fc7800d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:46.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.762+0000 7fc785000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc7800d2710 0x7fc7800d2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43942/0 (socket says 172.21.15.80:43942) 2024-05-10T04:26:46.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.762+0000 7fc785000700 1 -- 172.21.15.80:0/35798800 learned_addr learned my addr 172.21.15.80:0/35798800 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:46.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.763+0000 7fc777e00700 1 --2- 172.21.15.80:0/35798800 >> v2:172.21.15.106:3300/0 conn(0x7fc7800b6300 0x7fc7800b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:46.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.763+0000 7fc785000700 1 -- 172.21.15.80:0/35798800 >> v2:172.21.15.106:3300/0 conn(0x7fc7800b6300 msgr2=0x7fc7800b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:46.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.763+0000 7fc785000700 1 --2- 172.21.15.80:0/35798800 >> v2:172.21.15.106:3300/0 conn(0x7fc7800b6300 0x7fc7800b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.763+0000 7fc785000700 1 -- 172.21.15.80:0/35798800 >> v1:172.21.15.106:6789/0 conn(0x7fc780162bc0 legacy=0x7fc7800b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:46.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.763+0000 7fc785000700 1 -- 172.21.15.80:0/35798800 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7801623c0 con 0x7fc7800d2710 2024-05-10T04:26:46.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.763+0000 7fc785000700 1 --2- 172.21.15.80:0/35798800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7800d2710 0x7fc7800d2b20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc7800d0790 tx=0x7fc77800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e54bf35427a327 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:46.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.763+0000 7fc77f400700 1 -- 172.21.15.80:0/35798800 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77800e070 con 0x7fc7800d2710 2024-05-10T04:26:46.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.763+0000 7fc77f400700 1 -- 172.21.15.80:0/35798800 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc778003a20 con 0x7fc7800d2710 2024-05-10T04:26:46.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.763+0000 7fc77f400700 1 -- 172.21.15.80:0/35798800 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778003dd0 con 0x7fc7800d2710 2024-05-10T04:26:46.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.764+0000 7fc787000700 1 -- 172.21.15.80:0/35798800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7800d2710 msgr2=0x7fc7800d2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:46.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.764+0000 7fc787000700 1 --2- 172.21.15.80:0/35798800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7800d2710 0x7fc7800d2b20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc7800d0790 tx=0x7fc77800b330 comp rx=0 tx=0).stop 2024-05-10T04:26:46.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.764+0000 7fc787000700 1 -- 172.21.15.80:0/35798800 shutdown_connections 2024-05-10T04:26:46.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.764+0000 7fc787000700 1 --2- 172.21.15.80:0/35798800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7800d2710 0x7fc7800d2b20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.764+0000 7fc787000700 1 --2- 172.21.15.80:0/35798800 >> v2:172.21.15.106:3300/0 conn(0x7fc7800b6300 0x7fc7800b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.764+0000 7fc787000700 1 -- 172.21.15.80:0/35798800 >> 172.21.15.80:0/35798800 conn(0x7fc7800d0c30 msgr2=0x7fc7800d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:46.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.764+0000 7fc787000700 1 -- 172.21.15.80:0/35798800 shutdown_connections 2024-05-10T04:26:46.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.764+0000 7fc787000700 1 -- 172.21.15.80:0/35798800 wait complete. 2024-05-10T04:26:46.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.766+0000 7fc787000700 1 Processor -- start 2024-05-10T04:26:46.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.767+0000 7fc787000700 1 -- start start 2024-05-10T04:26:46.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.768+0000 7fc787000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7800d2710 0x7fc7800c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:46.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.768+0000 7fc787000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc780162bc0 0x7fc7801592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:46.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.768+0000 7fc787000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc780159810 0x7fc7801f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:46.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.768+0000 7fc787000700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc780159ff0 con 0x7fc780159810 2024-05-10T04:26:46.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.768+0000 7fc787000700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7801f4ba0 con 0x7fc780162bc0 2024-05-10T04:26:46.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.768+0000 7fc787000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800c7540 con 0x7fc7800d2710 2024-05-10T04:26:46.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.768+0000 7fc785000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc780159810 0x7fc7801f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:46.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.768+0000 7fc785000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc780159810 0x7fc7801f40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43948/0 (socket says 172.21.15.80:43948) 2024-05-10T04:26:46.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.768+0000 7fc785000700 1 -- 172.21.15.80:0/246605388 learned_addr learned my addr 172.21.15.80:0/246605388 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:46.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.769+0000 7fc77fe00700 1 --2- 172.21.15.80:0/246605388 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7800d2710 0x7fc7800c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:46.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.769+0000 7fc777e00700 1 --2- 172.21.15.80:0/246605388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc780162bc0 0x7fc7801592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:46.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.769+0000 7fc785000700 1 -- 172.21.15.80:0/246605388 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7800d2710 msgr2=0x7fc7800c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:46.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.769+0000 7fc785000700 1 --2- 172.21.15.80:0/246605388 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7800d2710 0x7fc7800c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.769+0000 7fc785000700 1 -- 172.21.15.80:0/246605388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc780162bc0 msgr2=0x7fc7801592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:46.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.769+0000 7fc785000700 1 --2- 172.21.15.80:0/246605388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc780162bc0 0x7fc7801592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.769+0000 7fc785000700 1 -- 172.21.15.80:0/246605388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc778009b30 con 0x7fc780159810 2024-05-10T04:26:46.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.769+0000 7fc77fe00700 1 --2- 172.21.15.80:0/246605388 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7800d2710 0x7fc7800c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:26:46.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.769+0000 7fc777e00700 1 --2- 172.21.15.80:0/246605388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc780162bc0 0x7fc7801592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:26:46.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.769+0000 7fc785000700 1 --2- 172.21.15.80:0/246605388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc780159810 0x7fc7801f40a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc7800b6980 tx=0x7fc778004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:46.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.769+0000 7fc77cc00700 1 -- 172.21.15.80:0/246605388 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778004440 con 0x7fc780159810 2024-05-10T04:26:46.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.769+0000 7fc77cc00700 1 -- 172.21.15.80:0/246605388 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7780045c0 con 0x7fc780159810 2024-05-10T04:26:46.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.769+0000 7fc77cc00700 1 -- 172.21.15.80:0/246605388 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778004970 con 0x7fc780159810 2024-05-10T04:26:46.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.769+0000 7fc787000700 1 -- 172.21.15.80:0/246605388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7800c7de0 con 0x7fc780159810 2024-05-10T04:26:46.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.770+0000 7fc787000700 1 -- 172.21.15.80:0/246605388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7801f4df0 con 0x7fc780159810 2024-05-10T04:26:46.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.771+0000 7fc787000700 1 -- 172.21.15.80:0/246605388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7800c7f70 con 0x7fc780159810 2024-05-10T04:26:46.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.772+0000 7fc77cc00700 1 -- 172.21.15.80:0/246605388 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc778025450 con 0x7fc780159810 2024-05-10T04:26:46.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.772+0000 7fc77cc00700 1 --2- 172.21.15.80:0/246605388 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc75c06acc0 0x7fc75c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:46.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.773+0000 7fc77cc00700 1 -- 172.21.15.80:0/246605388 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc77808aab0 con 0x7fc780159810 2024-05-10T04:26:46.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.773+0000 7fc77fe00700 1 --2- 172.21.15.80:0/246605388 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc75c06acc0 0x7fc75c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:46.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.774+0000 7fc77fe00700 1 --2- 172.21.15.80:0/246605388 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc75c06acc0 0x7fc75c06d1d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc770006fd0 tx=0x7fc770008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:46.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.777+0000 7fc77cc00700 1 -- 172.21.15.80:0/246605388 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc778055c80 con 0x7fc780159810 2024-05-10T04:26:46.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.983+0000 7fc787000700 1 -- 172.21.15.80:0/246605388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc780074af0 con 0x7fc780159810 2024-05-10T04:26:46.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.985+0000 7fc77cc00700 1 -- 172.21.15.80:0/246605388 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16101 (secure 0 0 0) 0x7fc7780592a0 con 0x7fc780159810 2024-05-10T04:26:46.986 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:26:46.986 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":34,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:23:55.996940+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:23:52.881736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T04:23:53.974964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:26:46.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.987+0000 7fc787000700 1 -- 172.21.15.80:0/246605388 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc75c06acc0 msgr2=0x7fc75c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:46.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.987+0000 7fc787000700 1 --2- 172.21.15.80:0/246605388 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc75c06acc0 0x7fc75c06d1d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc770006fd0 tx=0x7fc770008040 comp rx=0 tx=0).stop 2024-05-10T04:26:46.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.987+0000 7fc787000700 1 -- 172.21.15.80:0/246605388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc780159810 msgr2=0x7fc7801f40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:46.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.987+0000 7fc787000700 1 --2- 172.21.15.80:0/246605388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc780159810 0x7fc7801f40a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc7800b6980 tx=0x7fc778004ad0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.987+0000 7fc787000700 1 -- 172.21.15.80:0/246605388 shutdown_connections 2024-05-10T04:26:46.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.987+0000 7fc787000700 1 --2- 172.21.15.80:0/246605388 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc75c06acc0 0x7fc75c06d1d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.987+0000 7fc787000700 1 --2- 172.21.15.80:0/246605388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc780159810 0x7fc7801f40a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.987+0000 7fc787000700 1 --2- 172.21.15.80:0/246605388 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7800d2710 0x7fc7800c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.987+0000 7fc787000700 1 --2- 172.21.15.80:0/246605388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc780162bc0 0x7fc7801592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.987+0000 7fc787000700 1 -- 172.21.15.80:0/246605388 >> 172.21.15.80:0/246605388 conn(0x7fc7800d0c30 msgr2=0x7fc7800b4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.987+0000 7fc787000700 1 -- 172.21.15.80:0/246605388 shutdown_connections 2024-05-10T04:26:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:46.987+0000 7fc787000700 1 -- 172.21.15.80:0/246605388 wait complete. 2024-05-10T04:26:47.015 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T04:26:47.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.276+0000 7fc5a5400700 1 Processor -- start 2024-05-10T04:26:47.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.276+0000 7fc5a5400700 1 -- start start 2024-05-10T04:26:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.278+0000 7fc5a5400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc5a00b3280 0x7fc5a00d3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.278+0000 7fc5a5400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc5a00b5d00 0x7fc5a00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.278+0000 7fc5a5400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a00d38d0 con 0x7fc5a006c2f0 2024-05-10T04:26:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.278+0000 7fc5a5400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a00b6650 con 0x7fc5a00b3280 2024-05-10T04:26:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.278+0000 7fc5a5400700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a006cf70 con 0x7fc5a00b5d00 2024-05-10T04:26:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.278+0000 7fc59f200700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc5a006c2f0 0x7fc5a006c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58824/0 (socket says 172.21.15.80:58824) 2024-05-10T04:26:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.278+0000 7fc59f200700 1 -- 172.21.15.80:0/3447975848 learned_addr learned my addr 172.21.15.80:0/3447975848 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.278+0000 7fc59e800700 1 --2- 172.21.15.80:0/3447975848 >> v2:172.21.15.80:3300/0 conn(0x7fc5a00b3280 0x7fc5a00d3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.279+0000 7fc59de00700 1 --2- 172.21.15.80:0/3447975848 >> v2:172.21.15.106:3300/0 conn(0x7fc5a00b5d00 0x7fc5a00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.279+0000 7fc59d400700 1 -- 172.21.15.80:0/3447975848 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398998188 0 0) 0x7fc5a00d38d0 con 0x7fc5a006c2f0 2024-05-10T04:26:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.279+0000 7fc59d400700 1 -- 172.21.15.80:0/3447975848 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5840035b0 con 0x7fc5a006c2f0 2024-05-10T04:26:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.279+0000 7fc59e800700 1 -- 172.21.15.80:0/3447975848 >> v2:172.21.15.106:3300/0 conn(0x7fc5a00b5d00 msgr2=0x7fc5a00b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.279+0000 7fc59e800700 1 --2- 172.21.15.80:0/3447975848 >> v2:172.21.15.106:3300/0 conn(0x7fc5a00b5d00 0x7fc5a00b6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:47.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.279+0000 7fc59e800700 1 -- 172.21.15.80:0/3447975848 >> v1:172.21.15.80:6789/0 conn(0x7fc5a006c2f0 legacy=0x7fc5a006c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:47.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.279+0000 7fc59e800700 1 -- 172.21.15.80:0/3447975848 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a006d250 con 0x7fc5a00b3280 2024-05-10T04:26:47.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.279+0000 7fc59e800700 1 --2- 172.21.15.80:0/3447975848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5a00b3280 0x7fc5a00d3390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00ba030 tx=0x7fc590009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135e5a70618e0b8a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:47.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.280+0000 7fc59d400700 1 -- 172.21.15.80:0/3447975848 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590011830 con 0x7fc5a00b3280 2024-05-10T04:26:47.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.280+0000 7fc59d400700 1 -- 172.21.15.80:0/3447975848 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc590011990 con 0x7fc5a00b3280 2024-05-10T04:26:47.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.280+0000 7fc59d400700 1 -- 172.21.15.80:0/3447975848 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590011d00 con 0x7fc5a00b3280 2024-05-10T04:26:47.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.280+0000 7fc5a5400700 1 -- 172.21.15.80:0/3447975848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5a00b3280 msgr2=0x7fc5a00d3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:47.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.280+0000 7fc5a5400700 1 --2- 172.21.15.80:0/3447975848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5a00b3280 0x7fc5a00d3390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00ba030 tx=0x7fc590009b20 comp rx=0 tx=0).stop 2024-05-10T04:26:47.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.280+0000 7fc5a5400700 1 -- 172.21.15.80:0/3447975848 shutdown_connections 2024-05-10T04:26:47.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.280+0000 7fc5a5400700 1 --2- 172.21.15.80:0/3447975848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5a00b3280 0x7fc5a00d3390 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:47.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.280+0000 7fc5a5400700 1 --2- 172.21.15.80:0/3447975848 >> v2:172.21.15.106:3300/0 conn(0x7fc5a00b5d00 0x7fc5a00b6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:47.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.280+0000 7fc5a5400700 1 -- 172.21.15.80:0/3447975848 >> 172.21.15.80:0/3447975848 conn(0x7fc5a00d40a0 msgr2=0x7fc5a00d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:47.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.280+0000 7fc5a5400700 1 -- 172.21.15.80:0/3447975848 shutdown_connections 2024-05-10T04:26:47.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.280+0000 7fc5a5400700 1 -- 172.21.15.80:0/3447975848 wait complete. 2024-05-10T04:26:47.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.283+0000 7fc5a5400700 1 Processor -- start 2024-05-10T04:26:47.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.283+0000 7fc5a5400700 1 -- start start 2024-05-10T04:26:47.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.284+0000 7fc5a5400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5a006c2f0 0x7fc5a00b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:47.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.284+0000 7fc5a5400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5a00b3280 0x7fc5a01552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:47.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.284+0000 7fc5a5400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5a00b5d00 0x7fc5a00acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:47.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.284+0000 7fc5a5400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a00ad9a0 con 0x7fc5a00b5d00 2024-05-10T04:26:47.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.284+0000 7fc5a5400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a00ac5d0 con 0x7fc5a006c2f0 2024-05-10T04:26:47.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.284+0000 7fc5a5400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a00b1e70 con 0x7fc5a00b3280 2024-05-10T04:26:47.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.285+0000 7fc59f200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5a00b5d00 0x7fc5a00acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:47.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.285+0000 7fc59f200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5a00b5d00 0x7fc5a00acd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43970/0 (socket says 172.21.15.80:43970) 2024-05-10T04:26:47.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.285+0000 7fc59f200700 1 -- 172.21.15.80:0/557262696 learned_addr learned my addr 172.21.15.80:0/557262696 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:47.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.285+0000 7fc59de00700 1 --2- 172.21.15.80:0/557262696 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5a00b3280 0x7fc5a01552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:47.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.285+0000 7fc59e800700 1 --2- 172.21.15.80:0/557262696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5a006c2f0 0x7fc5a00b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:47.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.285+0000 7fc59f200700 1 -- 172.21.15.80:0/557262696 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5a00b3280 msgr2=0x7fc5a01552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:47.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.285+0000 7fc59f200700 1 --2- 172.21.15.80:0/557262696 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5a00b3280 0x7fc5a01552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:47.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.285+0000 7fc59f200700 1 -- 172.21.15.80:0/557262696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5a006c2f0 msgr2=0x7fc5a00b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:47.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.285+0000 7fc59f200700 1 --2- 172.21.15.80:0/557262696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5a006c2f0 0x7fc5a00b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:47.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.285+0000 7fc59f200700 1 -- 172.21.15.80:0/557262696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5900094a0 con 0x7fc5a00b5d00 2024-05-10T04:26:47.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.285+0000 7fc59e800700 1 --2- 172.21.15.80:0/557262696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5a006c2f0 0x7fc5a00b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:26:47.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.285+0000 7fc59f200700 1 --2- 172.21.15.80:0/557262696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5a00b5d00 0x7fc5a00acd20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc59800ca70 tx=0x7fc59800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:47.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.286+0000 7fc596a00700 1 -- 172.21.15.80:0/557262696 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59800aaa0 con 0x7fc5a00b5d00 2024-05-10T04:26:47.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.286+0000 7fc596a00700 1 -- 172.21.15.80:0/557262696 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59800ac00 con 0x7fc5a00b5d00 2024-05-10T04:26:47.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.286+0000 7fc596a00700 1 -- 172.21.15.80:0/557262696 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598012400 con 0x7fc5a00b5d00 2024-05-10T04:26:47.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.286+0000 7fc5a5400700 1 -- 172.21.15.80:0/557262696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a00b2840 con 0x7fc5a00b5d00 2024-05-10T04:26:47.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.286+0000 7fc5a5400700 1 -- 172.21.15.80:0/557262696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a00b1540 con 0x7fc5a00b5d00 2024-05-10T04:26:47.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.287+0000 7fc5a5400700 1 -- 172.21.15.80:0/557262696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a00732b0 con 0x7fc5a00b5d00 2024-05-10T04:26:47.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.288+0000 7fc596a00700 1 -- 172.21.15.80:0/557262696 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc59801b3b0 con 0x7fc5a00b5d00 2024-05-10T04:26:47.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.289+0000 7fc596a00700 1 --2- 172.21.15.80:0/557262696 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc58006ac90 0x7fc58006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:47.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.289+0000 7fc596a00700 1 -- 172.21.15.80:0/557262696 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc598088fe0 con 0x7fc5a00b5d00 2024-05-10T04:26:47.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.289+0000 7fc59e800700 1 --2- 172.21.15.80:0/557262696 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc58006ac90 0x7fc58006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:47.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.290+0000 7fc59e800700 1 --2- 172.21.15.80:0/557262696 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc58006ac90 0x7fc58006d1a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc590014040 tx=0x7fc590008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:47.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.293+0000 7fc596a00700 1 -- 172.21.15.80:0/557262696 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc598054180 con 0x7fc5a00b5d00 2024-05-10T04:26:47.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.544+0000 7fc5a5400700 1 -- 172.21.15.80:0/557262696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc5a0074af0 con 0x7fc5a00b5d00 2024-05-10T04:26:47.546 INFO:tasks.ceph.mon.a.smithi080.stderr:2024-05-10T04:26:47.545+0000 7f9332200700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T04:26:47.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.557+0000 7fc596a00700 1 -- 172.21.15.80:0/557262696 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc598017020 con 0x7fc5a00b5d00 2024-05-10T04:26:47.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.560+0000 7fc5a5400700 1 -- 172.21.15.80:0/557262696 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc58006ac90 msgr2=0x7fc58006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:47.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.560+0000 7fc5a5400700 1 --2- 172.21.15.80:0/557262696 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc58006ac90 0x7fc58006d1a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc590014040 tx=0x7fc590008030 comp rx=0 tx=0).stop 2024-05-10T04:26:47.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.560+0000 7fc5a5400700 1 -- 172.21.15.80:0/557262696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5a00b5d00 msgr2=0x7fc5a00acd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:47.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.560+0000 7fc5a5400700 1 --2- 172.21.15.80:0/557262696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5a00b5d00 0x7fc5a00acd20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc59800ca70 tx=0x7fc59800ce30 comp rx=0 tx=0).stop 2024-05-10T04:26:47.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.560+0000 7fc5a5400700 1 -- 172.21.15.80:0/557262696 shutdown_connections 2024-05-10T04:26:47.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.560+0000 7fc5a5400700 1 --2- 172.21.15.80:0/557262696 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fc58006ac90 0x7fc58006d1a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:47.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.560+0000 7fc5a5400700 1 --2- 172.21.15.80:0/557262696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5a00b5d00 0x7fc5a00acd20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:47.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.560+0000 7fc5a5400700 1 --2- 172.21.15.80:0/557262696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5a006c2f0 0x7fc5a00b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:47.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.560+0000 7fc5a5400700 1 --2- 172.21.15.80:0/557262696 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5a00b3280 0x7fc5a01552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:47.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.560+0000 7fc5a5400700 1 -- 172.21.15.80:0/557262696 >> 172.21.15.80:0/557262696 conn(0x7fc5a00d40a0 msgr2=0x7fc5a00740c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:47.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.560+0000 7fc5a5400700 1 -- 172.21.15.80:0/557262696 shutdown_connections 2024-05-10T04:26:47.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.560+0000 7fc5a5400700 1 -- 172.21.15.80:0/557262696 wait complete. 2024-05-10T04:26:47.563 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T04:26:47.588 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T04:26:47.709 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-05-10T04:26:47.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.857+0000 7fe26aa00700 1 Processor -- start 2024-05-10T04:26:47.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.857+0000 7fe26aa00700 1 -- start start 2024-05-10T04:26:47.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.858+0000 7fe26aa00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2640b3280 0x7fe2640d3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:47.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.859+0000 7fe26aa00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe2640b5d00 0x7fe2640b6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:47.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.859+0000 7fe26aa00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe26406c2f0 0x7fe26406c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:47.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.859+0000 7fe26aa00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2640d38d0 con 0x7fe26406c2f0 2024-05-10T04:26:47.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.859+0000 7fe26aa00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2640b6650 con 0x7fe2640b5d00 2024-05-10T04:26:47.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.859+0000 7fe26aa00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26406cf70 con 0x7fe2640b3280 2024-05-10T04:26:47.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.859+0000 7fe268a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe26406c2f0 0x7fe26406c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:47.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.859+0000 7fe263e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2640b3280 0x7fe2640d3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:47.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.859+0000 7fe268a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe26406c2f0 0x7fe26406c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43994/0 (socket says 172.21.15.80:43994) 2024-05-10T04:26:47.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.859+0000 7fe263400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe2640b5d00 0x7fe2640b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:47.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.859+0000 7fe268a00700 1 -- 172.21.15.80:0/1634122026 learned_addr learned my addr 172.21.15.80:0/1634122026 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:47.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.859+0000 7fe268a00700 1 -- 172.21.15.80:0/1634122026 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2640b3280 msgr2=0x7fe2640d3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:47.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.859+0000 7fe268a00700 1 --2- 172.21.15.80:0/1634122026 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2640b3280 0x7fe2640d3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:47.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.859+0000 7fe268a00700 1 -- 172.21.15.80:0/1634122026 >> v2:172.21.15.106:3300/0 conn(0x7fe2640b5d00 msgr2=0x7fe2640b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.859+0000 7fe268a00700 1 --2- 172.21.15.80:0/1634122026 >> v2:172.21.15.106:3300/0 conn(0x7fe2640b5d00 0x7fe2640b6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.859+0000 7fe268a00700 1 -- 172.21.15.80:0/1634122026 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26406d250 con 0x7fe26406c2f0 2024-05-10T04:26:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.860+0000 7fe268a00700 1 --2- 172.21.15.80:0/1634122026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe26406c2f0 0x7fe26406c700 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe2640d4df0 tx=0x7fe25c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a9616619cea890 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.860+0000 7fe262a00700 1 -- 172.21.15.80:0/1634122026 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00e070 con 0x7fe26406c2f0 2024-05-10T04:26:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.860+0000 7fe262a00700 1 -- 172.21.15.80:0/1634122026 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c00b910 con 0x7fe26406c2f0 2024-05-10T04:26:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.860+0000 7fe262a00700 1 -- 172.21.15.80:0/1634122026 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00bcc0 con 0x7fe26406c2f0 2024-05-10T04:26:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.861+0000 7fe26aa00700 1 -- 172.21.15.80:0/1634122026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe26406c2f0 msgr2=0x7fe26406c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.861+0000 7fe26aa00700 1 --2- 172.21.15.80:0/1634122026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe26406c2f0 0x7fe26406c700 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe2640d4df0 tx=0x7fe25c00b330 comp rx=0 tx=0).stop 2024-05-10T04:26:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.861+0000 7fe26aa00700 1 -- 172.21.15.80:0/1634122026 shutdown_connections 2024-05-10T04:26:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.861+0000 7fe26aa00700 1 --2- 172.21.15.80:0/1634122026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe26406c2f0 0x7fe26406c700 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.861+0000 7fe26aa00700 1 --2- 172.21.15.80:0/1634122026 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2640b3280 0x7fe2640d3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.861+0000 7fe26aa00700 1 --2- 172.21.15.80:0/1634122026 >> v2:172.21.15.106:3300/0 conn(0x7fe2640b5d00 0x7fe2640b6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.861+0000 7fe26aa00700 1 -- 172.21.15.80:0/1634122026 >> 172.21.15.80:0/1634122026 conn(0x7fe2640d40a0 msgr2=0x7fe2640d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.861+0000 7fe26aa00700 1 -- 172.21.15.80:0/1634122026 shutdown_connections 2024-05-10T04:26:47.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.861+0000 7fe26aa00700 1 -- 172.21.15.80:0/1634122026 wait complete. 2024-05-10T04:26:47.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.863+0000 7fe26aa00700 1 Processor -- start 2024-05-10T04:26:47.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.863+0000 7fe26aa00700 1 -- start start 2024-05-10T04:26:47.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.864+0000 7fe26aa00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe26406c2f0 0x7fe2640ae310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:47.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.865+0000 7fe26aa00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2640b3280 0x7fe264154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:47.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.865+0000 7fe26aa00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2640b5d00 0x7fe264156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:47.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.865+0000 7fe26aa00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe264155eb0 con 0x7fe26406c2f0 2024-05-10T04:26:47.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.865+0000 7fe26aa00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe264152140 con 0x7fe2640b3280 2024-05-10T04:26:47.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.865+0000 7fe26aa00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe264154fe0 con 0x7fe2640b5d00 2024-05-10T04:26:47.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.865+0000 7fe263e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe26406c2f0 0x7fe2640ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:47.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.865+0000 7fe263e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe26406c2f0 0x7fe2640ae310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43996/0 (socket says 172.21.15.80:43996) 2024-05-10T04:26:47.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.865+0000 7fe263e00700 1 -- 172.21.15.80:0/2970519547 learned_addr learned my addr 172.21.15.80:0/2970519547 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:47.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.865+0000 7fe268a00700 1 --2- 172.21.15.80:0/2970519547 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2640b5d00 0x7fe264156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:47.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.865+0000 7fe263400700 1 --2- 172.21.15.80:0/2970519547 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2640b3280 0x7fe264154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:47.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.865+0000 7fe263e00700 1 -- 172.21.15.80:0/2970519547 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2640b5d00 msgr2=0x7fe264156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:47.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.865+0000 7fe263e00700 1 --2- 172.21.15.80:0/2970519547 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2640b5d00 0x7fe264156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:47.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.865+0000 7fe263e00700 1 -- 172.21.15.80:0/2970519547 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2640b3280 msgr2=0x7fe264154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:47.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.865+0000 7fe263e00700 1 --2- 172.21.15.80:0/2970519547 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2640b3280 0x7fe264154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:47.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.865+0000 7fe263e00700 1 -- 172.21.15.80:0/2970519547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c009b30 con 0x7fe26406c2f0 2024-05-10T04:26:47.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.865+0000 7fe263e00700 1 --2- 172.21.15.80:0/2970519547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe26406c2f0 0x7fe2640ae310 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe25400e870 tx=0x7fe25400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:47.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.866+0000 7fe25be00700 1 -- 172.21.15.80:0/2970519547 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25400c640 con 0x7fe26406c2f0 2024-05-10T04:26:47.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.866+0000 7fe25be00700 1 -- 172.21.15.80:0/2970519547 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25400c7a0 con 0x7fe26406c2f0 2024-05-10T04:26:47.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.866+0000 7fe26aa00700 1 -- 172.21.15.80:0/2970519547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe264155230 con 0x7fe26406c2f0 2024-05-10T04:26:47.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.866+0000 7fe25be00700 1 -- 172.21.15.80:0/2970519547 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25400cb30 con 0x7fe26406c2f0 2024-05-10T04:26:47.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.866+0000 7fe26aa00700 1 -- 172.21.15.80:0/2970519547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2641557f0 con 0x7fe26406c2f0 2024-05-10T04:26:47.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.867+0000 7fe26aa00700 1 -- 172.21.15.80:0/2970519547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2640732b0 con 0x7fe26406c2f0 2024-05-10T04:26:47.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.868+0000 7fe25be00700 1 -- 172.21.15.80:0/2970519547 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe25400cc90 con 0x7fe26406c2f0 2024-05-10T04:26:47.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.869+0000 7fe25be00700 1 --2- 172.21.15.80:0/2970519547 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe24406ac90 0x7fe24406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:47.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.869+0000 7fe25be00700 1 -- 172.21.15.80:0/2970519547 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe2540896f0 con 0x7fe26406c2f0 2024-05-10T04:26:47.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.869+0000 7fe263400700 1 --2- 172.21.15.80:0/2970519547 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe24406ac90 0x7fe24406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:47.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.870+0000 7fe263400700 1 --2- 172.21.15.80:0/2970519547 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe24406ac90 0x7fe24406d1a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe264150c40 tx=0x7fe250008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:47.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:47.874+0000 7fe25be00700 1 -- 172.21.15.80:0/2970519547 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe2540547c0 con 0x7fe26406c2f0 2024-05-10T04:26:48.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.123+0000 7fe26aa00700 1 -- 172.21.15.80:0/2970519547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe264074af0 con 0x7fe26406c2f0 2024-05-10T04:26:48.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.562+0000 7fe25be00700 1 -- 172.21.15.80:0/2970519547 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe254057de0 con 0x7fe26406c2f0 2024-05-10T04:26:48.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.565+0000 7fe26aa00700 1 -- 172.21.15.80:0/2970519547 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe24406ac90 msgr2=0x7fe24406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:48.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.565+0000 7fe26aa00700 1 --2- 172.21.15.80:0/2970519547 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe24406ac90 0x7fe24406d1a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe264150c40 tx=0x7fe250008040 comp rx=0 tx=0).stop 2024-05-10T04:26:48.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.565+0000 7fe26aa00700 1 -- 172.21.15.80:0/2970519547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe26406c2f0 msgr2=0x7fe2640ae310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:48.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.565+0000 7fe26aa00700 1 --2- 172.21.15.80:0/2970519547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe26406c2f0 0x7fe2640ae310 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe25400e870 tx=0x7fe25400ec30 comp rx=0 tx=0).stop 2024-05-10T04:26:48.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.565+0000 7fe26aa00700 1 -- 172.21.15.80:0/2970519547 shutdown_connections 2024-05-10T04:26:48.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.565+0000 7fe26aa00700 1 --2- 172.21.15.80:0/2970519547 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fe24406ac90 0x7fe24406d1a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:48.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.565+0000 7fe26aa00700 1 --2- 172.21.15.80:0/2970519547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe26406c2f0 0x7fe2640ae310 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:48.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.565+0000 7fe26aa00700 1 --2- 172.21.15.80:0/2970519547 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2640b5d00 0x7fe264156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:48.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.565+0000 7fe26aa00700 1 --2- 172.21.15.80:0/2970519547 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2640b3280 0x7fe264154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:48.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.565+0000 7fe26aa00700 1 -- 172.21.15.80:0/2970519547 >> 172.21.15.80:0/2970519547 conn(0x7fe2640d40a0 msgr2=0x7fe2641613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:48.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.565+0000 7fe26aa00700 1 -- 172.21.15.80:0/2970519547 shutdown_connections 2024-05-10T04:26:48.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.565+0000 7fe26aa00700 1 -- 172.21.15.80:0/2970519547 wait complete. 2024-05-10T04:26:48.593 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T04:26:48.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.857+0000 7f0731600700 1 Processor -- start 2024-05-10T04:26:48.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.857+0000 7f0731600700 1 -- start start 2024-05-10T04:26:48.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.859+0000 7f0731600700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f072c15e5e0 0x7f072c161f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:48.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.859+0000 7f0731600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f072c0b5c10 0x7f072c0b6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:48.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.859+0000 7f0731600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072c0b6560 con 0x7f072c0cea50 2024-05-10T04:26:48.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.859+0000 7f0731600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072c0cada0 con 0x7f072c0b5c10 2024-05-10T04:26:48.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.859+0000 7f0731600700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072c1624a0 con 0x7f072c15e5e0 2024-05-10T04:26:48.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.859+0000 7f072b400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f072c0b5c10 0x7f072c0b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:48.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.859+0000 7f072b400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f072c0b5c10 0x7f072c0b6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44002/0 (socket says 172.21.15.80:44002) 2024-05-10T04:26:48.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.859+0000 7f072b400700 1 -- 172.21.15.80:0/1105608087 learned_addr learned my addr 172.21.15.80:0/1105608087 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:48.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.859+0000 7f072aa00700 1 --2- 172.21.15.80:0/1105608087 >> v2:172.21.15.106:3300/0 conn(0x7f072c15e5e0 0x7f072c161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:48.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.860+0000 7f072b400700 1 -- 172.21.15.80:0/1105608087 >> v2:172.21.15.106:3300/0 conn(0x7f072c15e5e0 msgr2=0x7f072c161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:48.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.860+0000 7f072b400700 1 --2- 172.21.15.80:0/1105608087 >> v2:172.21.15.106:3300/0 conn(0x7f072c15e5e0 0x7f072c161f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:48.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.860+0000 7f072b400700 1 -- 172.21.15.80:0/1105608087 >> v1:172.21.15.106:6789/0 conn(0x7f072c0cea50 legacy=0x7f072c0b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:48.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.860+0000 7f072b400700 1 -- 172.21.15.80:0/1105608087 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c1626b0 con 0x7f072c0b5c10 2024-05-10T04:26:48.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.860+0000 7f072b400700 1 --2- 172.21.15.80:0/1105608087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f072c0b5c10 0x7f072c0b6020 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f072c08c3a0 tx=0x7f072400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b23d8359017417 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:48.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.860+0000 7f0729600700 1 -- 172.21.15.80:0/1105608087 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072400e070 con 0x7f072c0b5c10 2024-05-10T04:26:48.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.860+0000 7f0729600700 1 -- 172.21.15.80:0/1105608087 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072400b910 con 0x7f072c0b5c10 2024-05-10T04:26:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.860+0000 7f0729600700 1 -- 172.21.15.80:0/1105608087 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072400bcc0 con 0x7f072c0b5c10 2024-05-10T04:26:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.861+0000 7f0731600700 1 -- 172.21.15.80:0/1105608087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f072c0b5c10 msgr2=0x7f072c0b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.861+0000 7f0731600700 1 --2- 172.21.15.80:0/1105608087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f072c0b5c10 0x7f072c0b6020 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f072c08c3a0 tx=0x7f072400b330 comp rx=0 tx=0).stop 2024-05-10T04:26:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.861+0000 7f0731600700 1 -- 172.21.15.80:0/1105608087 shutdown_connections 2024-05-10T04:26:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.861+0000 7f0731600700 1 --2- 172.21.15.80:0/1105608087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f072c0b5c10 0x7f072c0b6020 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.861+0000 7f0731600700 1 --2- 172.21.15.80:0/1105608087 >> v2:172.21.15.106:3300/0 conn(0x7f072c15e5e0 0x7f072c161f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.861+0000 7f0731600700 1 -- 172.21.15.80:0/1105608087 >> 172.21.15.80:0/1105608087 conn(0x7f072c0d0cd0 msgr2=0x7f072c0d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:48.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.861+0000 7f0731600700 1 -- 172.21.15.80:0/1105608087 shutdown_connections 2024-05-10T04:26:48.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.861+0000 7f0731600700 1 -- 172.21.15.80:0/1105608087 wait complete. 2024-05-10T04:26:48.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.863+0000 7f0731600700 1 Processor -- start 2024-05-10T04:26:48.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.863+0000 7f0731600700 1 -- start start 2024-05-10T04:26:48.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.865+0000 7f0731600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f072c0b5c10 0x7f072c0cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:48.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.865+0000 7f0731600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f072c0cea50 0x7f072c0caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:48.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.865+0000 7f0731600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f072c15e5e0 0x7f072c0cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:48.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.865+0000 7f0731600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c15f590 con 0x7f072c0cea50 2024-05-10T04:26:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.865+0000 7f0731600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c14f560 con 0x7f072c0b5c10 2024-05-10T04:26:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.865+0000 7f0731600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c1e7cf0 con 0x7f072c15e5e0 2024-05-10T04:26:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.865+0000 7f072a000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f072c0cea50 0x7f072c0caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.865+0000 7f072a000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f072c0cea50 0x7f072c0caee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44004/0 (socket says 172.21.15.80:44004) 2024-05-10T04:26:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.865+0000 7f072a000700 1 -- 172.21.15.80:0/2240821889 learned_addr learned my addr 172.21.15.80:0/2240821889 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.865+0000 7f072b400700 1 --2- 172.21.15.80:0/2240821889 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f072c15e5e0 0x7f072c0cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.865+0000 7f072aa00700 1 --2- 172.21.15.80:0/2240821889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f072c0b5c10 0x7f072c0cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.866+0000 7f072a000700 1 -- 172.21.15.80:0/2240821889 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f072c15e5e0 msgr2=0x7f072c0cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.866+0000 7f072a000700 1 --2- 172.21.15.80:0/2240821889 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f072c15e5e0 0x7f072c0cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:48.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.866+0000 7f072a000700 1 -- 172.21.15.80:0/2240821889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f072c0b5c10 msgr2=0x7f072c0cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:48.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.866+0000 7f072a000700 1 --2- 172.21.15.80:0/2240821889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f072c0b5c10 0x7f072c0cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:48.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.866+0000 7f072a000700 1 -- 172.21.15.80:0/2240821889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0724009b30 con 0x7f072c0cea50 2024-05-10T04:26:48.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.866+0000 7f072b400700 1 --2- 172.21.15.80:0/2240821889 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f072c15e5e0 0x7f072c0cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:26:48.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.866+0000 7f072a000700 1 --2- 172.21.15.80:0/2240821889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f072c0cea50 0x7f072c0caee0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f071800c420 tx=0x7f071800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:48.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.866+0000 7f0722a00700 1 -- 172.21.15.80:0/2240821889 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07180052d0 con 0x7f072c0cea50 2024-05-10T04:26:48.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.866+0000 7f0722a00700 1 -- 172.21.15.80:0/2240821889 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0718005430 con 0x7f072c0cea50 2024-05-10T04:26:48.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.866+0000 7f0731600700 1 -- 172.21.15.80:0/2240821889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072c0cdd90 con 0x7f072c0cea50 2024-05-10T04:26:48.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.866+0000 7f0722a00700 1 -- 172.21.15.80:0/2240821889 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07180038c0 con 0x7f072c0cea50 2024-05-10T04:26:48.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.866+0000 7f0731600700 1 -- 172.21.15.80:0/2240821889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072c15f7a0 con 0x7f072c0cea50 2024-05-10T04:26:48.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.867+0000 7f0731600700 1 -- 172.21.15.80:0/2240821889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072c074af0 con 0x7f072c0cea50 2024-05-10T04:26:48.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.869+0000 7f0722a00700 1 -- 172.21.15.80:0/2240821889 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0718003a20 con 0x7f072c0cea50 2024-05-10T04:26:48.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.869+0000 7f0722a00700 1 --2- 172.21.15.80:0/2240821889 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f070c06acc0 0x7f070c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:48.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.869+0000 7f0722a00700 1 -- 172.21.15.80:0/2240821889 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0718088620 con 0x7f072c0cea50 2024-05-10T04:26:48.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.870+0000 7f072aa00700 1 --2- 172.21.15.80:0/2240821889 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f070c06acc0 0x7f070c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:48.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.870+0000 7f072aa00700 1 --2- 172.21.15.80:0/2240821889 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f070c06acc0 0x7f070c06d1d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f072c0d4e60 tx=0x7f071c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:48.874+0000 7f0722a00700 1 -- 172.21.15.80:0/2240821889 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0718053710 con 0x7f072c0cea50 2024-05-10T04:26:49.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.080+0000 7f0731600700 1 -- 172.21.15.80:0/2240821889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f072c0cdd90 con 0x7f072c0cea50 2024-05-10T04:26:49.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.571+0000 7f0722a00700 1 -- 172.21.15.80:0/2240821889 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) v1 ==== 181+0+0 (secure 0 0 0) 0x7f072c0cdd90 con 0x7f072c0cea50 2024-05-10T04:26:49.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.575+0000 7f0731600700 1 -- 172.21.15.80:0/2240821889 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f070c06acc0 msgr2=0x7f070c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:49.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.575+0000 7f0731600700 1 --2- 172.21.15.80:0/2240821889 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f070c06acc0 0x7f070c06d1d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f072c0d4e60 tx=0x7f071c008040 comp rx=0 tx=0).stop 2024-05-10T04:26:49.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.575+0000 7f0731600700 1 -- 172.21.15.80:0/2240821889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f072c0cea50 msgr2=0x7f072c0caee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:49.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.575+0000 7f0731600700 1 --2- 172.21.15.80:0/2240821889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f072c0cea50 0x7f072c0caee0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f071800c420 tx=0x7f071800c7e0 comp rx=0 tx=0).stop 2024-05-10T04:26:49.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.575+0000 7f0731600700 1 -- 172.21.15.80:0/2240821889 shutdown_connections 2024-05-10T04:26:49.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.575+0000 7f0731600700 1 --2- 172.21.15.80:0/2240821889 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f070c06acc0 0x7f070c06d1d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:49.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.575+0000 7f0731600700 1 --2- 172.21.15.80:0/2240821889 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f072c15e5e0 0x7f072c0cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:49.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.575+0000 7f0731600700 1 --2- 172.21.15.80:0/2240821889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f072c0b5c10 0x7f072c0cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:49.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.575+0000 7f0731600700 1 --2- 172.21.15.80:0/2240821889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f072c0cea50 0x7f072c0caee0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:49.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.575+0000 7f0731600700 1 -- 172.21.15.80:0/2240821889 >> 172.21.15.80:0/2240821889 conn(0x7f072c0d0cd0 msgr2=0x7f072c0b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:49.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.576+0000 7f0731600700 1 -- 172.21.15.80:0/2240821889 shutdown_connections 2024-05-10T04:26:49.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.576+0000 7f0731600700 1 -- 172.21.15.80:0/2240821889 wait complete. 2024-05-10T04:26:49.579 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2024-05-10T04:26:49.609 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T04:26:49.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.875+0000 7f0653800700 1 Processor -- start 2024-05-10T04:26:49.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.875+0000 7f0653800700 1 -- start start 2024-05-10T04:26:49.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.877+0000 7f0653800700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f064c1627a0 0x7f064c0d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:49.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.877+0000 7f0653800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c162d80 con 0x7f064c0b6080 2024-05-10T04:26:49.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.877+0000 7f0653800700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c0d2970 con 0x7f064c0b33e0 2024-05-10T04:26:49.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.877+0000 7f0653800700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c0b37f0 con 0x7f064c1627a0 2024-05-10T04:26:49.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.877+0000 7f064be00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f064c0b6080 0x7f064c162090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58836/0 (socket says 172.21.15.80:58836) 2024-05-10T04:26:49.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.877+0000 7f064be00700 1 -- 172.21.15.80:0/2260586662 learned_addr learned my addr 172.21.15.80:0/2260586662 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:49.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.877+0000 7f0651800700 1 --2- 172.21.15.80:0/2260586662 >> v2:172.21.15.106:3300/0 conn(0x7f064c1627a0 0x7f064c0d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:49.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.877+0000 7f064b400700 1 -- 172.21.15.80:0/2260586662 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545362635 0 0) 0x7f064c162d80 con 0x7f064c0b6080 2024-05-10T04:26:49.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.877+0000 7f064b400700 1 -- 172.21.15.80:0/2260586662 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06340035b0 con 0x7f064c0b6080 2024-05-10T04:26:49.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.877+0000 7f064b400700 1 -- 172.21.15.80:0/2260586662 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248035358 0 0) 0x7f064c0d2970 con 0x7f064c0b33e0 2024-05-10T04:26:49.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.877+0000 7f064b400700 1 -- 172.21.15.80:0/2260586662 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f064c162d80 con 0x7f064c0b33e0 2024-05-10T04:26:49.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.878+0000 7f0651800700 1 -- 172.21.15.80:0/2260586662 >> v1:172.21.15.106:6789/0 conn(0x7f064c0b33e0 legacy=0x7f064c0b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:49.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.878+0000 7f0651800700 1 -- 172.21.15.80:0/2260586662 >> v1:172.21.15.80:6789/0 conn(0x7f064c0b6080 legacy=0x7f064c162090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:49.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.878+0000 7f064b400700 1 -- 172.21.15.80:0/2260586662 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4095374894 0 0) 0x7f06340035b0 con 0x7f064c0b6080 2024-05-10T04:26:49.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.878+0000 7f0651800700 1 -- 172.21.15.80:0/2260586662 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c0d2c50 con 0x7f064c1627a0 2024-05-10T04:26:49.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.878+0000 7f0651800700 1 --2- 172.21.15.80:0/2260586662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f064c1627a0 0x7f064c0d3450 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0644009d90 tx=0x7f064400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=553f80d8234e385 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:49.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.878+0000 7f064b400700 1 -- 172.21.15.80:0/2260586662 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064400e070 con 0x7f064c1627a0 2024-05-10T04:26:49.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.878+0000 7f064b400700 1 -- 172.21.15.80:0/2260586662 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0644003a20 con 0x7f064c1627a0 2024-05-10T04:26:49.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.878+0000 7f064b400700 1 -- 172.21.15.80:0/2260586662 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638001670 con 0x7f064c1627a0 2024-05-10T04:26:49.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.879+0000 7f0653800700 1 -- 172.21.15.80:0/2260586662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f064c1627a0 msgr2=0x7f064c0d3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:49.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.879+0000 7f0653800700 1 --2- 172.21.15.80:0/2260586662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f064c1627a0 0x7f064c0d3450 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0644009d90 tx=0x7f064400b330 comp rx=0 tx=0).stop 2024-05-10T04:26:49.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.879+0000 7f0653800700 1 -- 172.21.15.80:0/2260586662 shutdown_connections 2024-05-10T04:26:49.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.879+0000 7f0653800700 1 --2- 172.21.15.80:0/2260586662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f064c1627a0 0x7f064c0d3450 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:49.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.879+0000 7f0653800700 1 -- 172.21.15.80:0/2260586662 >> 172.21.15.80:0/2260586662 conn(0x7f064c0d0b50 msgr2=0x7f064c0d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:49.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.879+0000 7f0653800700 1 -- 172.21.15.80:0/2260586662 shutdown_connections 2024-05-10T04:26:49.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.879+0000 7f0653800700 1 -- 172.21.15.80:0/2260586662 wait complete. 2024-05-10T04:26:49.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.881+0000 7f0653800700 1 Processor -- start 2024-05-10T04:26:49.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.882+0000 7f0653800700 1 -- start start 2024-05-10T04:26:49.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.883+0000 7f0653800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f064c0b33e0 0x7f064c15d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:49.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.883+0000 7f0653800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f064c1627a0 0x7f064c159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:49.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.883+0000 7f0653800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f064c15c570 0x7f064c15c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:49.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.883+0000 7f0653800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0ad0c0 con 0x7f064c1627a0 2024-05-10T04:26:49.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.883+0000 7f0653800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0b0d10 con 0x7f064c0b33e0 2024-05-10T04:26:49.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.883+0000 7f0653800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0abdd0 con 0x7f064c15c570 2024-05-10T04:26:49.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.883+0000 7f064be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f064c1627a0 0x7f064c159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:49.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.883+0000 7f064be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f064c1627a0 0x7f064c159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44018/0 (socket says 172.21.15.80:44018) 2024-05-10T04:26:49.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.883+0000 7f064be00700 1 -- 172.21.15.80:0/2394801774 learned_addr learned my addr 172.21.15.80:0/2394801774 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:49.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.883+0000 7f0650e00700 1 --2- 172.21.15.80:0/2394801774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f064c0b33e0 0x7f064c15d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:49.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.884+0000 7f0651800700 1 --2- 172.21.15.80:0/2394801774 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f064c15c570 0x7f064c15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:49.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.884+0000 7f064be00700 1 -- 172.21.15.80:0/2394801774 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f064c15c570 msgr2=0x7f064c15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:49.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.884+0000 7f064be00700 1 --2- 172.21.15.80:0/2394801774 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f064c15c570 0x7f064c15c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:49.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.884+0000 7f064be00700 1 -- 172.21.15.80:0/2394801774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f064c0b33e0 msgr2=0x7f064c15d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:49.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.884+0000 7f064be00700 1 --2- 172.21.15.80:0/2394801774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f064c0b33e0 0x7f064c15d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:49.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.884+0000 7f064be00700 1 -- 172.21.15.80:0/2394801774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0644009a70 con 0x7f064c1627a0 2024-05-10T04:26:49.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.884+0000 7f0651800700 1 --2- 172.21.15.80:0/2394801774 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f064c15c570 0x7f064c15c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:26:49.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.884+0000 7f064be00700 1 --2- 172.21.15.80:0/2394801774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f064c1627a0 0x7f064c159930 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f063800c550 tx=0x7f063800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:49.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.884+0000 7f0648c00700 1 -- 172.21.15.80:0/2394801774 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638004c80 con 0x7f064c1627a0 2024-05-10T04:26:49.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.884+0000 7f0648c00700 1 -- 172.21.15.80:0/2394801774 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0638004de0 con 0x7f064c1627a0 2024-05-10T04:26:49.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.884+0000 7f0653800700 1 -- 172.21.15.80:0/2394801774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064c0acc30 con 0x7f064c1627a0 2024-05-10T04:26:49.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.884+0000 7f0648c00700 1 -- 172.21.15.80:0/2394801774 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638007310 con 0x7f064c1627a0 2024-05-10T04:26:49.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.884+0000 7f0653800700 1 -- 172.21.15.80:0/2394801774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c0ac020 con 0x7f064c1627a0 2024-05-10T04:26:49.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.886+0000 7f0653800700 1 -- 172.21.15.80:0/2394801774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064c0732b0 con 0x7f064c1627a0 2024-05-10T04:26:49.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.887+0000 7f0648c00700 1 -- 172.21.15.80:0/2394801774 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0638007470 con 0x7f064c1627a0 2024-05-10T04:26:49.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.888+0000 7f0648c00700 1 --2- 172.21.15.80:0/2394801774 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f062c06ac90 0x7f062c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:49.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.888+0000 7f0648c00700 1 -- 172.21.15.80:0/2394801774 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f0638088ee0 con 0x7f064c1627a0 2024-05-10T04:26:49.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.888+0000 7f0650e00700 1 --2- 172.21.15.80:0/2394801774 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f062c06ac90 0x7f062c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:49.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.889+0000 7f0650e00700 1 --2- 172.21.15.80:0/2394801774 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f062c06ac90 0x7f062c06d1a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f06400011e0 tx=0x7f0640009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:49.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:49.893+0000 7f0648c00700 1 -- 172.21.15.80:0/2394801774 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0638054190 con 0x7f064c1627a0 2024-05-10T04:26:50.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.106+0000 7f0653800700 1 -- 172.21.15.80:0/2394801774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f064c0acdc0 con 0x7f064c1627a0 2024-05-10T04:26:50.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.577+0000 7f0648c00700 1 -- 172.21.15.80:0/2394801774 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) v1 ==== 169+0+0 (secure 0 0 0) 0x7f06380577b0 con 0x7f064c1627a0 2024-05-10T04:26:50.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.581+0000 7f0653800700 1 -- 172.21.15.80:0/2394801774 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f062c06ac90 msgr2=0x7f062c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:50.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.581+0000 7f0653800700 1 --2- 172.21.15.80:0/2394801774 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f062c06ac90 0x7f062c06d1a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f06400011e0 tx=0x7f0640009040 comp rx=0 tx=0).stop 2024-05-10T04:26:50.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.581+0000 7f0653800700 1 -- 172.21.15.80:0/2394801774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f064c1627a0 msgr2=0x7f064c159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:50.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.581+0000 7f0653800700 1 --2- 172.21.15.80:0/2394801774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f064c1627a0 0x7f064c159930 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f063800c550 tx=0x7f063800c860 comp rx=0 tx=0).stop 2024-05-10T04:26:50.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.582+0000 7f0653800700 1 -- 172.21.15.80:0/2394801774 shutdown_connections 2024-05-10T04:26:50.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.582+0000 7f0653800700 1 --2- 172.21.15.80:0/2394801774 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f062c06ac90 0x7f062c06d1a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:50.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.582+0000 7f0653800700 1 --2- 172.21.15.80:0/2394801774 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f064c15c570 0x7f064c15c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:50.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.582+0000 7f0653800700 1 --2- 172.21.15.80:0/2394801774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f064c0b33e0 0x7f064c15d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:50.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.582+0000 7f0653800700 1 --2- 172.21.15.80:0/2394801774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f064c1627a0 0x7f064c159930 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:50.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.582+0000 7f0653800700 1 -- 172.21.15.80:0/2394801774 >> 172.21.15.80:0/2394801774 conn(0x7f064c0d0b50 msgr2=0x7f064c06c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:50.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.582+0000 7f0653800700 1 -- 172.21.15.80:0/2394801774 shutdown_connections 2024-05-10T04:26:50.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.582+0000 7f0653800700 1 -- 172.21.15.80:0/2394801774 wait complete. 2024-05-10T04:26:50.584 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2024-05-10T04:26:50.611 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-10T04:26:50.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.885+0000 7ff889c00700 1 Processor -- start 2024-05-10T04:26:50.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.885+0000 7ff889c00700 1 -- start start 2024-05-10T04:26:50.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.887+0000 7ff889c00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff884162150 0x7ff88415e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:50.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.887+0000 7ff889c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff88406c160 0x7ff88406c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:50.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.887+0000 7ff889c00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8840d2c00 con 0x7ff8840cf4d0 2024-05-10T04:26:50.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.887+0000 7ff889c00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff88406cab0 con 0x7ff884162150 2024-05-10T04:26:50.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.887+0000 7ff889c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff884162630 con 0x7ff88406c160 2024-05-10T04:26:50.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.887+0000 7ff882000700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff8840cf4d0 0x7ff8840b73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58846/0 (socket says 172.21.15.80:58846) 2024-05-10T04:26:50.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.887+0000 7ff882000700 1 -- 172.21.15.80:0/3586810101 learned_addr learned my addr 172.21.15.80:0/3586810101 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:50.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.887+0000 7ff882a00700 1 --2- 172.21.15.80:0/3586810101 >> v2:172.21.15.106:3300/0 conn(0x7ff884162150 0x7ff88415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:50.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.887+0000 7ff883400700 1 --2- 172.21.15.80:0/3586810101 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff88406c160 0x7ff88406c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:50.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.888+0000 7ff881600700 1 -- 172.21.15.80:0/3586810101 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167232687 0 0) 0x7ff8840d2c00 con 0x7ff8840cf4d0 2024-05-10T04:26:50.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.888+0000 7ff881600700 1 -- 172.21.15.80:0/3586810101 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8680035b0 con 0x7ff8840cf4d0 2024-05-10T04:26:50.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.888+0000 7ff882a00700 1 -- 172.21.15.80:0/3586810101 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff88406c160 msgr2=0x7ff88406c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:50.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.888+0000 7ff882a00700 1 --2- 172.21.15.80:0/3586810101 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff88406c160 0x7ff88406c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:50.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.888+0000 7ff882a00700 1 -- 172.21.15.80:0/3586810101 >> v1:172.21.15.80:6789/0 conn(0x7ff8840cf4d0 legacy=0x7ff8840b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:50.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.888+0000 7ff882a00700 1 -- 172.21.15.80:0/3586810101 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff884162910 con 0x7ff884162150 2024-05-10T04:26:50.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.888+0000 7ff882a00700 1 --2- 172.21.15.80:0/3586810101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff884162150 0x7ff88415e610 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff874009870 tx=0x7ff874009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=758e00b6256b176f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:50.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.888+0000 7ff881600700 1 -- 172.21.15.80:0/3586810101 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874011830 con 0x7ff884162150 2024-05-10T04:26:50.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.889+0000 7ff881600700 1 -- 172.21.15.80:0/3586810101 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff874011990 con 0x7ff884162150 2024-05-10T04:26:50.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.889+0000 7ff881600700 1 -- 172.21.15.80:0/3586810101 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874011d20 con 0x7ff884162150 2024-05-10T04:26:50.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.889+0000 7ff889c00700 1 -- 172.21.15.80:0/3586810101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff884162150 msgr2=0x7ff88415e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:50.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.889+0000 7ff889c00700 1 --2- 172.21.15.80:0/3586810101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff884162150 0x7ff88415e610 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff874009870 tx=0x7ff874009b80 comp rx=0 tx=0).stop 2024-05-10T04:26:50.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.889+0000 7ff889c00700 1 -- 172.21.15.80:0/3586810101 shutdown_connections 2024-05-10T04:26:50.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.889+0000 7ff889c00700 1 --2- 172.21.15.80:0/3586810101 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff88406c160 0x7ff88406c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:50.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.889+0000 7ff889c00700 1 --2- 172.21.15.80:0/3586810101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff884162150 0x7ff88415e610 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:50.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.889+0000 7ff889c00700 1 -- 172.21.15.80:0/3586810101 >> 172.21.15.80:0/3586810101 conn(0x7ff8840d3e10 msgr2=0x7ff8840d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:50.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.889+0000 7ff889c00700 1 -- 172.21.15.80:0/3586810101 shutdown_connections 2024-05-10T04:26:50.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.889+0000 7ff889c00700 1 -- 172.21.15.80:0/3586810101 wait complete. 2024-05-10T04:26:50.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.892+0000 7ff889c00700 1 Processor -- start 2024-05-10T04:26:50.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.892+0000 7ff889c00700 1 -- start start 2024-05-10T04:26:50.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.893+0000 7ff889c00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff88406c160 0x7ff88414f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:50.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.893+0000 7ff889c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8840cf4d0 0x7ff8840b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:50.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.893+0000 7ff889c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff884162150 0x7ff8841f8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:50.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.893+0000 7ff889c00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff884153670 con 0x7ff884162150 2024-05-10T04:26:50.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.893+0000 7ff889c00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8840cde50 con 0x7ff88406c160 2024-05-10T04:26:50.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.893+0000 7ff889c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8840b4670 con 0x7ff8840cf4d0 2024-05-10T04:26:50.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.893+0000 7ff883400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff884162150 0x7ff8841f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:50.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.893+0000 7ff883400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff884162150 0x7ff8841f8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44022/0 (socket says 172.21.15.80:44022) 2024-05-10T04:26:50.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.894+0000 7ff883400700 1 -- 172.21.15.80:0/1075384034 learned_addr learned my addr 172.21.15.80:0/1075384034 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:50.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.894+0000 7ff882000700 1 --2- 172.21.15.80:0/1075384034 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8840cf4d0 0x7ff8840b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:50.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.894+0000 7ff882a00700 1 --2- 172.21.15.80:0/1075384034 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff88406c160 0x7ff88414f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:50.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.894+0000 7ff883400700 1 -- 172.21.15.80:0/1075384034 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8840cf4d0 msgr2=0x7ff8840b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:50.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.894+0000 7ff883400700 1 --2- 172.21.15.80:0/1075384034 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8840cf4d0 0x7ff8840b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:50.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.894+0000 7ff883400700 1 -- 172.21.15.80:0/1075384034 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff88406c160 msgr2=0x7ff88414f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:50.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.894+0000 7ff883400700 1 --2- 172.21.15.80:0/1075384034 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff88406c160 0x7ff88414f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:50.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.894+0000 7ff883400700 1 -- 172.21.15.80:0/1075384034 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8740094a0 con 0x7ff884162150 2024-05-10T04:26:50.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.894+0000 7ff883400700 1 --2- 172.21.15.80:0/1075384034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff884162150 0x7ff8841f8830 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00efc0 tx=0x7ff87c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:50.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.894+0000 7ff87aa00700 1 -- 172.21.15.80:0/1075384034 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c009b20 con 0x7ff884162150 2024-05-10T04:26:50.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.894+0000 7ff87aa00700 1 -- 172.21.15.80:0/1075384034 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87c00f040 con 0x7ff884162150 2024-05-10T04:26:50.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.894+0000 7ff889c00700 1 -- 172.21.15.80:0/1075384034 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8840ce080 con 0x7ff884162150 2024-05-10T04:26:50.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.895+0000 7ff87aa00700 1 -- 172.21.15.80:0/1075384034 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c00cc90 con 0x7ff884162150 2024-05-10T04:26:50.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.895+0000 7ff889c00700 1 -- 172.21.15.80:0/1075384034 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8841f8030 con 0x7ff884162150 2024-05-10T04:26:50.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.896+0000 7ff889c00700 1 -- 172.21.15.80:0/1075384034 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff884074af0 con 0x7ff884162150 2024-05-10T04:26:50.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.897+0000 7ff87aa00700 1 -- 172.21.15.80:0/1075384034 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff87c014480 con 0x7ff884162150 2024-05-10T04:26:50.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.897+0000 7ff87aa00700 1 --2- 172.21.15.80:0/1075384034 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff86406ac90 0x7ff86406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:50.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.898+0000 7ff87aa00700 1 -- 172.21.15.80:0/1075384034 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff87c0899a0 con 0x7ff884162150 2024-05-10T04:26:50.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.898+0000 7ff882a00700 1 --2- 172.21.15.80:0/1075384034 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff86406ac90 0x7ff86406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:50.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.898+0000 7ff882a00700 1 --2- 172.21.15.80:0/1075384034 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff86406ac90 0x7ff86406d1a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff874009870 tx=0x7ff874008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:50.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:50.902+0000 7ff87aa00700 1 -- 172.21.15.80:0/1075384034 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff87c054f10 con 0x7ff884162150 2024-05-10T04:26:51.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.110+0000 7ff889c00700 1 -- 172.21.15.80:0/1075384034 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff884161ec0 con 0x7ff884162150 2024-05-10T04:26:51.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.114+0000 7ff87aa00700 1 -- 172.21.15.80:0/1075384034 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff87c0180a0 con 0x7ff884162150 2024-05-10T04:26:51.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.117+0000 7ff889c00700 1 -- 172.21.15.80:0/1075384034 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff86406ac90 msgr2=0x7ff86406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:51.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.117+0000 7ff889c00700 1 --2- 172.21.15.80:0/1075384034 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff86406ac90 0x7ff86406d1a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff874009870 tx=0x7ff874008030 comp rx=0 tx=0).stop 2024-05-10T04:26:51.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.117+0000 7ff889c00700 1 -- 172.21.15.80:0/1075384034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff884162150 msgr2=0x7ff8841f8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:51.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.117+0000 7ff889c00700 1 --2- 172.21.15.80:0/1075384034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff884162150 0x7ff8841f8830 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00efc0 tx=0x7ff87c009f60 comp rx=0 tx=0).stop 2024-05-10T04:26:51.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.117+0000 7ff889c00700 1 -- 172.21.15.80:0/1075384034 shutdown_connections 2024-05-10T04:26:51.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.117+0000 7ff889c00700 1 --2- 172.21.15.80:0/1075384034 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7ff86406ac90 0x7ff86406d1a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:51.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.117+0000 7ff889c00700 1 --2- 172.21.15.80:0/1075384034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff884162150 0x7ff8841f8830 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:51.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.117+0000 7ff889c00700 1 --2- 172.21.15.80:0/1075384034 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff88406c160 0x7ff88414f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:51.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.117+0000 7ff889c00700 1 --2- 172.21.15.80:0/1075384034 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8840cf4d0 0x7ff8840b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:51.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.117+0000 7ff889c00700 1 -- 172.21.15.80:0/1075384034 >> 172.21.15.80:0/1075384034 conn(0x7ff8840d3e10 msgr2=0x7ff8840d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:51.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.117+0000 7ff889c00700 1 -- 172.21.15.80:0/1075384034 shutdown_connections 2024-05-10T04:26:51.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.117+0000 7ff889c00700 1 -- 172.21.15.80:0/1075384034 wait complete. 2024-05-10T04:26:51.144 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_acls.TestACLs.test_acls' 2024-05-10T04:26:51.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.402+0000 7f05db600700 1 Processor -- start 2024-05-10T04:26:51.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.402+0000 7f05db600700 1 -- start start 2024-05-10T04:26:51.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.404+0000 7f05db600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f05d40b6300 0x7f05d40b3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:51.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.404+0000 7f05db600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05d40d2710 0x7f05d40d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:51.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.404+0000 7f05db600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d415f960 con 0x7f05d4162bc0 2024-05-10T04:26:51.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.404+0000 7f05db600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d415f680 con 0x7f05d40b6300 2024-05-10T04:26:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.404+0000 7f05db600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d41620e0 con 0x7f05d40d2710 2024-05-10T04:26:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.404+0000 7f05d3e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f05d40b6300 0x7f05d40b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.404+0000 7f05d3e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f05d40b6300 0x7f05d40b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44034/0 (socket says 172.21.15.80:44034) 2024-05-10T04:26:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.404+0000 7f05d3e00700 1 -- 172.21.15.80:0/1065524218 learned_addr learned my addr 172.21.15.80:0/1065524218 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.405+0000 7f05d9600700 1 --2- 172.21.15.80:0/1065524218 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05d40d2710 0x7f05d40d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.405+0000 7f05d3e00700 1 -- 172.21.15.80:0/1065524218 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05d40d2710 msgr2=0x7f05d40d2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.405+0000 7f05d3e00700 1 --2- 172.21.15.80:0/1065524218 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05d40d2710 0x7f05d40d2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.405+0000 7f05d3e00700 1 -- 172.21.15.80:0/1065524218 >> v1:172.21.15.106:6789/0 conn(0x7f05d4162bc0 legacy=0x7f05d40b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.405+0000 7f05d3e00700 1 -- 172.21.15.80:0/1065524218 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d41623c0 con 0x7f05d40b6300 2024-05-10T04:26:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.405+0000 7f05d3e00700 1 --2- 172.21.15.80:0/1065524218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05d40b6300 0x7f05d40b3100 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f05c00098e0 tx=0x7f05c0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58feae118cb2a771 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.405+0000 7f05d3400700 1 -- 172.21.15.80:0/1065524218 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c000b8a0 con 0x7f05d40b6300 2024-05-10T04:26:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.405+0000 7f05d3400700 1 -- 172.21.15.80:0/1065524218 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c000ba00 con 0x7f05d40b6300 2024-05-10T04:26:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.405+0000 7f05d3400700 1 -- 172.21.15.80:0/1065524218 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c000bdb0 con 0x7f05d40b6300 2024-05-10T04:26:51.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.406+0000 7f05db600700 1 -- 172.21.15.80:0/1065524218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05d40b6300 msgr2=0x7f05d40b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:51.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.406+0000 7f05db600700 1 --2- 172.21.15.80:0/1065524218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05d40b6300 0x7f05d40b3100 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f05c00098e0 tx=0x7f05c0009bf0 comp rx=0 tx=0).stop 2024-05-10T04:26:51.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.406+0000 7f05db600700 1 -- 172.21.15.80:0/1065524218 shutdown_connections 2024-05-10T04:26:51.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.406+0000 7f05db600700 1 --2- 172.21.15.80:0/1065524218 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05d40d2710 0x7f05d40d2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:51.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.406+0000 7f05db600700 1 --2- 172.21.15.80:0/1065524218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05d40b6300 0x7f05d40b3100 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:51.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.406+0000 7f05db600700 1 -- 172.21.15.80:0/1065524218 >> 172.21.15.80:0/1065524218 conn(0x7f05d40d0c30 msgr2=0x7f05d40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:51.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.406+0000 7f05db600700 1 -- 172.21.15.80:0/1065524218 shutdown_connections 2024-05-10T04:26:51.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.406+0000 7f05db600700 1 -- 172.21.15.80:0/1065524218 wait complete. 2024-05-10T04:26:51.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.408+0000 7f05db600700 1 Processor -- start 2024-05-10T04:26:51.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.409+0000 7f05db600700 1 -- start start 2024-05-10T04:26:51.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.410+0000 7f05db600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05d40d2710 0x7f05d4157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:51.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.410+0000 7f05db600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05d4162bc0 0x7f05d414a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.410+0000 7f05db600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05d4154110 0x7f05d41f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.410+0000 7f05db600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d41f5130 con 0x7f05d40d2710 2024-05-10T04:26:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.410+0000 7f05db600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d40c8e50 con 0x7f05d4162bc0 2024-05-10T04:26:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.410+0000 7f05db600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d40c9130 con 0x7f05d4154110 2024-05-10T04:26:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.410+0000 7f05d8c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05d40d2710 0x7f05d4157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.410+0000 7f05d8c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05d40d2710 0x7f05d4157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44050/0 (socket says 172.21.15.80:44050) 2024-05-10T04:26:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.410+0000 7f05d8c00700 1 -- 172.21.15.80:0/1009373826 learned_addr learned my addr 172.21.15.80:0/1009373826 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.410+0000 7f05d9600700 1 --2- 172.21.15.80:0/1009373826 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05d4154110 0x7f05d41f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.411+0000 7f05d3e00700 1 --2- 172.21.15.80:0/1009373826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05d4162bc0 0x7f05d414a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.411+0000 7f05d8c00700 1 -- 172.21.15.80:0/1009373826 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05d4154110 msgr2=0x7f05d41f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.411+0000 7f05d8c00700 1 --2- 172.21.15.80:0/1009373826 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05d4154110 0x7f05d41f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.411+0000 7f05d8c00700 1 -- 172.21.15.80:0/1009373826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05d4162bc0 msgr2=0x7f05d414a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.411+0000 7f05d8c00700 1 --2- 172.21.15.80:0/1009373826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05d4162bc0 0x7f05d414a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.411+0000 7f05d8c00700 1 -- 172.21.15.80:0/1009373826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c00094f0 con 0x7f05d40d2710 2024-05-10T04:26:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.411+0000 7f05d9600700 1 --2- 172.21.15.80:0/1009373826 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05d4154110 0x7f05d41f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:26:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.411+0000 7f05d8c00700 1 --2- 172.21.15.80:0/1009373826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05d40d2710 0x7f05d4157490 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f05c800c450 tx=0x7f05c800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.411+0000 7f05d0c00700 1 -- 172.21.15.80:0/1009373826 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c80052d0 con 0x7f05d40d2710 2024-05-10T04:26:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.411+0000 7f05d0c00700 1 -- 172.21.15.80:0/1009373826 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c8005430 con 0x7f05d40d2710 2024-05-10T04:26:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.411+0000 7f05d0c00700 1 -- 172.21.15.80:0/1009373826 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c80038c0 con 0x7f05d40d2710 2024-05-10T04:26:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.411+0000 7f05db600700 1 -- 172.21.15.80:0/1009373826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d40c9410 con 0x7f05d40d2710 2024-05-10T04:26:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.411+0000 7f05db600700 1 -- 172.21.15.80:0/1009373826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d40c99d0 con 0x7f05d40d2710 2024-05-10T04:26:51.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.412+0000 7f05db600700 1 -- 172.21.15.80:0/1009373826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d40c9b60 con 0x7f05d40d2710 2024-05-10T04:26:51.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.413+0000 7f05d0c00700 1 -- 172.21.15.80:0/1009373826 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f05c8003a20 con 0x7f05d40d2710 2024-05-10T04:26:51.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.414+0000 7f05d0c00700 1 --2- 172.21.15.80:0/1009373826 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f05b406ac90 0x7f05b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:51.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.414+0000 7f05d0c00700 1 -- 172.21.15.80:0/1009373826 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f05c80884c0 con 0x7f05d40d2710 2024-05-10T04:26:51.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.415+0000 7f05d3e00700 1 --2- 172.21.15.80:0/1009373826 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f05b406ac90 0x7f05b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:51.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.415+0000 7f05d3e00700 1 --2- 172.21.15.80:0/1009373826 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f05b406ac90 0x7f05b406d1a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f05c00098e0 tx=0x7f05c0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:51.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.419+0000 7f05d0c00700 1 -- 172.21.15.80:0/1009373826 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f05c8053870 con 0x7f05d40d2710 2024-05-10T04:26:51.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:51.708+0000 7f05db600700 1 -- 172.21.15.80:0/1009373826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) v1 -- 0x7f05d4074af0 con 0x7f05d40d2710 2024-05-10T04:26:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:52.582+0000 7f05d0c00700 1 -- 172.21.15.80:0/1009373826 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v198) v1 ==== 120+0+0 (secure 0 0 0) 0x7f05c8056e90 con 0x7f05d40d2710 2024-05-10T04:26:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:52.585+0000 7f05db600700 1 -- 172.21.15.80:0/1009373826 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f05b406ac90 msgr2=0x7f05b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:52.585+0000 7f05db600700 1 --2- 172.21.15.80:0/1009373826 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f05b406ac90 0x7f05b406d1a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f05c00098e0 tx=0x7f05c0008030 comp rx=0 tx=0).stop 2024-05-10T04:26:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:52.585+0000 7f05db600700 1 -- 172.21.15.80:0/1009373826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05d40d2710 msgr2=0x7f05d4157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:52.585+0000 7f05db600700 1 --2- 172.21.15.80:0/1009373826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05d40d2710 0x7f05d4157490 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f05c800c450 tx=0x7f05c800c760 comp rx=0 tx=0).stop 2024-05-10T04:26:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:52.586+0000 7f05db600700 1 -- 172.21.15.80:0/1009373826 shutdown_connections 2024-05-10T04:26:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:52.586+0000 7f05db600700 1 --2- 172.21.15.80:0/1009373826 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f05b406ac90 0x7f05b406d1a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:52.586+0000 7f05db600700 1 --2- 172.21.15.80:0/1009373826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05d40d2710 0x7f05d4157490 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:52.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:52.586+0000 7f05db600700 1 --2- 172.21.15.80:0/1009373826 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05d4154110 0x7f05d41f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:52.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:52.586+0000 7f05db600700 1 --2- 172.21.15.80:0/1009373826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05d4162bc0 0x7f05d414a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:52.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:52.586+0000 7f05db600700 1 -- 172.21.15.80:0/1009373826 >> 172.21.15.80:0/1009373826 conn(0x7f05d40d0c30 msgr2=0x7f05d40d3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:52.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:52.586+0000 7f05db600700 1 -- 172.21.15.80:0/1009373826 shutdown_connections 2024-05-10T04:26:52.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:52.586+0000 7f05db600700 1 -- 172.21.15.80:0/1009373826 wait complete. 2024-05-10T04:26:52.618 INFO:tasks.cephfs_test_runner:test_acls (tasks.cephfs.test_acls.TestACLs) ... ok 2024-05-10T04:26:52.618 INFO:tasks.cephfs_test_runner: 2024-05-10T04:26:52.618 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-10T04:26:52.618 INFO:tasks.cephfs_test_runner:Ran 1 test in 212.290s 2024-05-10T04:26:52.618 INFO:tasks.cephfs_test_runner: 2024-05-10T04:26:52.618 INFO:tasks.cephfs_test_runner:OK 2024-05-10T04:26:52.619 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-10T04:26:52.628 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-10T04:26:52.636 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-10T04:26:52.636 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:26:52.636 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:26:52.680 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16343248k,nr_inodes=4085812,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275196k,mode=700,uid=1000,gid=1304 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2024-05-10T04:26:52.680 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-10T04:26:52.680 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:26:52.763 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16343248k,nr_inodes=4085812,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275196k,mode=700,uid=1000,gid=1304 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2024-05-10T04:26:52.763 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:26:52.763 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:26:52.810 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16343288k,nr_inodes=4085822,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275204k,mode=700,uid=1000,gid=1304 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2024-05-10T04:26:52.810 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T04:26:52.811 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:26:52.897 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16343288k,nr_inodes=4085822,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275204k,mode=700,uid=1000,gid=1304 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2024-05-10T04:26:52.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:26:52.897 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-05-10T04:26:52.940 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T04:26:52.940 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T04:26:52.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:26:52.941 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T04:26:53.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:26:53.049 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T04:26:53.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:26:53.117 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-05-10T04:26:53.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:26:53.237 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-05-10T04:26:53.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:26:53.281 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-05-10T04:26:53.393 INFO:teuthology.orchestra.run.smithi080.stderr:Cannot find device "ceph-brx" 2024-05-10T04:26:53.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:26:53.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:26:53.396 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-05-10T04:26:53.443 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-10T04:26:53.443 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-10T04:26:53.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:26:53.444 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-10T04:26:53.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:26:53.514 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-10T04:26:53.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:26:53.585 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2024-05-10T04:26:53.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:26:53.700 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-05-10T04:26:53.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:26:53.745 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2024-05-10T04:26:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:Cannot find device "ceph-brx" 2024-05-10T04:26:53.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:26:53.861 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-10T04:26:53.871 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T04:26:53.871 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:26:54.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.132+0000 7fa18d600700 1 Processor -- start 2024-05-10T04:26:54.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.132+0000 7fa18d600700 1 -- start start 2024-05-10T04:26:54.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.134+0000 7fa18d600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa18815b870 0x7fa18815c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:54.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.134+0000 7fa18d600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa1880b31d0 0x7fa18806d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:54.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.134+0000 7fa18d600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1880cf360 con 0x7fa1880cdde0 2024-05-10T04:26:54.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.134+0000 7fa18d600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18815c730 con 0x7fa18815b870 2024-05-10T04:26:54.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.134+0000 7fa18d600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1880ce750 con 0x7fa1880b31d0 2024-05-10T04:26:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.134+0000 7fa186a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa18815b870 0x7fa18815c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.134+0000 7fa186a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa18815b870 0x7fa18815c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44636/0 (socket says 172.21.15.80:44636) 2024-05-10T04:26:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.134+0000 7fa186a00700 1 -- 172.21.15.80:0/4096023532 learned_addr learned my addr 172.21.15.80:0/4096023532 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.134+0000 7fa187400700 1 --2- 172.21.15.80:0/4096023532 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa1880b31d0 0x7fa18806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.134+0000 7fa186a00700 1 -- 172.21.15.80:0/4096023532 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa1880b31d0 msgr2=0x7fa18806d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.134+0000 7fa186a00700 1 --2- 172.21.15.80:0/4096023532 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa1880b31d0 0x7fa18806d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.134+0000 7fa186a00700 1 -- 172.21.15.80:0/4096023532 >> v1:172.21.15.106:6789/0 conn(0x7fa1880cdde0 legacy=0x7fa1880b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.134+0000 7fa186a00700 1 -- 172.21.15.80:0/4096023532 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1880cea30 con 0x7fa18815b870 2024-05-10T04:26:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.134+0000 7fa187400700 1 --2- 172.21.15.80:0/4096023532 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa1880b31d0 0x7fa18806d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:26:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.135+0000 7fa186a00700 1 --2- 172.21.15.80:0/4096023532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa18815b870 0x7fa18815c1f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa1780098f0 tx=0x7fa178009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a66a1f3868bbdcd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.135+0000 7fa185600700 1 -- 172.21.15.80:0/4096023532 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa178004230 con 0x7fa18815b870 2024-05-10T04:26:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.135+0000 7fa185600700 1 -- 172.21.15.80:0/4096023532 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa178004390 con 0x7fa18815b870 2024-05-10T04:26:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.135+0000 7fa185600700 1 -- 172.21.15.80:0/4096023532 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1780036a0 con 0x7fa18815b870 2024-05-10T04:26:54.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.136+0000 7fa18d600700 1 -- 172.21.15.80:0/4096023532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa18815b870 msgr2=0x7fa18815c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:54.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.136+0000 7fa18d600700 1 --2- 172.21.15.80:0/4096023532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa18815b870 0x7fa18815c1f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa1780098f0 tx=0x7fa178009c00 comp rx=0 tx=0).stop 2024-05-10T04:26:54.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.136+0000 7fa18d600700 1 -- 172.21.15.80:0/4096023532 shutdown_connections 2024-05-10T04:26:54.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.136+0000 7fa18d600700 1 --2- 172.21.15.80:0/4096023532 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa1880b31d0 0x7fa18806d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.136+0000 7fa18d600700 1 --2- 172.21.15.80:0/4096023532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa18815b870 0x7fa18815c1f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.136+0000 7fa18d600700 1 -- 172.21.15.80:0/4096023532 >> 172.21.15.80:0/4096023532 conn(0x7fa18806b470 msgr2=0x7fa1880b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:54.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.136+0000 7fa18d600700 1 -- 172.21.15.80:0/4096023532 shutdown_connections 2024-05-10T04:26:54.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.136+0000 7fa18d600700 1 -- 172.21.15.80:0/4096023532 wait complete. 2024-05-10T04:26:54.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.138+0000 7fa18d600700 1 Processor -- start 2024-05-10T04:26:54.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.138+0000 7fa18d600700 1 -- start start 2024-05-10T04:26:54.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.140+0000 7fa18d600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa1880cdde0 0x7fa18813ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:54.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.140+0000 7fa18d600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa18815b870 0x7fa1881590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:54.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.140+0000 7fa18d600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1881f24c0 0x7fa18813bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:54.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.140+0000 7fa18d600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1881f5af0 con 0x7fa18815b870 2024-05-10T04:26:54.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.140+0000 7fa18d600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa188159bb0 con 0x7fa1881f24c0 2024-05-10T04:26:54.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.140+0000 7fa18d600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1881f2a50 con 0x7fa1880cdde0 2024-05-10T04:26:54.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.140+0000 7fa186000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa18815b870 0x7fa1881590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:54.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.140+0000 7fa186000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa18815b870 0x7fa1881590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44638/0 (socket says 172.21.15.80:44638) 2024-05-10T04:26:54.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.140+0000 7fa186000700 1 -- 172.21.15.80:0/2135887491 learned_addr learned my addr 172.21.15.80:0/2135887491 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:54.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.140+0000 7fa186a00700 1 --2- 172.21.15.80:0/2135887491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa1880cdde0 0x7fa18813ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:54.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.140+0000 7fa187400700 1 --2- 172.21.15.80:0/2135887491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1881f24c0 0x7fa18813bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:54.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.140+0000 7fa186000700 1 -- 172.21.15.80:0/2135887491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa1880cdde0 msgr2=0x7fa18813ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:54.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.141+0000 7fa186000700 1 --2- 172.21.15.80:0/2135887491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa1880cdde0 0x7fa18813ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.141+0000 7fa186000700 1 -- 172.21.15.80:0/2135887491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1881f24c0 msgr2=0x7fa18813bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:54.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.141+0000 7fa186000700 1 --2- 172.21.15.80:0/2135887491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1881f24c0 0x7fa18813bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.141+0000 7fa186000700 1 -- 172.21.15.80:0/2135887491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa178009550 con 0x7fa18815b870 2024-05-10T04:26:54.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.141+0000 7fa186000700 1 --2- 172.21.15.80:0/2135887491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa18815b870 0x7fa1881590c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa17400b4a0 tx=0x7fa17400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:54.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.141+0000 7fa17ea00700 1 -- 172.21.15.80:0/2135887491 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174011830 con 0x7fa18815b870 2024-05-10T04:26:54.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.141+0000 7fa17ea00700 1 -- 172.21.15.80:0/2135887491 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa174011990 con 0x7fa18815b870 2024-05-10T04:26:54.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.141+0000 7fa17ea00700 1 -- 172.21.15.80:0/2135887491 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174011d40 con 0x7fa18815b870 2024-05-10T04:26:54.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.141+0000 7fa18d600700 1 -- 172.21.15.80:0/2135887491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1881f2ca0 con 0x7fa18815b870 2024-05-10T04:26:54.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.141+0000 7fa18d600700 1 -- 172.21.15.80:0/2135887491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1881f3260 con 0x7fa18815b870 2024-05-10T04:26:54.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.142+0000 7fa18d600700 1 -- 172.21.15.80:0/2135887491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1881f6070 con 0x7fa18815b870 2024-05-10T04:26:54.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.143+0000 7fa17ea00700 1 -- 172.21.15.80:0/2135887491 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa17401a400 con 0x7fa18815b870 2024-05-10T04:26:54.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.145+0000 7fa17ea00700 1 --2- 172.21.15.80:0/2135887491 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa16806ac90 0x7fa16806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:54.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.145+0000 7fa17ea00700 1 -- 172.21.15.80:0/2135887491 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa174088d90 con 0x7fa18815b870 2024-05-10T04:26:54.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.145+0000 7fa186a00700 1 --2- 172.21.15.80:0/2135887491 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa16806ac90 0x7fa16806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:54.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.146+0000 7fa186a00700 1 --2- 172.21.15.80:0/2135887491 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa16806ac90 0x7fa16806d1a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa1780098f0 tx=0x7fa178008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:54.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.149+0000 7fa17ea00700 1 -- 172.21.15.80:0/2135887491 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa174054140 con 0x7fa18815b870 2024-05-10T04:26:54.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.346+0000 7fa18d600700 1 -- 172.21.15.80:0/2135887491 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1880b3a30 con 0x7fa16806ac90 2024-05-10T04:26:54.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.349+0000 7fa17ea00700 1 -- 172.21.15.80:0/2135887491 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50640 (secure 0 0 0) 0x7fa1880b3a30 con 0x7fa16806ac90 2024-05-10T04:26:54.351 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:26:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.352+0000 7fa18d600700 1 -- 172.21.15.80:0/2135887491 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa16806ac90 msgr2=0x7fa16806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.352+0000 7fa18d600700 1 --2- 172.21.15.80:0/2135887491 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa16806ac90 0x7fa16806d1a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa1780098f0 tx=0x7fa178008030 comp rx=0 tx=0).stop 2024-05-10T04:26:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.352+0000 7fa18d600700 1 -- 172.21.15.80:0/2135887491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa18815b870 msgr2=0x7fa1881590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.352+0000 7fa18d600700 1 --2- 172.21.15.80:0/2135887491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa18815b870 0x7fa1881590c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa17400b4a0 tx=0x7fa17400b7b0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.352+0000 7fa18d600700 1 -- 172.21.15.80:0/2135887491 shutdown_connections 2024-05-10T04:26:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.352+0000 7fa18d600700 1 --2- 172.21.15.80:0/2135887491 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa16806ac90 0x7fa16806d1a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.352+0000 7fa18d600700 1 --2- 172.21.15.80:0/2135887491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1881f24c0 0x7fa18813bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.352+0000 7fa18d600700 1 --2- 172.21.15.80:0/2135887491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa1880cdde0 0x7fa18813ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.352+0000 7fa18d600700 1 --2- 172.21.15.80:0/2135887491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa18815b870 0x7fa1881590c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.352+0000 7fa18d600700 1 -- 172.21.15.80:0/2135887491 >> 172.21.15.80:0/2135887491 conn(0x7fa18806b470 msgr2=0x7fa188143be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.352+0000 7fa18d600700 1 -- 172.21.15.80:0/2135887491 shutdown_connections 2024-05-10T04:26:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.352+0000 7fa18d600700 1 -- 172.21.15.80:0/2135887491 wait complete. 2024-05-10T04:26:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-10T04:26:54.378 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:26:54.380 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-05-10T04:26:52.807001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224740,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":220147,"kb_avail":754749980,"statfs":{"total":773094113280,"available":772863979520,"internally_reserved":0,"allocated":4562944,"data_stored":2514764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":225431096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-615807,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-5,"num_write":-125,"num_write_kb":-656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001576"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T04:26:49.984374+0000","last_change":"2024-05-10T04:22:27.829537+0000","last_active":"2024-05-10T04:26:49.984374+0000","last_peered":"2024-05-10T04:26:49.984374+0000","last_clean":"2024-05-10T04:26:49.984374+0000","last_became_active":"2024-05-10T04:22:27.828179+0000","last_became_peered":"2024-05-10T04:22:27.828179+0000","last_unstale":"2024-05-10T04:26:49.984374+0000","last_undegraded":"2024-05-10T04:26:49.984374+0000","last_fullsized":"2024-05-10T04:26:49.984374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_clean_scrub_stamp":"2024-05-10T04:22:26.813824+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:23.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":754339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82599999999999996,"5min":1.216,"15min":1.216},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81799999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.504}]},{"osd":1,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73299999999999998,"15min":0.74399999999999999},"min":{"1min":0.58699999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92700000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.625,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.79900000000000004,"5min":1.181,"15min":1.181},"last":0.63600000000000001}]},{"osd":2,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.68300000000000005,"15min":0.68600000000000005},"min":{"1min":0.53900000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.3320000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73999999999999999,"15min":0.76000000000000001},"min":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86899999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69999999999999996,"15min":0.70999999999999996},"min":{"1min":0.504,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85999999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.79200000000000004},"min":{"1min":0.54100000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92700000000000005,"5min":1.155,"15min":1.155},"last":0.83999999999999997}]},{"osd":4,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68300000000000005,"15min":0.68000000000000005},"min":{"1min":0.52100000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95599999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71699999999999997,"15min":0.71399999999999997},"min":{"1min":0.50900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85999999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.79800000000000004}]},{"osd":5,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76400000000000001,"15min":0.77800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.99299999999999999,"5min":1.056,"15min":1.056},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.503,"5min":0.438,"15min":0.438},"max":{"1min":0.94899999999999995,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.82499999999999996}]},{"osd":6,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.85999999999999999,"15min":0.86599999999999999},"min":{"1min":0.71599999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0189999999999999,"5min":1.252,"15min":1.252},"last":0.871},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.84899999999999998,"15min":0.877},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0349999999999999,"5min":2.206,"15min":2.206},"last":0.92500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71099999999999997,"15min":0.71499999999999997},"min":{"1min":0.50600000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95699999999999996,"5min":1,"15min":1},"last":0.96299999999999997}]},{"osd":1,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.91900000000000004,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95699999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.98799999999999999}]},{"osd":2,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.68600000000000005},"min":{"1min":0.51700000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89500000000000002,"5min":1.048,"15min":1.048},"last":1.169},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.53900000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88300000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.089}]},{"osd":3,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70599999999999996,"15min":0.69299999999999995},"min":{"1min":0.58099999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85599999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.497,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89800000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.91200000000000003}]},{"osd":4,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.51500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.95399999999999996,"5min":1.079,"15min":1.079},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45600000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.90200000000000002,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":1.1160000000000001}]},{"osd":5,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.747,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95399999999999996,"5min":1.036,"15min":1.036},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.63900000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.999,"5min":1.01,"15min":1.01},"last":1.0649999999999999}]},{"osd":7,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":0.99199999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.036},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82999999999999996,"15min":0.83799999999999997},"min":{"1min":0.63700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97999999999999998,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.1359999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":163971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.496,"15min":0.57099999999999995},"min":{"1min":0.311,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.52100000000000002,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.55000000000000004,"15min":0.61199999999999999},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.65700000000000003,"5min":3.347,"15min":3.347},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.502,"15min":0.53200000000000003},"min":{"1min":0.39800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.56399999999999995,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.48099999999999998,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.51500000000000001,"5min":1.294,"15min":1.294},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56899999999999995,"15min":0.61799999999999999},"min":{"1min":0.42899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.57599999999999996,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.52800000000000002,"15min":0.59799999999999998},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.60199999999999998,"5min":3.629,"15min":3.629},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.94999999999999996,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.77600000000000002,"15min":0.78300000000000003},"min":{"1min":0.58799999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.90100000000000002,"5min":1.464,"15min":1.464},"last":0.94399999999999995}]},{"osd":5,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.77200000000000002,"15min":0.80400000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90600000000000003,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76400000000000001,"15min":0.76500000000000001},"min":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.91900000000000004,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.90100000000000002}]},{"osd":6,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.80500000000000005,"15min":0.81599999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91800000000000004,"5min":2.391,"15min":2.391},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78200000000000003,"15min":0.81699999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.89400000000000002,"5min":1.625,"15min":1.625},"last":0.82299999999999995}]},{"osd":7,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78900000000000003,"15min":0.83699999999999997},"min":{"1min":0.57299999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89500000000000002,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81000000000000005,"15min":0.84299999999999997},"min":{"1min":0.58499999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.99199999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.92900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":1007616,"data_stored":754339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.48899999999999999,"15min":0.52100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57199999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.441},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.52000000000000002,"15min":0.55200000000000005},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.51100000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.47099999999999997}]},{"osd":2,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.47099999999999997,"15min":0.51900000000000002},"min":{"1min":0.33200000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.47199999999999998,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54700000000000004,"15min":0.59499999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.57699999999999996,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57199999999999995,"15min":0.626},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.61099999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.52700000000000002,"15min":0.56200000000000006},"min":{"1min":0.38,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.56399999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85599999999999998,"5min":1.034,"15min":1.034},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.78400000000000003,"15min":0.79400000000000004},"min":{"1min":0.59299999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.93899999999999995,"5min":1.492,"15min":1.492},"last":0.85199999999999998}]},{"osd":5,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70499999999999996,"15min":0.69599999999999995},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.79600000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.56999999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91000000000000003,"5min":1.071,"15min":1.071},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.51700000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94999999999999996,"5min":1.091,"15min":1.091},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.58199999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0049999999999999,"5min":1.052,"15min":1.052},"last":0.69799999999999995}]},{"osd":7,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.81499999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.96299999999999997,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.92200000000000004,"5min":1.105,"15min":1.105},"last":0.77800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.52500000000000002,"15min":0.63300000000000001},"min":{"1min":0.28699999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.621,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.432,"5min":0.52500000000000002,"15min":0.63},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52300000000000002,"5min":5.883,"15min":5.883},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.56399999999999995,"15min":0.65400000000000003},"min":{"1min":0.33600000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64800000000000002,"5min":4.1440000000000001,"15min":4.1440000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.58699999999999997,"15min":0.69299999999999995},"min":{"1min":0.39300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73699999999999999,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.69799999999999995}]},{"osd":3,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51800000000000002,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.60199999999999998,"5min":3.452,"15min":3.452},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58499999999999996,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.64600000000000002,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.79500000000000004,"15min":0.82699999999999996},"min":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.95899999999999996,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.86699999999999999},"min":{"1min":0.60699999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94199999999999995,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.80000000000000004}]},{"osd":5,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77600000000000002,"15min":0.82799999999999996},"min":{"1min":0.55500000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94299999999999995,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.58999999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92400000000000004,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.81599999999999995}]},{"osd":6,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78200000000000003,"15min":0.84799999999999998},"min":{"1min":0.56200000000000006,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98899999999999999,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.79900000000000004,"15min":0.84599999999999997},"min":{"1min":0.59499999999999997,"5min":0.501,"15min":0.501},"max":{"1min":0.99299999999999999,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80400000000000005,"15min":0.83699999999999997},"min":{"1min":0.63800000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.97699999999999998,"5min":1.986,"15min":1.986},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.84699999999999998,"15min":0.91500000000000004},"min":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.996,"5min":3.419,"15min":3.419},"last":0.66500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":163971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.42799999999999999,"15min":0.433},"min":{"1min":0.308,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.53000000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.47099999999999997,"15min":0.47999999999999998},"min":{"1min":0.33100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.59199999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.439}]},{"osd":1,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.51500000000000001,"15min":0.57699999999999996},"min":{"1min":0.318,"5min":0.312,"15min":0.312},"max":{"1min":0.61599999999999999,"5min":3.6829999999999998,"15min":3.6829999999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.50700000000000001,"15min":0.51800000000000002},"min":{"1min":0.374,"5min":0.316,"15min":0.316},"max":{"1min":0.61199999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.64200000000000002,"15min":0.73599999999999999},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69799999999999995,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.64500000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.628,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.52300000000000002}]},{"osd":4,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.73299999999999998},"min":{"1min":0.58599999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97299999999999998,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82899999999999996,"15min":0.88500000000000001},"min":{"1min":0.60699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0029999999999999,"5min":4.0010000000000003,"15min":4.0010000000000003},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.82699999999999996,"15min":0.88900000000000001},"min":{"1min":0.61299999999999999,"5min":0.501,"15min":0.501},"max":{"1min":0.94699999999999995,"5min":4.024,"15min":4.024},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.501,"5min":0.495,"15min":0.495},"max":{"1min":1.014,"5min":1.456,"15min":1.456},"last":0.745}]},{"osd":6,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76800000000000002,"15min":0.76600000000000001},"min":{"1min":0.58099999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.97699999999999998,"5min":1.502,"15min":1.502},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77300000000000002,"15min":0.77600000000000002},"min":{"1min":0.624,"5min":0.497,"15min":0.497},"max":{"1min":0.95899999999999996,"5min":1.474,"15min":1.474},"last":0.84899999999999998}]},{"osd":7,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.66300000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0289999999999999,"5min":1.369,"15min":1.369},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.88400000000000001,"15min":0.96099999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0469999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.70399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.71199999999999997,"15min":0.74299999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89900000000000002,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97299999999999998,"5min":2.641,"15min":2.641},"last":0.72399999999999998}]},{"osd":1,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.42999999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.871},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.48199999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.996,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68000000000000005,"15min":0.66800000000000004},"min":{"1min":0.48399999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89700000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.621},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76400000000000001,"15min":0.77600000000000002},"min":{"1min":0.52600000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99299999999999999,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.91600000000000004}]},{"osd":3,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.47199999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":1.024,"15min":1.024},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.79700000000000004,"15min":0.81499999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.95499999999999996,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.65100000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.46800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.96099999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.84099999999999997}]},{"osd":6,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.47499999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.58599999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.88700000000000001}]},{"osd":7,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.55800000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0149999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.82899999999999996,"15min":0.82299999999999995},"min":{"1min":0.65500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0269999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.93100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.64200000000000002,"15min":0.66700000000000004},"min":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70499999999999996,"5min":2.032,"15min":2.032},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.69199999999999995,"15min":0.73699999999999999},"min":{"1min":0.46400000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81399999999999995,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.61399999999999999}]},{"osd":1,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.73499999999999999,"15min":0.78100000000000003},"min":{"1min":0.53700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80200000000000005,"5min":2.089,"15min":2.089},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.53700000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.75900000000000001,"5min":1.964,"15min":1.964},"last":0.90500000000000003}]},{"osd":2,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.75700000000000001,"15min":0.82099999999999995},"min":{"1min":0.51000000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93100000000000005,"5min":2.577,"15min":2.577},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78800000000000003,"15min":0.84099999999999997},"min":{"1min":0.622,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.82799999999999996,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.92600000000000005}]},{"osd":3,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.77700000000000002,"15min":0.81699999999999995},"min":{"1min":0.55600000000000005,"5min":0.436,"15min":0.436},"max":{"1min":0.86299999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.77300000000000002,"15min":0.79800000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86099999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.871}]},{"osd":4,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68500000000000005,"15min":0.71699999999999997},"min":{"1min":0.52800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.871,"5min":1.458,"15min":1.458},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77000000000000002,"15min":0.80400000000000005},"min":{"1min":0.61599999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89700000000000002,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.754,"15min":0.73299999999999998},"min":{"1min":0.58799999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92800000000000005,"5min":1.595,"15min":1.595},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79000000000000004,"15min":0.79700000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91400000000000003,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.012}]},{"osd":7,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.86299999999999999,"15min":0.94399999999999995},"min":{"1min":0.56699999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95699999999999996,"5min":4.0700000000000003,"15min":4.0700000000000003},"last":0.995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.83299999999999996,"15min":0.874},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94399999999999995,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.96299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:26:54.381 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:26:54.383 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:26:54.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.646+0000 7f46a7c00700 1 Processor -- start 2024-05-10T04:26:54.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.646+0000 7f46a7c00700 1 -- start start 2024-05-10T04:26:54.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.648+0000 7f46a7c00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f46a00b2ac0 0x7f46a00ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:54.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.648+0000 7f46a7c00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f46a00cf320 0x7f46a00b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:54.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.648+0000 7f46a7c00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a015e4e0 con 0x7f46a0071620 2024-05-10T04:26:54.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.648+0000 7f46a7c00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a015e7c0 con 0x7f46a00b2ac0 2024-05-10T04:26:54.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.648+0000 7f46a7c00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a015eaa0 con 0x7f46a00cf320 2024-05-10T04:26:54.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.648+0000 7f46a5200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f46a00b2ac0 0x7f46a00ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:54.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.648+0000 7f46a5200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f46a00b2ac0 0x7f46a00ce630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44652/0 (socket says 172.21.15.80:44652) 2024-05-10T04:26:54.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.648+0000 7f46a5200700 1 -- 172.21.15.80:0/3564487611 learned_addr learned my addr 172.21.15.80:0/3564487611 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:54.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.648+0000 7f469fe00700 1 --2- 172.21.15.80:0/3564487611 >> v2:172.21.15.106:3300/0 conn(0x7f46a00cf320 0x7f46a00b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:54.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.649+0000 7f46a5200700 1 -- 172.21.15.80:0/3564487611 >> v2:172.21.15.106:3300/0 conn(0x7f46a00cf320 msgr2=0x7f46a00b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:54.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.649+0000 7f46a5200700 1 --2- 172.21.15.80:0/3564487611 >> v2:172.21.15.106:3300/0 conn(0x7f46a00cf320 0x7f46a00b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.649+0000 7f46a5200700 1 -- 172.21.15.80:0/3564487611 >> v1:172.21.15.106:6789/0 conn(0x7f46a0071620 legacy=0x7f46a0071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:54.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.649+0000 7f46a5200700 1 -- 172.21.15.80:0/3564487611 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a015ed80 con 0x7f46a00b2ac0 2024-05-10T04:26:54.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.649+0000 7f469f400700 1 -- 172.21.15.80:0/3564487611 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470526760 0 0) 0x7f46a015e4e0 con 0x7f46a0071620 2024-05-10T04:26:54.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.649+0000 7f46a5200700 1 --2- 172.21.15.80:0/3564487611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46a00b2ac0 0x7f46a00ce630 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f46a0158a40 tx=0x7f4694009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70c3b788bfa92df server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:54.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.649+0000 7f469f400700 1 -- 172.21.15.80:0/3564487611 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694011830 con 0x7f46a00b2ac0 2024-05-10T04:26:54.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.649+0000 7f469f400700 1 -- 172.21.15.80:0/3564487611 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4694011990 con 0x7f46a00b2ac0 2024-05-10T04:26:54.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.649+0000 7f469f400700 1 -- 172.21.15.80:0/3564487611 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694011d20 con 0x7f46a00b2ac0 2024-05-10T04:26:54.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.650+0000 7f46a7c00700 1 -- 172.21.15.80:0/3564487611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46a00b2ac0 msgr2=0x7f46a00ce630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:54.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.650+0000 7f46a7c00700 1 --2- 172.21.15.80:0/3564487611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46a00b2ac0 0x7f46a00ce630 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f46a0158a40 tx=0x7f4694009bd0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.650+0000 7f46a7c00700 1 -- 172.21.15.80:0/3564487611 shutdown_connections 2024-05-10T04:26:54.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.650+0000 7f46a7c00700 1 --2- 172.21.15.80:0/3564487611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46a00b2ac0 0x7f46a00ce630 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.650+0000 7f46a7c00700 1 --2- 172.21.15.80:0/3564487611 >> v2:172.21.15.106:3300/0 conn(0x7f46a00cf320 0x7f46a00b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.650+0000 7f46a7c00700 1 -- 172.21.15.80:0/3564487611 >> 172.21.15.80:0/3564487611 conn(0x7f46a006b470 msgr2=0x7f46a00b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:54.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.650+0000 7f46a7c00700 1 -- 172.21.15.80:0/3564487611 shutdown_connections 2024-05-10T04:26:54.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.650+0000 7f46a7c00700 1 -- 172.21.15.80:0/3564487611 wait complete. 2024-05-10T04:26:54.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.653+0000 7f46a7c00700 1 Processor -- start 2024-05-10T04:26:54.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.653+0000 7f46a7c00700 1 -- start start 2024-05-10T04:26:54.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.654+0000 7f46a7c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46a0071620 0x7f46a00ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:54.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.654+0000 7f46a7c00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f46a00b2ac0 0x7f46a00ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:54.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.654+0000 7f46a7c00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f46a00cf320 0x7f46a0155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:54.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.654+0000 7f46a7c00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a01568b0 con 0x7f46a0071620 2024-05-10T04:26:54.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.654+0000 7f46a7c00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00ad050 con 0x7f46a00cf320 2024-05-10T04:26:54.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.654+0000 7f46a7c00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00ace20 con 0x7f46a00b2ac0 2024-05-10T04:26:54.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.655+0000 7f46a5200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46a0071620 0x7f46a00ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:54.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.655+0000 7f46a5200700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46a0071620 0x7f46a00ae340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44664/0 (socket says 172.21.15.80:44664) 2024-05-10T04:26:54.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.655+0000 7f46a5200700 1 -- 172.21.15.80:0/3959168638 learned_addr learned my addr 172.21.15.80:0/3959168638 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:54.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.655+0000 7f469fe00700 1 --2- 172.21.15.80:0/3959168638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f46a00b2ac0 0x7f46a00ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:54.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.655+0000 7f46a5c00700 1 --2- 172.21.15.80:0/3959168638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f46a00cf320 0x7f46a0155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.655+0000 7f46a5200700 1 -- 172.21.15.80:0/3959168638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f46a00b2ac0 msgr2=0x7f46a00ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.655+0000 7f46a5200700 1 --2- 172.21.15.80:0/3959168638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f46a00b2ac0 0x7f46a00ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.655+0000 7f46a5200700 1 -- 172.21.15.80:0/3959168638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f46a00cf320 msgr2=0x7f46a0155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.655+0000 7f46a5200700 1 --2- 172.21.15.80:0/3959168638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f46a00cf320 0x7f46a0155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.655+0000 7f46a5200700 1 -- 172.21.15.80:0/3959168638 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4694009550 con 0x7f46a0071620 2024-05-10T04:26:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.655+0000 7f46a5c00700 1 --2- 172.21.15.80:0/3959168638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f46a00cf320 0x7f46a0155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:26:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.655+0000 7f46a5200700 1 --2- 172.21.15.80:0/3959168638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46a0071620 0x7f46a00ae340 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4694009c10 tx=0x7f4694004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.655+0000 7f469cc00700 1 -- 172.21.15.80:0/3959168638 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940036a0 con 0x7f46a0071620 2024-05-10T04:26:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.655+0000 7f469cc00700 1 -- 172.21.15.80:0/3959168638 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469401e070 con 0x7f46a0071620 2024-05-10T04:26:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.655+0000 7f469cc00700 1 -- 172.21.15.80:0/3959168638 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694003a20 con 0x7f46a0071620 2024-05-10T04:26:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.655+0000 7f46a7c00700 1 -- 172.21.15.80:0/3959168638 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a01511c0 con 0x7f46a0071620 2024-05-10T04:26:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.656+0000 7f46a7c00700 1 -- 172.21.15.80:0/3959168638 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a00ad580 con 0x7f46a0071620 2024-05-10T04:26:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.657+0000 7f46a7c00700 1 -- 172.21.15.80:0/3959168638 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a0074af0 con 0x7f46a0071620 2024-05-10T04:26:54.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.658+0000 7f469cc00700 1 -- 172.21.15.80:0/3959168638 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4694003b80 con 0x7f46a0071620 2024-05-10T04:26:54.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.658+0000 7f469cc00700 1 --2- 172.21.15.80:0/3959168638 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f468006acc0 0x7f468006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:54.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.659+0000 7f469cc00700 1 -- 172.21.15.80:0/3959168638 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f469408a0c0 con 0x7f46a0071620 2024-05-10T04:26:54.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.659+0000 7f469fe00700 1 --2- 172.21.15.80:0/3959168638 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f468006acc0 0x7f468006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:54.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.659+0000 7f469fe00700 1 --2- 172.21.15.80:0/3959168638 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f468006acc0 0x7f468006d1d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f46a00ce810 tx=0x7f468c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:54.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.663+0000 7f469cc00700 1 -- 172.21.15.80:0/3959168638 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4694055500 con 0x7f46a0071620 2024-05-10T04:26:54.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.862+0000 7f46a7c00700 1 -- 172.21.15.80:0/3959168638 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46a00cd910 con 0x7f468006acc0 2024-05-10T04:26:54.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.865+0000 7f469cc00700 1 -- 172.21.15.80:0/3959168638 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50640 (secure 0 0 0) 0x7f468c011720 con 0x7f468006acc0 2024-05-10T04:26:54.867 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:26:54.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.868+0000 7f46a7c00700 1 -- 172.21.15.80:0/3959168638 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f468006acc0 msgr2=0x7f468006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.868+0000 7f46a7c00700 1 --2- 172.21.15.80:0/3959168638 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f468006acc0 0x7f468006d1d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f46a00ce810 tx=0x7f468c008040 comp rx=0 tx=0).stop 2024-05-10T04:26:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.868+0000 7f46a7c00700 1 -- 172.21.15.80:0/3959168638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46a0071620 msgr2=0x7f46a00ae340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.868+0000 7f46a7c00700 1 --2- 172.21.15.80:0/3959168638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46a0071620 0x7f46a00ae340 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4694009c10 tx=0x7f4694004750 comp rx=0 tx=0).stop 2024-05-10T04:26:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.868+0000 7f46a7c00700 1 -- 172.21.15.80:0/3959168638 shutdown_connections 2024-05-10T04:26:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.868+0000 7f46a7c00700 1 --2- 172.21.15.80:0/3959168638 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f468006acc0 0x7f468006d1d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.868+0000 7f46a7c00700 1 --2- 172.21.15.80:0/3959168638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46a0071620 0x7f46a00ae340 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.868+0000 7f46a7c00700 1 --2- 172.21.15.80:0/3959168638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f46a00cf320 0x7f46a0155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.868+0000 7f46a7c00700 1 --2- 172.21.15.80:0/3959168638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f46a00b2ac0 0x7f46a00ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.868+0000 7f46a7c00700 1 -- 172.21.15.80:0/3959168638 >> 172.21.15.80:0/3959168638 conn(0x7f46a006b470 msgr2=0x7f46a015a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.868+0000 7f46a7c00700 1 -- 172.21.15.80:0/3959168638 shutdown_connections 2024-05-10T04:26:54.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:54.868+0000 7f46a7c00700 1 -- 172.21.15.80:0/3959168638 wait complete. 2024-05-10T04:26:54.871 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-10T04:26:54.898 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2024-05-10T04:26:54.807370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224740,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":220147,"kb_avail":754749980,"statfs":{"total":773094113280,"available":772863979520,"internally_reserved":0,"allocated":4562944,"data_stored":2514764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":225431096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-615807,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-5,"num_write":-125,"num_write_kb":-656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.256396"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T04:26:49.984374+0000","last_change":"2024-05-10T04:22:27.829537+0000","last_active":"2024-05-10T04:26:49.984374+0000","last_peered":"2024-05-10T04:26:49.984374+0000","last_clean":"2024-05-10T04:26:49.984374+0000","last_became_active":"2024-05-10T04:22:27.828179+0000","last_became_peered":"2024-05-10T04:22:27.828179+0000","last_unstale":"2024-05-10T04:26:49.984374+0000","last_undegraded":"2024-05-10T04:26:49.984374+0000","last_fullsized":"2024-05-10T04:26:49.984374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_clean_scrub_stamp":"2024-05-10T04:22:26.813824+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:23.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":754339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82599999999999996,"5min":1.216,"15min":1.216},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81799999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.504}]},{"osd":1,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73299999999999998,"15min":0.74399999999999999},"min":{"1min":0.58699999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92700000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.625,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.79900000000000004,"5min":1.181,"15min":1.181},"last":0.63600000000000001}]},{"osd":2,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.68300000000000005,"15min":0.68600000000000005},"min":{"1min":0.53900000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.3320000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73999999999999999,"15min":0.76000000000000001},"min":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86899999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69999999999999996,"15min":0.70999999999999996},"min":{"1min":0.504,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85999999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.79200000000000004},"min":{"1min":0.54100000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92700000000000005,"5min":1.155,"15min":1.155},"last":0.83999999999999997}]},{"osd":4,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68300000000000005,"15min":0.68000000000000005},"min":{"1min":0.52100000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95599999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71699999999999997,"15min":0.71399999999999997},"min":{"1min":0.50900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85999999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.79800000000000004}]},{"osd":5,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76400000000000001,"15min":0.77800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.99299999999999999,"5min":1.056,"15min":1.056},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.503,"5min":0.438,"15min":0.438},"max":{"1min":0.94899999999999995,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.82499999999999996}]},{"osd":6,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.85999999999999999,"15min":0.86599999999999999},"min":{"1min":0.71599999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0189999999999999,"5min":1.252,"15min":1.252},"last":0.871},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.84899999999999998,"15min":0.877},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0349999999999999,"5min":2.206,"15min":2.206},"last":0.92500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71099999999999997,"15min":0.71499999999999997},"min":{"1min":0.50600000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95699999999999996,"5min":1,"15min":1},"last":0.96299999999999997}]},{"osd":1,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.91900000000000004,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95699999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.98799999999999999}]},{"osd":2,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.68600000000000005},"min":{"1min":0.51700000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89500000000000002,"5min":1.048,"15min":1.048},"last":1.169},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.53900000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88300000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.089}]},{"osd":3,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70599999999999996,"15min":0.69299999999999995},"min":{"1min":0.58099999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85599999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.497,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89800000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.91200000000000003}]},{"osd":4,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.51500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.95399999999999996,"5min":1.079,"15min":1.079},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45600000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.90200000000000002,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":1.1160000000000001}]},{"osd":5,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.747,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95399999999999996,"5min":1.036,"15min":1.036},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.63900000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.999,"5min":1.01,"15min":1.01},"last":1.0649999999999999}]},{"osd":7,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":0.99199999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.036},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82999999999999996,"15min":0.83799999999999997},"min":{"1min":0.63700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97999999999999998,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.1359999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":163971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.496,"15min":0.57099999999999995},"min":{"1min":0.311,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.52100000000000002,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.55000000000000004,"15min":0.61199999999999999},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.65700000000000003,"5min":3.347,"15min":3.347},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.502,"15min":0.53200000000000003},"min":{"1min":0.39800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.56399999999999995,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.48099999999999998,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.51500000000000001,"5min":1.294,"15min":1.294},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56899999999999995,"15min":0.61799999999999999},"min":{"1min":0.42899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.57599999999999996,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.52800000000000002,"15min":0.59799999999999998},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.60199999999999998,"5min":3.629,"15min":3.629},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.94999999999999996,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.77600000000000002,"15min":0.78300000000000003},"min":{"1min":0.58799999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.90100000000000002,"5min":1.464,"15min":1.464},"last":0.94399999999999995}]},{"osd":5,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.77200000000000002,"15min":0.80400000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90600000000000003,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76400000000000001,"15min":0.76500000000000001},"min":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.91900000000000004,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.90100000000000002}]},{"osd":6,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.80500000000000005,"15min":0.81599999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91800000000000004,"5min":2.391,"15min":2.391},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78200000000000003,"15min":0.81699999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.89400000000000002,"5min":1.625,"15min":1.625},"last":0.82299999999999995}]},{"osd":7,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78900000000000003,"15min":0.83699999999999997},"min":{"1min":0.57299999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89500000000000002,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81000000000000005,"15min":0.84299999999999997},"min":{"1min":0.58499999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.99199999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.92900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":1007616,"data_stored":754339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.48899999999999999,"15min":0.52100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57199999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.441},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.52000000000000002,"15min":0.55200000000000005},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.51100000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.47099999999999997}]},{"osd":2,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.47099999999999997,"15min":0.51900000000000002},"min":{"1min":0.33200000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.47199999999999998,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54700000000000004,"15min":0.59499999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.57699999999999996,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57199999999999995,"15min":0.626},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.61099999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.52700000000000002,"15min":0.56200000000000006},"min":{"1min":0.38,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.56399999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85599999999999998,"5min":1.034,"15min":1.034},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.78400000000000003,"15min":0.79400000000000004},"min":{"1min":0.59299999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.93899999999999995,"5min":1.492,"15min":1.492},"last":0.85199999999999998}]},{"osd":5,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70499999999999996,"15min":0.69599999999999995},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.79600000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.56999999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91000000000000003,"5min":1.071,"15min":1.071},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.51700000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94999999999999996,"5min":1.091,"15min":1.091},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.58199999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0049999999999999,"5min":1.052,"15min":1.052},"last":0.69799999999999995}]},{"osd":7,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.81499999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.96299999999999997,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.92200000000000004,"5min":1.105,"15min":1.105},"last":0.77800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.52500000000000002,"15min":0.63300000000000001},"min":{"1min":0.28699999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.621,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.432,"5min":0.52500000000000002,"15min":0.63},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52300000000000002,"5min":5.883,"15min":5.883},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.56399999999999995,"15min":0.65400000000000003},"min":{"1min":0.33600000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64800000000000002,"5min":4.1440000000000001,"15min":4.1440000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.58699999999999997,"15min":0.69299999999999995},"min":{"1min":0.39300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73699999999999999,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.69799999999999995}]},{"osd":3,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51800000000000002,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.60199999999999998,"5min":3.452,"15min":3.452},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58499999999999996,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.64600000000000002,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.79500000000000004,"15min":0.82699999999999996},"min":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.95899999999999996,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.86699999999999999},"min":{"1min":0.60699999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94199999999999995,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.80000000000000004}]},{"osd":5,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77600000000000002,"15min":0.82799999999999996},"min":{"1min":0.55500000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94299999999999995,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.58999999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92400000000000004,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.81599999999999995}]},{"osd":6,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78200000000000003,"15min":0.84799999999999998},"min":{"1min":0.56200000000000006,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98899999999999999,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.79900000000000004,"15min":0.84599999999999997},"min":{"1min":0.59499999999999997,"5min":0.501,"15min":0.501},"max":{"1min":0.99299999999999999,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80400000000000005,"15min":0.83699999999999997},"min":{"1min":0.63800000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.97699999999999998,"5min":1.986,"15min":1.986},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.84699999999999998,"15min":0.91500000000000004},"min":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.996,"5min":3.419,"15min":3.419},"last":0.66500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":163971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.42799999999999999,"15min":0.433},"min":{"1min":0.308,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.53000000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.47099999999999997,"15min":0.47999999999999998},"min":{"1min":0.33100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.59199999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.439}]},{"osd":1,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.51500000000000001,"15min":0.57699999999999996},"min":{"1min":0.318,"5min":0.312,"15min":0.312},"max":{"1min":0.61599999999999999,"5min":3.6829999999999998,"15min":3.6829999999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.50700000000000001,"15min":0.51800000000000002},"min":{"1min":0.374,"5min":0.316,"15min":0.316},"max":{"1min":0.61199999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.64200000000000002,"15min":0.73599999999999999},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69799999999999995,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.64500000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.628,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.52300000000000002}]},{"osd":4,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.73299999999999998},"min":{"1min":0.58599999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97299999999999998,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82899999999999996,"15min":0.88500000000000001},"min":{"1min":0.60699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0029999999999999,"5min":4.0010000000000003,"15min":4.0010000000000003},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.82699999999999996,"15min":0.88900000000000001},"min":{"1min":0.61299999999999999,"5min":0.501,"15min":0.501},"max":{"1min":0.94699999999999995,"5min":4.024,"15min":4.024},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.501,"5min":0.495,"15min":0.495},"max":{"1min":1.014,"5min":1.456,"15min":1.456},"last":0.745}]},{"osd":6,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76800000000000002,"15min":0.76600000000000001},"min":{"1min":0.58099999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.97699999999999998,"5min":1.502,"15min":1.502},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77300000000000002,"15min":0.77600000000000002},"min":{"1min":0.624,"5min":0.497,"15min":0.497},"max":{"1min":0.95899999999999996,"5min":1.474,"15min":1.474},"last":0.84899999999999998}]},{"osd":7,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.66300000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0289999999999999,"5min":1.369,"15min":1.369},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.88400000000000001,"15min":0.96099999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0469999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.70399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.71199999999999997,"15min":0.74299999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89900000000000002,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97299999999999998,"5min":2.641,"15min":2.641},"last":0.72399999999999998}]},{"osd":1,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.42999999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.871},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.48199999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.996,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68000000000000005,"15min":0.66800000000000004},"min":{"1min":0.48399999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89700000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.621},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76400000000000001,"15min":0.77600000000000002},"min":{"1min":0.52600000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99299999999999999,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.91600000000000004}]},{"osd":3,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.47199999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":1.024,"15min":1.024},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.79700000000000004,"15min":0.81499999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.95499999999999996,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.65100000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.46800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.96099999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.84099999999999997}]},{"osd":6,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.47499999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.58599999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.88700000000000001}]},{"osd":7,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.55800000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0149999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.82899999999999996,"15min":0.82299999999999995},"min":{"1min":0.65500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0269999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.93100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.64200000000000002,"15min":0.66700000000000004},"min":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70499999999999996,"5min":2.032,"15min":2.032},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.69199999999999995,"15min":0.73699999999999999},"min":{"1min":0.46400000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81399999999999995,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.61399999999999999}]},{"osd":1,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.73499999999999999,"15min":0.78100000000000003},"min":{"1min":0.53700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80200000000000005,"5min":2.089,"15min":2.089},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.53700000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.75900000000000001,"5min":1.964,"15min":1.964},"last":0.90500000000000003}]},{"osd":2,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.75700000000000001,"15min":0.82099999999999995},"min":{"1min":0.51000000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93100000000000005,"5min":2.577,"15min":2.577},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78800000000000003,"15min":0.84099999999999997},"min":{"1min":0.622,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.82799999999999996,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.92600000000000005}]},{"osd":3,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.77700000000000002,"15min":0.81699999999999995},"min":{"1min":0.55600000000000005,"5min":0.436,"15min":0.436},"max":{"1min":0.86299999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.77300000000000002,"15min":0.79800000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86099999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.871}]},{"osd":4,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68500000000000005,"15min":0.71699999999999997},"min":{"1min":0.52800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.871,"5min":1.458,"15min":1.458},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77000000000000002,"15min":0.80400000000000005},"min":{"1min":0.61599999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89700000000000002,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.754,"15min":0.73299999999999998},"min":{"1min":0.58799999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92800000000000005,"5min":1.595,"15min":1.595},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79000000000000004,"15min":0.79700000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91400000000000003,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.012}]},{"osd":7,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.86299999999999999,"15min":0.94399999999999995},"min":{"1min":0.56699999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95699999999999996,"5min":4.0700000000000003,"15min":4.0700000000000003},"last":0.995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.83299999999999996,"15min":0.874},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94399999999999995,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.96299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:26:54.899 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T04:26:54.900 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:26:55.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.158+0000 7fd0b2800700 1 Processor -- start 2024-05-10T04:26:55.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.158+0000 7fd0b2800700 1 -- start start 2024-05-10T04:26:55.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.160+0000 7fd0b2800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd0ac0cb0e0 0x7fd0ac0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:55.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.160+0000 7fd0b2800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0ac0b6270 0x7fd0ac06ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:55.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.160+0000 7fd0b2800700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd0ac06b170 0x7fd0ac0cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:55.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.160+0000 7fd0b2800700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ac0b13c0 con 0x7fd0ac0cb0e0 2024-05-10T04:26:55.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.160+0000 7fd0b2800700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ac0ceab0 con 0x7fd0ac06b170 2024-05-10T04:26:55.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.160+0000 7fd0b2800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac0b20e0 con 0x7fd0ac0b6270 2024-05-10T04:26:55.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.160+0000 7fd0ab400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd0ac0cb0e0 0x7fd0ac0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.160+0000 7fd0ab400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd0ac0cb0e0 0x7fd0ac0b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44668/0 (socket says 172.21.15.80:44668) 2024-05-10T04:26:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.160+0000 7fd0ab400700 1 -- 172.21.15.80:0/591390693 learned_addr learned my addr 172.21.15.80:0/591390693 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.160+0000 7fd0aaa00700 1 --2- 172.21.15.80:0/591390693 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0ac0b6270 0x7fd0ac06ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.160+0000 7fd0abe00700 1 --2- 172.21.15.80:0/591390693 >> v2:172.21.15.106:3300/0 conn(0x7fd0ac06b170 0x7fd0ac0cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.160+0000 7fd0ab400700 1 -- 172.21.15.80:0/591390693 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0ac0b6270 msgr2=0x7fd0ac06ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.160+0000 7fd0ab400700 1 --2- 172.21.15.80:0/591390693 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0ac0b6270 0x7fd0ac06ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.160+0000 7fd0ab400700 1 -- 172.21.15.80:0/591390693 >> v2:172.21.15.106:3300/0 conn(0x7fd0ac06b170 msgr2=0x7fd0ac0cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.160+0000 7fd0ab400700 1 --2- 172.21.15.80:0/591390693 >> v2:172.21.15.106:3300/0 conn(0x7fd0ac06b170 0x7fd0ac0cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.161+0000 7fd0ab400700 1 -- 172.21.15.80:0/591390693 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac06b580 con 0x7fd0ac0cb0e0 2024-05-10T04:26:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.161+0000 7fd0ab400700 1 --2- 172.21.15.80:0/591390693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0ac0cb0e0 0x7fd0ac0b5cb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0b6a90 tx=0x7fd09c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8852c2f4c1b1cf8d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:55.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.161+0000 7fd0aa000700 1 -- 172.21.15.80:0/591390693 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c00b870 con 0x7fd0ac0cb0e0 2024-05-10T04:26:55.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.161+0000 7fd0aa000700 1 -- 172.21.15.80:0/591390693 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c00b9d0 con 0x7fd0ac0cb0e0 2024-05-10T04:26:55.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.161+0000 7fd0aa000700 1 -- 172.21.15.80:0/591390693 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c00bd60 con 0x7fd0ac0cb0e0 2024-05-10T04:26:55.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.162+0000 7fd0b2800700 1 -- 172.21.15.80:0/591390693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0ac0cb0e0 msgr2=0x7fd0ac0b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:55.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.162+0000 7fd0b2800700 1 --2- 172.21.15.80:0/591390693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0ac0cb0e0 0x7fd0ac0b5cb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0b6a90 tx=0x7fd09c009bd0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.162+0000 7fd0b2800700 1 -- 172.21.15.80:0/591390693 shutdown_connections 2024-05-10T04:26:55.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.162+0000 7fd0b2800700 1 --2- 172.21.15.80:0/591390693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0ac0cb0e0 0x7fd0ac0b5cb0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.162+0000 7fd0b2800700 1 --2- 172.21.15.80:0/591390693 >> v2:172.21.15.106:3300/0 conn(0x7fd0ac06b170 0x7fd0ac0cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.162+0000 7fd0b2800700 1 --2- 172.21.15.80:0/591390693 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0ac0b6270 0x7fd0ac06ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.162+0000 7fd0b2800700 1 -- 172.21.15.80:0/591390693 >> 172.21.15.80:0/591390693 conn(0x7fd0ac0d0a90 msgr2=0x7fd0ac0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:55.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.162+0000 7fd0b2800700 1 -- 172.21.15.80:0/591390693 shutdown_connections 2024-05-10T04:26:55.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.162+0000 7fd0b2800700 1 -- 172.21.15.80:0/591390693 wait complete. 2024-05-10T04:26:55.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.164+0000 7fd0b2800700 1 Processor -- start 2024-05-10T04:26:55.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.164+0000 7fd0b2800700 1 -- start start 2024-05-10T04:26:55.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.166+0000 7fd0b2800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0ac06b170 0x7fd0ac0c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:55.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.166+0000 7fd0b2800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0ac0b6270 0x7fd0ac14b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:55.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.166+0000 7fd0b2800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0ac0cb0e0 0x7fd0ac14bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:55.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.166+0000 7fd0b2800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac15c420 con 0x7fd0ac0cb0e0 2024-05-10T04:26:55.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.166+0000 7fd0b2800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac14bd10 con 0x7fd0ac06b170 2024-05-10T04:26:55.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.166+0000 7fd0b2800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac14ca40 con 0x7fd0ac0b6270 2024-05-10T04:26:55.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.166+0000 7fd0abe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0ac0cb0e0 0x7fd0ac14bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:55.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.166+0000 7fd0aaa00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0ac0b6270 0x7fd0ac14b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:55.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.166+0000 7fd0abe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0ac0cb0e0 0x7fd0ac14bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44674/0 (socket says 172.21.15.80:44674) 2024-05-10T04:26:55.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.166+0000 7fd0abe00700 1 -- 172.21.15.80:0/750292941 learned_addr learned my addr 172.21.15.80:0/750292941 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:55.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.166+0000 7fd0ab400700 1 --2- 172.21.15.80:0/750292941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0ac06b170 0x7fd0ac0c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:55.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.167+0000 7fd0abe00700 1 -- 172.21.15.80:0/750292941 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0ac0b6270 msgr2=0x7fd0ac14b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:55.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.167+0000 7fd0abe00700 1 --2- 172.21.15.80:0/750292941 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0ac0b6270 0x7fd0ac14b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.167+0000 7fd0abe00700 1 -- 172.21.15.80:0/750292941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0ac06b170 msgr2=0x7fd0ac0c48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:55.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.167+0000 7fd0abe00700 1 --2- 172.21.15.80:0/750292941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0ac06b170 0x7fd0ac0c48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.167+0000 7fd0abe00700 1 -- 172.21.15.80:0/750292941 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c009550 con 0x7fd0ac0cb0e0 2024-05-10T04:26:55.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.167+0000 7fd0abe00700 1 --2- 172.21.15.80:0/750292941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0ac0cb0e0 0x7fd0ac14bf90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4007cf0 tx=0x7fd0a400e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:55.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.167+0000 7fd0a3400700 1 -- 172.21.15.80:0/750292941 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a400eb70 con 0x7fd0ac0cb0e0 2024-05-10T04:26:55.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.167+0000 7fd0a3400700 1 -- 172.21.15.80:0/750292941 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a400ecd0 con 0x7fd0ac0cb0e0 2024-05-10T04:26:55.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.167+0000 7fd0b2800700 1 -- 172.21.15.80:0/750292941 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ac0b07e0 con 0x7fd0ac0cb0e0 2024-05-10T04:26:55.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.167+0000 7fd0a3400700 1 -- 172.21.15.80:0/750292941 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4014420 con 0x7fd0ac0cb0e0 2024-05-10T04:26:55.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.167+0000 7fd0b2800700 1 -- 172.21.15.80:0/750292941 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ac0ad800 con 0x7fd0ac0cb0e0 2024-05-10T04:26:55.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.168+0000 7fd0b2800700 1 -- 172.21.15.80:0/750292941 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ac0cd310 con 0x7fd0ac0cb0e0 2024-05-10T04:26:55.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.169+0000 7fd0a3400700 1 -- 172.21.15.80:0/750292941 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd0a4014580 con 0x7fd0ac0cb0e0 2024-05-10T04:26:55.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.170+0000 7fd0a3400700 1 --2- 172.21.15.80:0/750292941 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd08c06ac90 0x7fd08c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:55.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.170+0000 7fd0a3400700 1 -- 172.21.15.80:0/750292941 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd0a4089620 con 0x7fd0ac0cb0e0 2024-05-10T04:26:55.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.171+0000 7fd0ab400700 1 --2- 172.21.15.80:0/750292941 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd08c06ac90 0x7fd08c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:55.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.172+0000 7fd0ab400700 1 --2- 172.21.15.80:0/750292941 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd08c06ac90 0x7fd08c06d1a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0b6a90 tx=0x7fd09c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:55.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.175+0000 7fd0a3400700 1 -- 172.21.15.80:0/750292941 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd0a40549d0 con 0x7fd0ac0cb0e0 2024-05-10T04:26:55.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.375+0000 7fd0b2800700 1 -- 172.21.15.80:0/750292941 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd0ac0b17b0 con 0x7fd08c06ac90 2024-05-10T04:26:55.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.378+0000 7fd0a3400700 1 -- 172.21.15.80:0/750292941 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50640 (secure 0 0 0) 0x7fd09c00bb40 con 0x7fd08c06ac90 2024-05-10T04:26:55.379 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:26:55.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.380+0000 7fd0b2800700 1 -- 172.21.15.80:0/750292941 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd08c06ac90 msgr2=0x7fd08c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:55.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.380+0000 7fd0b2800700 1 --2- 172.21.15.80:0/750292941 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd08c06ac90 0x7fd08c06d1a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0b6a90 tx=0x7fd09c008030 comp rx=0 tx=0).stop 2024-05-10T04:26:55.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.380+0000 7fd0b2800700 1 -- 172.21.15.80:0/750292941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0ac0cb0e0 msgr2=0x7fd0ac14bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:55.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.380+0000 7fd0b2800700 1 --2- 172.21.15.80:0/750292941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0ac0cb0e0 0x7fd0ac14bf90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4007cf0 tx=0x7fd0a400e0e0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.380+0000 7fd0b2800700 1 -- 172.21.15.80:0/750292941 shutdown_connections 2024-05-10T04:26:55.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.380+0000 7fd0b2800700 1 --2- 172.21.15.80:0/750292941 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd08c06ac90 0x7fd08c06d1a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.380+0000 7fd0b2800700 1 --2- 172.21.15.80:0/750292941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0ac0cb0e0 0x7fd0ac14bf90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.380+0000 7fd0b2800700 1 --2- 172.21.15.80:0/750292941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0ac06b170 0x7fd0ac0c48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.380+0000 7fd0b2800700 1 --2- 172.21.15.80:0/750292941 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0ac0b6270 0x7fd0ac14b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.380+0000 7fd0b2800700 1 -- 172.21.15.80:0/750292941 >> 172.21.15.80:0/750292941 conn(0x7fd0ac0d0a90 msgr2=0x7fd0ac15e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:55.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.380+0000 7fd0b2800700 1 -- 172.21.15.80:0/750292941 shutdown_connections 2024-05-10T04:26:55.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.380+0000 7fd0b2800700 1 -- 172.21.15.80:0/750292941 wait complete. 2024-05-10T04:26:55.387 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-10T04:26:55.409 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2024-05-10T04:26:54.807370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224740,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":220147,"kb_avail":754749980,"statfs":{"total":773094113280,"available":772863979520,"internally_reserved":0,"allocated":4562944,"data_stored":2514764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":225431096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-615807,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-5,"num_write":-125,"num_write_kb":-656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.256396"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T04:26:49.984374+0000","last_change":"2024-05-10T04:22:27.829537+0000","last_active":"2024-05-10T04:26:49.984374+0000","last_peered":"2024-05-10T04:26:49.984374+0000","last_clean":"2024-05-10T04:26:49.984374+0000","last_became_active":"2024-05-10T04:22:27.828179+0000","last_became_peered":"2024-05-10T04:22:27.828179+0000","last_unstale":"2024-05-10T04:26:49.984374+0000","last_undegraded":"2024-05-10T04:26:49.984374+0000","last_fullsized":"2024-05-10T04:26:49.984374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_clean_scrub_stamp":"2024-05-10T04:22:26.813824+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:23.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":754339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82599999999999996,"5min":1.216,"15min":1.216},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81799999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.504}]},{"osd":1,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73299999999999998,"15min":0.74399999999999999},"min":{"1min":0.58699999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92700000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.625,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.79900000000000004,"5min":1.181,"15min":1.181},"last":0.63600000000000001}]},{"osd":2,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.68300000000000005,"15min":0.68600000000000005},"min":{"1min":0.53900000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.3320000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73999999999999999,"15min":0.76000000000000001},"min":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86899999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69999999999999996,"15min":0.70999999999999996},"min":{"1min":0.504,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85999999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.79200000000000004},"min":{"1min":0.54100000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92700000000000005,"5min":1.155,"15min":1.155},"last":0.83999999999999997}]},{"osd":4,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68300000000000005,"15min":0.68000000000000005},"min":{"1min":0.52100000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95599999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71699999999999997,"15min":0.71399999999999997},"min":{"1min":0.50900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85999999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.79800000000000004}]},{"osd":5,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76400000000000001,"15min":0.77800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.99299999999999999,"5min":1.056,"15min":1.056},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.503,"5min":0.438,"15min":0.438},"max":{"1min":0.94899999999999995,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.82499999999999996}]},{"osd":6,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.85999999999999999,"15min":0.86599999999999999},"min":{"1min":0.71599999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0189999999999999,"5min":1.252,"15min":1.252},"last":0.871},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.84899999999999998,"15min":0.877},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0349999999999999,"5min":2.206,"15min":2.206},"last":0.92500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71099999999999997,"15min":0.71499999999999997},"min":{"1min":0.50600000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95699999999999996,"5min":1,"15min":1},"last":0.96299999999999997}]},{"osd":1,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.91900000000000004,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95699999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.98799999999999999}]},{"osd":2,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.68600000000000005},"min":{"1min":0.51700000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89500000000000002,"5min":1.048,"15min":1.048},"last":1.169},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.53900000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88300000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.089}]},{"osd":3,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70599999999999996,"15min":0.69299999999999995},"min":{"1min":0.58099999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85599999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.497,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89800000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.91200000000000003}]},{"osd":4,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.51500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.95399999999999996,"5min":1.079,"15min":1.079},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45600000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.90200000000000002,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":1.1160000000000001}]},{"osd":5,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.747,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95399999999999996,"5min":1.036,"15min":1.036},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.63900000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.999,"5min":1.01,"15min":1.01},"last":1.0649999999999999}]},{"osd":7,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":0.99199999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.036},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82999999999999996,"15min":0.83799999999999997},"min":{"1min":0.63700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97999999999999998,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.1359999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":163971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.496,"15min":0.57099999999999995},"min":{"1min":0.311,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.52100000000000002,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.55000000000000004,"15min":0.61199999999999999},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.65700000000000003,"5min":3.347,"15min":3.347},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.502,"15min":0.53200000000000003},"min":{"1min":0.39800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.56399999999999995,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.48099999999999998,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.51500000000000001,"5min":1.294,"15min":1.294},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56899999999999995,"15min":0.61799999999999999},"min":{"1min":0.42899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.57599999999999996,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.52800000000000002,"15min":0.59799999999999998},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.60199999999999998,"5min":3.629,"15min":3.629},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.94999999999999996,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.77600000000000002,"15min":0.78300000000000003},"min":{"1min":0.58799999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.90100000000000002,"5min":1.464,"15min":1.464},"last":0.94399999999999995}]},{"osd":5,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.77200000000000002,"15min":0.80400000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90600000000000003,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76400000000000001,"15min":0.76500000000000001},"min":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.91900000000000004,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.90100000000000002}]},{"osd":6,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.80500000000000005,"15min":0.81599999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91800000000000004,"5min":2.391,"15min":2.391},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78200000000000003,"15min":0.81699999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.89400000000000002,"5min":1.625,"15min":1.625},"last":0.82299999999999995}]},{"osd":7,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78900000000000003,"15min":0.83699999999999997},"min":{"1min":0.57299999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89500000000000002,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81000000000000005,"15min":0.84299999999999997},"min":{"1min":0.58499999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.99199999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.92900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":1007616,"data_stored":754339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.48899999999999999,"15min":0.52100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57199999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.441},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.52000000000000002,"15min":0.55200000000000005},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.51100000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.47099999999999997}]},{"osd":2,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.47099999999999997,"15min":0.51900000000000002},"min":{"1min":0.33200000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.47199999999999998,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54700000000000004,"15min":0.59499999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.57699999999999996,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57199999999999995,"15min":0.626},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.61099999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.52700000000000002,"15min":0.56200000000000006},"min":{"1min":0.38,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.56399999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85599999999999998,"5min":1.034,"15min":1.034},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.78400000000000003,"15min":0.79400000000000004},"min":{"1min":0.59299999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.93899999999999995,"5min":1.492,"15min":1.492},"last":0.85199999999999998}]},{"osd":5,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70499999999999996,"15min":0.69599999999999995},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.79600000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.56999999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91000000000000003,"5min":1.071,"15min":1.071},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.51700000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94999999999999996,"5min":1.091,"15min":1.091},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.58199999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0049999999999999,"5min":1.052,"15min":1.052},"last":0.69799999999999995}]},{"osd":7,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.81499999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.96299999999999997,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.92200000000000004,"5min":1.105,"15min":1.105},"last":0.77800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.52500000000000002,"15min":0.63300000000000001},"min":{"1min":0.28699999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.621,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.432,"5min":0.52500000000000002,"15min":0.63},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52300000000000002,"5min":5.883,"15min":5.883},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.56399999999999995,"15min":0.65400000000000003},"min":{"1min":0.33600000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64800000000000002,"5min":4.1440000000000001,"15min":4.1440000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.58699999999999997,"15min":0.69299999999999995},"min":{"1min":0.39300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73699999999999999,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.69799999999999995}]},{"osd":3,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51800000000000002,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.60199999999999998,"5min":3.452,"15min":3.452},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58499999999999996,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.64600000000000002,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.79500000000000004,"15min":0.82699999999999996},"min":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.95899999999999996,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.86699999999999999},"min":{"1min":0.60699999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94199999999999995,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.80000000000000004}]},{"osd":5,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77600000000000002,"15min":0.82799999999999996},"min":{"1min":0.55500000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94299999999999995,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.58999999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92400000000000004,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.81599999999999995}]},{"osd":6,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78200000000000003,"15min":0.84799999999999998},"min":{"1min":0.56200000000000006,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98899999999999999,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.79900000000000004,"15min":0.84599999999999997},"min":{"1min":0.59499999999999997,"5min":0.501,"15min":0.501},"max":{"1min":0.99299999999999999,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80400000000000005,"15min":0.83699999999999997},"min":{"1min":0.63800000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.97699999999999998,"5min":1.986,"15min":1.986},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.84699999999999998,"15min":0.91500000000000004},"min":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.996,"5min":3.419,"15min":3.419},"last":0.66500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":163971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.42799999999999999,"15min":0.433},"min":{"1min":0.308,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.53000000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.47099999999999997,"15min":0.47999999999999998},"min":{"1min":0.33100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.59199999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.439}]},{"osd":1,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.51500000000000001,"15min":0.57699999999999996},"min":{"1min":0.318,"5min":0.312,"15min":0.312},"max":{"1min":0.61599999999999999,"5min":3.6829999999999998,"15min":3.6829999999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.50700000000000001,"15min":0.51800000000000002},"min":{"1min":0.374,"5min":0.316,"15min":0.316},"max":{"1min":0.61199999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.64200000000000002,"15min":0.73599999999999999},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69799999999999995,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.64500000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.628,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.52300000000000002}]},{"osd":4,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.73299999999999998},"min":{"1min":0.58599999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97299999999999998,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82899999999999996,"15min":0.88500000000000001},"min":{"1min":0.60699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0029999999999999,"5min":4.0010000000000003,"15min":4.0010000000000003},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.82699999999999996,"15min":0.88900000000000001},"min":{"1min":0.61299999999999999,"5min":0.501,"15min":0.501},"max":{"1min":0.94699999999999995,"5min":4.024,"15min":4.024},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.501,"5min":0.495,"15min":0.495},"max":{"1min":1.014,"5min":1.456,"15min":1.456},"last":0.745}]},{"osd":6,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76800000000000002,"15min":0.76600000000000001},"min":{"1min":0.58099999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.97699999999999998,"5min":1.502,"15min":1.502},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77300000000000002,"15min":0.77600000000000002},"min":{"1min":0.624,"5min":0.497,"15min":0.497},"max":{"1min":0.95899999999999996,"5min":1.474,"15min":1.474},"last":0.84899999999999998}]},{"osd":7,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.66300000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0289999999999999,"5min":1.369,"15min":1.369},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.88400000000000001,"15min":0.96099999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0469999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.70399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.71199999999999997,"15min":0.74299999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89900000000000002,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97299999999999998,"5min":2.641,"15min":2.641},"last":0.72399999999999998}]},{"osd":1,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.42999999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.871},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.48199999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.996,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68000000000000005,"15min":0.66800000000000004},"min":{"1min":0.48399999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89700000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.621},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76400000000000001,"15min":0.77600000000000002},"min":{"1min":0.52600000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99299999999999999,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.91600000000000004}]},{"osd":3,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.47199999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":1.024,"15min":1.024},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.79700000000000004,"15min":0.81499999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.95499999999999996,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.65100000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.46800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.96099999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.84099999999999997}]},{"osd":6,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.47499999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.58599999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.88700000000000001}]},{"osd":7,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.55800000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0149999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.82899999999999996,"15min":0.82299999999999995},"min":{"1min":0.65500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0269999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.93100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.64200000000000002,"15min":0.66700000000000004},"min":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70499999999999996,"5min":2.032,"15min":2.032},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.69199999999999995,"15min":0.73699999999999999},"min":{"1min":0.46400000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81399999999999995,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.61399999999999999}]},{"osd":1,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.73499999999999999,"15min":0.78100000000000003},"min":{"1min":0.53700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80200000000000005,"5min":2.089,"15min":2.089},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.53700000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.75900000000000001,"5min":1.964,"15min":1.964},"last":0.90500000000000003}]},{"osd":2,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.75700000000000001,"15min":0.82099999999999995},"min":{"1min":0.51000000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93100000000000005,"5min":2.577,"15min":2.577},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78800000000000003,"15min":0.84099999999999997},"min":{"1min":0.622,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.82799999999999996,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.92600000000000005}]},{"osd":3,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.77700000000000002,"15min":0.81699999999999995},"min":{"1min":0.55600000000000005,"5min":0.436,"15min":0.436},"max":{"1min":0.86299999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.77300000000000002,"15min":0.79800000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86099999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.871}]},{"osd":4,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68500000000000005,"15min":0.71699999999999997},"min":{"1min":0.52800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.871,"5min":1.458,"15min":1.458},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77000000000000002,"15min":0.80400000000000005},"min":{"1min":0.61599999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89700000000000002,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.754,"15min":0.73299999999999998},"min":{"1min":0.58799999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92800000000000005,"5min":1.595,"15min":1.595},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79000000000000004,"15min":0.79700000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91400000000000003,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.012}]},{"osd":7,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.86299999999999999,"15min":0.94399999999999995},"min":{"1min":0.56699999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95699999999999996,"5min":4.0700000000000003,"15min":4.0700000000000003},"last":0.995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.83299999999999996,"15min":0.874},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94399999999999995,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.96299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:26:55.411 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:26:55.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.671+0000 7f75c2a00700 1 Processor -- start 2024-05-10T04:26:55.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.671+0000 7f75c2a00700 1 -- start start 2024-05-10T04:26:55.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.673+0000 7f75c2a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75bc161fa0 0x7f75bc0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:55.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.673+0000 7f75c2a00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f75bc0d0b70 0x7f75bc0b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:55.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.673+0000 7f75c2a00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75bc0d28c0 con 0x7f75bc0b2f50 2024-05-10T04:26:55.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.673+0000 7f75c2a00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75bc0b3360 con 0x7f75bc0d0b70 2024-05-10T04:26:55.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.673+0000 7f75c2a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0d2ba0 con 0x7f75bc161fa0 2024-05-10T04:26:55.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.673+0000 7f75bbe00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f75bc0b2f50 0x7f75bc0d3030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45270/0 (socket says 172.21.15.80:45270) 2024-05-10T04:26:55.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.673+0000 7f75bbe00700 1 -- 172.21.15.80:0/1056929399 learned_addr learned my addr 172.21.15.80:0/1056929399 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:55.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75c0a00700 1 --2- 172.21.15.80:0/1056929399 >> v2:172.21.15.106:3300/0 conn(0x7f75bc0d0b70 0x7f75bc0b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:55.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75bb400700 1 --2- 172.21.15.80:0/1056929399 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75bc161fa0 0x7f75bc0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:55.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75baa00700 1 -- 172.21.15.80:0/1056929399 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662637821 0 0) 0x7f75bc0d28c0 con 0x7f75bc0b2f50 2024-05-10T04:26:55.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75baa00700 1 -- 172.21.15.80:0/1056929399 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75a00035b0 con 0x7f75bc0b2f50 2024-05-10T04:26:55.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75baa00700 1 -- 172.21.15.80:0/1056929399 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3603350425 0 0) 0x7f75a00035b0 con 0x7f75bc0b2f50 2024-05-10T04:26:55.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75baa00700 1 -- 172.21.15.80:0/1056929399 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75bc161fa0 msgr2=0x7f75bc0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:55.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75baa00700 1 --2- 172.21.15.80:0/1056929399 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75bc161fa0 0x7f75bc0d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75baa00700 1 -- 172.21.15.80:0/1056929399 >> v2:172.21.15.106:3300/0 conn(0x7f75bc0d0b70 msgr2=0x7f75bc0b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:55.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75baa00700 1 --2- 172.21.15.80:0/1056929399 >> v2:172.21.15.106:3300/0 conn(0x7f75bc0d0b70 0x7f75bc0b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75baa00700 1 -- 172.21.15.80:0/1056929399 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc0cf970 con 0x7f75bc0b2f50 2024-05-10T04:26:55.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75baa00700 1 -- 172.21.15.80:0/1056929399 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7f75ac001670 con 0x7f75bc0b2f50 2024-05-10T04:26:55.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75baa00700 1 -- 172.21.15.80:0/1056929399 >> v1:172.21.15.80:6789/0 conn(0x7f75bc0b2f50 legacy=0x7f75bc0d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:55.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75baa00700 1 --2- 172.21.15.80:0/1056929399 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75bc161fa0 0x7f75a0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:55.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75baa00700 1 --2- 172.21.15.80:0/1056929399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75a0003f80 0x7f75a0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:55.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75baa00700 1 --2- 172.21.15.80:0/1056929399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75a0004d90 0x7f75a00051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:55.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75baa00700 1 -- 172.21.15.80:0/1056929399 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0b3360 con 0x7f75a0003f80 2024-05-10T04:26:55.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75baa00700 1 -- 172.21.15.80:0/1056929399 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0d2ba0 con 0x7f75a0004d90 2024-05-10T04:26:55.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75baa00700 1 -- 172.21.15.80:0/1056929399 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a000ba60 con 0x7f75bc161fa0 2024-05-10T04:26:55.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75bb400700 1 --2- 172.21.15.80:0/1056929399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75a0003f80 0x7f75a0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:55.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.674+0000 7f75bbe00700 1 --2- 172.21.15.80:0/1056929399 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75bc161fa0 0x7f75a0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:55.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.675+0000 7f75c0a00700 1 --2- 172.21.15.80:0/1056929399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75a0004d90 0x7f75a00051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:55.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.675+0000 7f75bb400700 1 -- 172.21.15.80:0/1056929399 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75bc161fa0 msgr2=0x7f75a0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:55.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.675+0000 7f75bb400700 1 --2- 172.21.15.80:0/1056929399 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75bc161fa0 0x7f75a0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.675+0000 7f75bb400700 1 -- 172.21.15.80:0/1056929399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75a0004d90 msgr2=0x7f75a00051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:55.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.675+0000 7f75bb400700 1 --2- 172.21.15.80:0/1056929399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75a0004d90 0x7f75a00051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.675+0000 7f75bb400700 1 -- 172.21.15.80:0/1056929399 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a00035b0 con 0x7f75a0003f80 2024-05-10T04:26:55.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.675+0000 7f75bb400700 1 --2- 172.21.15.80:0/1056929399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75a0003f80 0x7f75a0004850 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009b30 tx=0x7f75a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a0111fdd08bd8c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:55.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.675+0000 7f75baa00700 1 -- 172.21.15.80:0/1056929399 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a800e6c0 con 0x7f75a0003f80 2024-05-10T04:26:55.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.675+0000 7f75baa00700 1 -- 172.21.15.80:0/1056929399 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a800e820 con 0x7f75a0003f80 2024-05-10T04:26:55.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.675+0000 7f75baa00700 1 -- 172.21.15.80:0/1056929399 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a800eb90 con 0x7f75a0003f80 2024-05-10T04:26:55.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.676+0000 7f75c2a00700 1 -- 172.21.15.80:0/1056929399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75a0003f80 msgr2=0x7f75a0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:55.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.676+0000 7f75c2a00700 1 --2- 172.21.15.80:0/1056929399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75a0003f80 0x7f75a0004850 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009b30 tx=0x7f75a0005880 comp rx=0 tx=0).stop 2024-05-10T04:26:55.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.676+0000 7f75c0a00700 1 -- 172.21.15.80:0/1056929399 reap_dead start 2024-05-10T04:26:55.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.676+0000 7f75c2a00700 1 -- 172.21.15.80:0/1056929399 shutdown_connections 2024-05-10T04:26:55.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.676+0000 7f75c2a00700 1 -- 172.21.15.80:0/1056929399 >> 172.21.15.80:0/1056929399 conn(0x7f75bc06c3f0 msgr2=0x7f75bc06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:55.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.676+0000 7f75c2a00700 1 -- 172.21.15.80:0/1056929399 shutdown_connections 2024-05-10T04:26:55.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.676+0000 7f75c2a00700 1 -- 172.21.15.80:0/1056929399 wait complete. 2024-05-10T04:26:55.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.678+0000 7f75c2a00700 1 Processor -- start 2024-05-10T04:26:55.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.679+0000 7f75c2a00700 1 -- start start 2024-05-10T04:26:55.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.680+0000 7f75c2a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75a0003f80 0x7f75bc0cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:55.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.680+0000 7f75c2a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75bc0ccf60 0x7f75bc160c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:55.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.680+0000 7f75c2a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75bc0cd370 0x7f75bc161150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:55.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.680+0000 7f75c2a00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc148cc0 con 0x7f75bc0ccf60 2024-05-10T04:26:55.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.680+0000 7f75c2a00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0cd8f0 con 0x7f75bc0cd370 2024-05-10T04:26:55.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.680+0000 7f75c2a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc1474f0 con 0x7f75a0003f80 2024-05-10T04:26:55.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.680+0000 7f75bb400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75bc0ccf60 0x7f75bc160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:55.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.680+0000 7f75bb400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75bc0ccf60 0x7f75bc160c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44690/0 (socket says 172.21.15.80:44690) 2024-05-10T04:26:55.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.680+0000 7f75bb400700 1 -- 172.21.15.80:0/1540308330 learned_addr learned my addr 172.21.15.80:0/1540308330 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:55.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.681+0000 7f75bbe00700 1 --2- 172.21.15.80:0/1540308330 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75a0003f80 0x7f75bc0cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:55.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.681+0000 7f75c0a00700 1 --2- 172.21.15.80:0/1540308330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75bc0cd370 0x7f75bc161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:55.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.681+0000 7f75bb400700 1 -- 172.21.15.80:0/1540308330 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75a0003f80 msgr2=0x7f75bc0cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:55.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.681+0000 7f75bb400700 1 --2- 172.21.15.80:0/1540308330 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75a0003f80 0x7f75bc0cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.681+0000 7f75bb400700 1 -- 172.21.15.80:0/1540308330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75bc0cd370 msgr2=0x7f75bc161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:55.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.681+0000 7f75bb400700 1 --2- 172.21.15.80:0/1540308330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75bc0cd370 0x7f75bc161150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.681+0000 7f75bb400700 1 -- 172.21.15.80:0/1540308330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc0b87f0 con 0x7f75bc0ccf60 2024-05-10T04:26:55.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.681+0000 7f75c0a00700 1 --2- 172.21.15.80:0/1540308330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75bc0cd370 0x7f75bc161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:26:55.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.681+0000 7f75bb400700 1 --2- 172.21.15.80:0/1540308330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75bc0ccf60 0x7f75bc160c10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f75a800e4b0 tx=0x7f75a80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:55.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.681+0000 7f75b3e00700 1 -- 172.21.15.80:0/1540308330 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a800e6c0 con 0x7f75bc0ccf60 2024-05-10T04:26:55.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.681+0000 7f75b3e00700 1 -- 172.21.15.80:0/1540308330 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a8003ab0 con 0x7f75bc0ccf60 2024-05-10T04:26:55.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.681+0000 7f75c2a00700 1 -- 172.21.15.80:0/1540308330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75bc0cdb40 con 0x7f75bc0ccf60 2024-05-10T04:26:55.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.681+0000 7f75b3e00700 1 -- 172.21.15.80:0/1540308330 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8003e60 con 0x7f75bc0ccf60 2024-05-10T04:26:55.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.682+0000 7f75c2a00700 1 -- 172.21.15.80:0/1540308330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc0ce100 con 0x7f75bc0ccf60 2024-05-10T04:26:55.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.682+0000 7f75c2a00700 1 -- 172.21.15.80:0/1540308330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75bc0b2dc0 con 0x7f75bc0ccf60 2024-05-10T04:26:55.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.683+0000 7f75b3e00700 1 -- 172.21.15.80:0/1540308330 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f75a8013470 con 0x7f75bc0ccf60 2024-05-10T04:26:55.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.684+0000 7f75b3e00700 1 --2- 172.21.15.80:0/1540308330 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f759c06acc0 0x7f759c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:55.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.684+0000 7f75b3e00700 1 -- 172.21.15.80:0/1540308330 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f75a808a9e0 con 0x7f75bc0ccf60 2024-05-10T04:26:55.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.685+0000 7f75bbe00700 1 --2- 172.21.15.80:0/1540308330 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f759c06acc0 0x7f759c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:55.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.685+0000 7f75bbe00700 1 --2- 172.21.15.80:0/1540308330 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f759c06acc0 0x7f759c06d1d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f75ac000c00 tx=0x7f75ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:55.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.689+0000 7f75b3e00700 1 -- 172.21.15.80:0/1540308330 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f75a8055fd0 con 0x7f75bc0ccf60 2024-05-10T04:26:55.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.895+0000 7f75c2a00700 1 -- 172.21.15.80:0/1540308330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75bc148cc0 con 0x7f75bc0ccf60 2024-05-10T04:26:55.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.896+0000 7f75b3e00700 1 -- 172.21.15.80:0/1540308330 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+12516 (secure 0 0 0) 0x7f75a8009730 con 0x7f75bc0ccf60 2024-05-10T04:26:55.897 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:26:55.897 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":37,"fsid":"7fdf09a1-1b63-4484-b77e-59e97b1b5367","created":"2024-05-10T04:22:11.357888+0000","modified":"2024-05-10T04:26:50.569827+0000","last_up_change":"2024-05-10T04:22:25.223554+0000","last_in_change":"2024-05-10T04:22:15.517592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:22:26.793377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ea50853-2dac-4082-82e4-e7a7f31edcbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":41469},{"type":"v1","addr":"172.21.15.80:6801","nonce":41469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":41469},{"type":"v1","addr":"172.21.15.80:6803","nonce":41469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":41469},{"type":"v1","addr":"172.21.15.80:6807","nonce":41469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":41469},{"type":"v1","addr":"172.21.15.80:6805","nonce":41469}]},"public_addr":"172.21.15.80:6801/41469","cluster_addr":"172.21.15.80:6803/41469","heartbeat_back_addr":"172.21.15.80:6807/41469","heartbeat_front_addr":"172.21.15.80:6805/41469","state":["exists","up"]},{"osd":1,"uuid":"bae4dbab-b1ed-442e-bac8-0316117f1026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":41472},{"type":"v1","addr":"172.21.15.80:6818","nonce":41472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":41472},{"type":"v1","addr":"172.21.15.80:6822","nonce":41472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":41472},{"type":"v1","addr":"172.21.15.80:6830","nonce":41472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":41472},{"type":"v1","addr":"172.21.15.80:6826","nonce":41472}]},"public_addr":"172.21.15.80:6818/41472","cluster_addr":"172.21.15.80:6822/41472","heartbeat_back_addr":"172.21.15.80:6830/41472","heartbeat_front_addr":"172.21.15.80:6826/41472","state":["exists","up"]},{"osd":2,"uuid":"c09be638-0a47-46f6-960d-cf120a06e596","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":41471},{"type":"v1","addr":"172.21.15.80:6819","nonce":41471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6821","nonce":41471},{"type":"v1","addr":"172.21.15.80:6823","nonce":41471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6829","nonce":41471},{"type":"v1","addr":"172.21.15.80:6831","nonce":41471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6825","nonce":41471},{"type":"v1","addr":"172.21.15.80:6827","nonce":41471}]},"public_addr":"172.21.15.80:6819/41471","cluster_addr":"172.21.15.80:6823/41471","heartbeat_back_addr":"172.21.15.80:6831/41471","heartbeat_front_addr":"172.21.15.80:6827/41471","state":["exists","up"]},{"osd":3,"uuid":"4ea63c20-7567-46f3-aa79-fee68b744c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":41473},{"type":"v1","addr":"172.21.15.80:6809","nonce":41473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":41473},{"type":"v1","addr":"172.21.15.80:6811","nonce":41473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":41473},{"type":"v1","addr":"172.21.15.80:6815","nonce":41473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":41473},{"type":"v1","addr":"172.21.15.80:6813","nonce":41473}]},"public_addr":"172.21.15.80:6809/41473","cluster_addr":"172.21.15.80:6811/41473","heartbeat_back_addr":"172.21.15.80:6815/41473","heartbeat_front_addr":"172.21.15.80:6813/41473","state":["exists","up"]},{"osd":4,"uuid":"246468bd-b6e2-4307-8f5b-63bbd29df2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":41891},{"type":"v1","addr":"172.21.15.106:6801","nonce":41891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":41891},{"type":"v1","addr":"172.21.15.106:6803","nonce":41891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":41891},{"type":"v1","addr":"172.21.15.106:6807","nonce":41891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":41891},{"type":"v1","addr":"172.21.15.106:6805","nonce":41891}]},"public_addr":"172.21.15.106:6801/41891","cluster_addr":"172.21.15.106:6803/41891","heartbeat_back_addr":"172.21.15.106:6807/41891","heartbeat_front_addr":"172.21.15.106:6805/41891","state":["exists","up"]},{"osd":5,"uuid":"9a570758-5f58-4e32-814d-a26b4844dd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":41894},{"type":"v1","addr":"172.21.15.106:6825","nonce":41894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":41894},{"type":"v1","addr":"172.21.15.106:6827","nonce":41894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":41894},{"type":"v1","addr":"172.21.15.106:6831","nonce":41894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":41894},{"type":"v1","addr":"172.21.15.106:6829","nonce":41894}]},"public_addr":"172.21.15.106:6825/41894","cluster_addr":"172.21.15.106:6827/41894","heartbeat_back_addr":"172.21.15.106:6831/41894","heartbeat_front_addr":"172.21.15.106:6829/41894","state":["exists","up"]},{"osd":6,"uuid":"2f9c4ff3-7b1c-4806-9c8e-825acb76f2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":41893},{"type":"v1","addr":"172.21.15.106:6817","nonce":41893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":41893},{"type":"v1","addr":"172.21.15.106:6819","nonce":41893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":41893},{"type":"v1","addr":"172.21.15.106:6823","nonce":41893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":41893},{"type":"v1","addr":"172.21.15.106:6821","nonce":41893}]},"public_addr":"172.21.15.106:6817/41893","cluster_addr":"172.21.15.106:6819/41893","heartbeat_back_addr":"172.21.15.106:6823/41893","heartbeat_front_addr":"172.21.15.106:6821/41893","state":["exists","up"]},{"osd":7,"uuid":"0969d5f4-0b52-4fd8-a250-ec326b5e01f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":41892},{"type":"v1","addr":"172.21.15.106:6809","nonce":41892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":41892},{"type":"v1","addr":"172.21.15.106:6811","nonce":41892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":41892},{"type":"v1","addr":"172.21.15.106:6815","nonce":41892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":41892},{"type":"v1","addr":"172.21.15.106:6813","nonce":41892}]},"public_addr":"172.21.15.106:6809/41892","cluster_addr":"172.21.15.106:6811/41892","heartbeat_back_addr":"172.21.15.106:6815/41892","heartbeat_front_addr":"172.21.15.106:6813/41892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.992499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.042586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.054619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.177729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.917709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:21.047771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:22:20.971776+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6835/707679728":"2024-05-11T04:26:47.546008+0000","172.21.15.80:6833/707679728":"2024-05-11T04:26:47.546008+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:26:55.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.898+0000 7f75c2a00700 1 -- 172.21.15.80:0/1540308330 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f759c06acc0 msgr2=0x7f759c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:55.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.898+0000 7f75c2a00700 1 --2- 172.21.15.80:0/1540308330 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f759c06acc0 0x7f759c06d1d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f75ac000c00 tx=0x7f75ac009040 comp rx=0 tx=0).stop 2024-05-10T04:26:55.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.898+0000 7f75c2a00700 1 -- 172.21.15.80:0/1540308330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75bc0ccf60 msgr2=0x7f75bc160c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:55.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.898+0000 7f75c2a00700 1 --2- 172.21.15.80:0/1540308330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75bc0ccf60 0x7f75bc160c10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f75a800e4b0 tx=0x7f75a80047c0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.898+0000 7f75c2a00700 1 -- 172.21.15.80:0/1540308330 shutdown_connections 2024-05-10T04:26:55.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.898+0000 7f75c2a00700 1 --2- 172.21.15.80:0/1540308330 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f759c06acc0 0x7f759c06d1d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.898+0000 7f75c2a00700 1 --2- 172.21.15.80:0/1540308330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75bc0cd370 0x7f75bc161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.898+0000 7f75c2a00700 1 --2- 172.21.15.80:0/1540308330 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75a0003f80 0x7f75bc0cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.898+0000 7f75c2a00700 1 --2- 172.21.15.80:0/1540308330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75bc0ccf60 0x7f75bc160c10 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:55.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.898+0000 7f75c2a00700 1 -- 172.21.15.80:0/1540308330 >> 172.21.15.80:0/1540308330 conn(0x7f75bc06c3f0 msgr2=0x7f75bc06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:55.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.898+0000 7f75c2a00700 1 -- 172.21.15.80:0/1540308330 shutdown_connections 2024-05-10T04:26:55.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:55.898+0000 7f75c2a00700 1 -- 172.21.15.80:0/1540308330 wait complete. 2024-05-10T04:26:56.926 INFO:tasks.ceph:Scrubbing osd.0 2024-05-10T04:26:56.927 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-10T04:26:57.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.198+0000 7eff55400700 1 Processor -- start 2024-05-10T04:26:57.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.199+0000 7eff55400700 1 -- start start 2024-05-10T04:26:57.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.200+0000 7eff55400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff500b6240 0x7eff500d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:57.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.200+0000 7eff55400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff500d3690 con 0x7eff5015d870 2024-05-10T04:26:57.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.200+0000 7eff55400700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff500d2df0 con 0x7eff500d0600 2024-05-10T04:26:57.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.200+0000 7eff55400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff500b71e0 con 0x7eff500b6240 2024-05-10T04:26:57.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.201+0000 7eff4fe00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff500b6240 0x7eff500d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:57.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.201+0000 7eff4fe00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff500b6240 0x7eff500d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44698/0 (socket says 172.21.15.80:44698) 2024-05-10T04:26:57.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.201+0000 7eff54a00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7eff5015d870 0x7eff5015dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45284/0 (socket says 172.21.15.80:45284) 2024-05-10T04:26:57.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.201+0000 7eff4fe00700 1 -- 172.21.15.80:0/505608970 learned_addr learned my addr 172.21.15.80:0/505608970 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.201+0000 7eff4fe00700 1 -- 172.21.15.80:0/505608970 >> v1:172.21.15.106:6789/0 conn(0x7eff500d0600 legacy=0x7eff500d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.201+0000 7eff4fe00700 1 -- 172.21.15.80:0/505608970 >> v1:172.21.15.80:6789/0 conn(0x7eff5015d870 legacy=0x7eff5015dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.201+0000 7eff4fe00700 1 -- 172.21.15.80:0/505608970 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff500d30d0 con 0x7eff500b6240 2024-05-10T04:26:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.201+0000 7eff4f400700 1 -- 172.21.15.80:0/505608970 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625873887 0 0) 0x7eff500d3690 con 0x7eff5015d870 2024-05-10T04:26:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.201+0000 7eff4fe00700 1 --2- 172.21.15.80:0/505608970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff500b6240 0x7eff500d25c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7eff400098f0 tx=0x7eff40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7315c480e7da8e95 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.202+0000 7eff4f400700 1 -- 172.21.15.80:0/505608970 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4000b8a0 con 0x7eff500b6240 2024-05-10T04:26:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.202+0000 7eff4f400700 1 -- 172.21.15.80:0/505608970 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4000ba00 con 0x7eff500b6240 2024-05-10T04:26:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.202+0000 7eff4f400700 1 -- 172.21.15.80:0/505608970 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4000bd90 con 0x7eff500b6240 2024-05-10T04:26:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.202+0000 7eff55400700 1 -- 172.21.15.80:0/505608970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff500b6240 msgr2=0x7eff500d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.202+0000 7eff55400700 1 --2- 172.21.15.80:0/505608970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff500b6240 0x7eff500d25c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7eff400098f0 tx=0x7eff40009c00 comp rx=0 tx=0).stop 2024-05-10T04:26:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.202+0000 7eff55400700 1 -- 172.21.15.80:0/505608970 shutdown_connections 2024-05-10T04:26:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.202+0000 7eff55400700 1 --2- 172.21.15.80:0/505608970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff500b6240 0x7eff500d25c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:57.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.202+0000 7eff55400700 1 -- 172.21.15.80:0/505608970 >> 172.21.15.80:0/505608970 conn(0x7eff50067700 msgr2=0x7eff5006c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:57.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.202+0000 7eff55400700 1 -- 172.21.15.80:0/505608970 shutdown_connections 2024-05-10T04:26:57.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.203+0000 7eff55400700 1 -- 172.21.15.80:0/505608970 wait complete. 2024-05-10T04:26:57.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.205+0000 7eff55400700 1 Processor -- start 2024-05-10T04:26:57.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.205+0000 7eff55400700 1 -- start start 2024-05-10T04:26:57.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.206+0000 7eff55400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff500b6240 0x7eff501e6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:57.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.206+0000 7eff55400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff500d0600 0x7eff5014fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:57.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.206+0000 7eff55400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff5015d870 0x7eff5015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:57.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.206+0000 7eff55400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff501f5500 con 0x7eff500d0600 2024-05-10T04:26:57.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.206+0000 7eff55400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff500c93c0 con 0x7eff500b6240 2024-05-10T04:26:57.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.206+0000 7eff55400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff501e6e80 con 0x7eff5015d870 2024-05-10T04:26:57.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.207+0000 7eff47e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff500d0600 0x7eff5014fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:57.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.207+0000 7eff47e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff500d0600 0x7eff5014fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44702/0 (socket says 172.21.15.80:44702) 2024-05-10T04:26:57.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.207+0000 7eff47e00700 1 -- 172.21.15.80:0/3038115828 learned_addr learned my addr 172.21.15.80:0/3038115828 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:57.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.207+0000 7eff4fe00700 1 --2- 172.21.15.80:0/3038115828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff500b6240 0x7eff501e6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:57.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.207+0000 7eff54a00700 1 --2- 172.21.15.80:0/3038115828 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff5015d870 0x7eff5015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:57.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.207+0000 7eff47e00700 1 -- 172.21.15.80:0/3038115828 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff5015d870 msgr2=0x7eff5015fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:57.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.207+0000 7eff47e00700 1 --2- 172.21.15.80:0/3038115828 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff5015d870 0x7eff5015fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:57.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.207+0000 7eff47e00700 1 -- 172.21.15.80:0/3038115828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff500b6240 msgr2=0x7eff501e6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:57.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.207+0000 7eff47e00700 1 --2- 172.21.15.80:0/3038115828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff500b6240 0x7eff501e6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:57.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.207+0000 7eff47e00700 1 -- 172.21.15.80:0/3038115828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff40009550 con 0x7eff500d0600 2024-05-10T04:26:57.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.207+0000 7eff47e00700 1 --2- 172.21.15.80:0/3038115828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff500d0600 0x7eff5014fec0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7eff3800c450 tx=0x7eff3800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:57.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.208+0000 7eff4cc00700 1 -- 172.21.15.80:0/3038115828 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff380052d0 con 0x7eff500d0600 2024-05-10T04:26:57.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.208+0000 7eff4cc00700 1 -- 172.21.15.80:0/3038115828 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff38005430 con 0x7eff500d0600 2024-05-10T04:26:57.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.208+0000 7eff55400700 1 -- 172.21.15.80:0/3038115828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff500c9610 con 0x7eff500d0600 2024-05-10T04:26:57.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.208+0000 7eff4cc00700 1 -- 172.21.15.80:0/3038115828 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff380038c0 con 0x7eff500d0600 2024-05-10T04:26:57.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.208+0000 7eff55400700 1 -- 172.21.15.80:0/3038115828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff500c9bd0 con 0x7eff500d0600 2024-05-10T04:26:57.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.208+0000 7eff55400700 1 -- 172.21.15.80:0/3038115828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7eff500d2b00 con 0x7eff500d0600 2024-05-10T04:26:57.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.210+0000 7eff4cc00700 1 -- 172.21.15.80:0/3038115828 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7eff38003a20 con 0x7eff500d0600 2024-05-10T04:26:57.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.211+0000 7eff4cc00700 1 --2- 172.21.15.80:0/3038115828 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7eff2c06ac90 0x7eff2c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:57.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.211+0000 7eff4cc00700 1 -- 172.21.15.80:0/3038115828 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7eff38088c60 con 0x7eff500d0600 2024-05-10T04:26:57.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.211+0000 7eff4cc00700 1 --2- 172.21.15.80:0/3038115828 >> [v2:172.21.15.80:6800/41469,v1:172.21.15.80:6801/41469] conn(0x7eff2c070b40 0x7eff2c072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:57.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.211+0000 7eff4cc00700 1 -- 172.21.15.80:0/3038115828 --> [v2:172.21.15.80:6800/41469,v1:172.21.15.80:6801/41469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7eff2c073680 con 0x7eff2c070b40 2024-05-10T04:26:57.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.211+0000 7eff4cc00700 1 -- 172.21.15.80:0/3038115828 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff38088fd0 con 0x7eff500d0600 2024-05-10T04:26:57.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.211+0000 7eff4fe00700 1 --2- 172.21.15.80:0/3038115828 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7eff2c06ac90 0x7eff2c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:57.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.211+0000 7eff54a00700 1 --2- 172.21.15.80:0/3038115828 >> [v2:172.21.15.80:6800/41469,v1:172.21.15.80:6801/41469] conn(0x7eff2c070b40 0x7eff2c072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:57.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.212+0000 7eff54a00700 1 --2- 172.21.15.80:0/3038115828 >> [v2:172.21.15.80:6800/41469,v1:172.21.15.80:6801/41469] conn(0x7eff2c070b40 0x7eff2c072fb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:57.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.212+0000 7eff4fe00700 1 --2- 172.21.15.80:0/3038115828 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7eff2c06ac90 0x7eff2c06d1a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7eff40014040 tx=0x7eff40008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:57.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.212+0000 7eff4cc00700 1 -- 172.21.15.80:0/3038115828 <== osd.0 v2:172.21.15.80:6800/41469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7eff2c073680 con 0x7eff2c070b40 2024-05-10T04:26:57.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.227+0000 7eff55400700 1 -- 172.21.15.80:0/3038115828 --> [v2:172.21.15.80:6800/41469,v1:172.21.15.80:6801/41469] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7eff500b73f0 con 0x7eff2c070b40 2024-05-10T04:26:57.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.228+0000 7eff4cc00700 1 -- 172.21.15.80:0/3038115828 <== osd.0 v2:172.21.15.80:6800/41469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7eff480070b0 con 0x7eff2c070b40 2024-05-10T04:26:57.230 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-10T04:26:57.231 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T04:26:57.231 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-10T04:26:57.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.228+0000 7eff55400700 1 -- 172.21.15.80:0/3038115828 >> [v2:172.21.15.80:6800/41469,v1:172.21.15.80:6801/41469] conn(0x7eff2c070b40 msgr2=0x7eff2c072fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:57.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.228+0000 7eff55400700 1 --2- 172.21.15.80:0/3038115828 >> [v2:172.21.15.80:6800/41469,v1:172.21.15.80:6801/41469] conn(0x7eff2c070b40 0x7eff2c072fb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:57.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.228+0000 7eff55400700 1 -- 172.21.15.80:0/3038115828 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7eff2c06ac90 msgr2=0x7eff2c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:57.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.228+0000 7eff55400700 1 --2- 172.21.15.80:0/3038115828 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7eff2c06ac90 0x7eff2c06d1a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7eff40014040 tx=0x7eff40008030 comp rx=0 tx=0).stop 2024-05-10T04:26:57.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.228+0000 7eff55400700 1 -- 172.21.15.80:0/3038115828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff500d0600 msgr2=0x7eff5014fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:57.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.228+0000 7eff55400700 1 --2- 172.21.15.80:0/3038115828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff500d0600 0x7eff5014fec0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7eff3800c450 tx=0x7eff3800c760 comp rx=0 tx=0).stop 2024-05-10T04:26:57.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.228+0000 7eff54a00700 1 -- 172.21.15.80:0/3038115828 reap_dead start 2024-05-10T04:26:57.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.228+0000 7eff55400700 1 -- 172.21.15.80:0/3038115828 shutdown_connections 2024-05-10T04:26:57.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.228+0000 7eff55400700 1 -- 172.21.15.80:0/3038115828 >> 172.21.15.80:0/3038115828 conn(0x7eff50067700 msgr2=0x7eff5006c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:57.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.228+0000 7eff55400700 1 -- 172.21.15.80:0/3038115828 shutdown_connections 2024-05-10T04:26:57.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.228+0000 7eff55400700 1 -- 172.21.15.80:0/3038115828 wait complete. 2024-05-10T04:26:57.254 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-10T04:26:57.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.517+0000 7f759be00700 1 Processor -- start 2024-05-10T04:26:57.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.517+0000 7f759be00700 1 -- start start 2024-05-10T04:26:57.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.519+0000 7f759be00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f75940d04e0 0x7f75940cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:57.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.519+0000 7f759be00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75940ce9a0 con 0x7f75940b31c0 2024-05-10T04:26:57.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.519+0000 7f759be00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75940b02e0 con 0x7f759406b640 2024-05-10T04:26:57.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.519+0000 7f759be00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7594070950 con 0x7f75940d04e0 2024-05-10T04:26:57.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.519+0000 7f7599400700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f75940b31c0 0x7f75940cfdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45286/0 (socket says 172.21.15.80:45286) 2024-05-10T04:26:57.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.519+0000 7f7599400700 1 -- 172.21.15.80:0/3406444922 learned_addr learned my addr 172.21.15.80:0/3406444922 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:57.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.519+0000 7f7598a00700 1 --2- 172.21.15.80:0/3406444922 >> v2:172.21.15.106:3300/0 conn(0x7f75940d04e0 0x7f75940cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:57.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.519+0000 7f7593e00700 1 -- 172.21.15.80:0/3406444922 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103585860 0 0) 0x7f75940ce9a0 con 0x7f75940b31c0 2024-05-10T04:26:57.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.519+0000 7f7593e00700 1 -- 172.21.15.80:0/3406444922 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f757c0035b0 con 0x7f75940b31c0 2024-05-10T04:26:57.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.519+0000 7f7593e00700 1 -- 172.21.15.80:0/3406444922 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3313497456 0 0) 0x7f75940b02e0 con 0x7f759406b640 2024-05-10T04:26:57.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.519+0000 7f7593e00700 1 -- 172.21.15.80:0/3406444922 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75940ce9a0 con 0x7f759406b640 2024-05-10T04:26:57.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.520+0000 7f7598a00700 1 -- 172.21.15.80:0/3406444922 >> v1:172.21.15.106:6789/0 conn(0x7f759406b640 legacy=0x7f759406e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:57.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.520+0000 7f7598a00700 1 -- 172.21.15.80:0/3406444922 >> v1:172.21.15.80:6789/0 conn(0x7f75940b31c0 legacy=0x7f75940cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:57.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.520+0000 7f7598a00700 1 -- 172.21.15.80:0/3406444922 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7594070390 con 0x7f75940d04e0 2024-05-10T04:26:57.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.520+0000 7f7598a00700 1 --2- 172.21.15.80:0/3406444922 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75940d04e0 0x7f75940cc9c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7580009840 tx=0x7f7580009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d85a2ff4b09faa3c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:57.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.520+0000 7f7593e00700 1 -- 172.21.15.80:0/3406444922 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7580011830 con 0x7f75940d04e0 2024-05-10T04:26:57.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.520+0000 7f7593e00700 1 -- 172.21.15.80:0/3406444922 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7580011990 con 0x7f75940d04e0 2024-05-10T04:26:57.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.520+0000 7f7593e00700 1 -- 172.21.15.80:0/3406444922 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7580011d20 con 0x7f75940d04e0 2024-05-10T04:26:57.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.521+0000 7f759be00700 1 -- 172.21.15.80:0/3406444922 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75940d04e0 msgr2=0x7f75940cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:57.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.521+0000 7f759be00700 1 --2- 172.21.15.80:0/3406444922 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75940d04e0 0x7f75940cc9c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7580009840 tx=0x7f7580009b50 comp rx=0 tx=0).stop 2024-05-10T04:26:57.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.521+0000 7f759be00700 1 -- 172.21.15.80:0/3406444922 shutdown_connections 2024-05-10T04:26:57.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.521+0000 7f759be00700 1 --2- 172.21.15.80:0/3406444922 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75940d04e0 0x7f75940cc9c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:57.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.521+0000 7f759be00700 1 -- 172.21.15.80:0/3406444922 >> 172.21.15.80:0/3406444922 conn(0x7f75940b26a0 msgr2=0x7f75940b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:57.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.521+0000 7f759be00700 1 -- 172.21.15.80:0/3406444922 shutdown_connections 2024-05-10T04:26:57.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.521+0000 7f759be00700 1 -- 172.21.15.80:0/3406444922 wait complete. 2024-05-10T04:26:57.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.523+0000 7f759be00700 1 Processor -- start 2024-05-10T04:26:57.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.524+0000 7f759be00700 1 -- start start 2024-05-10T04:26:57.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.525+0000 7f759be00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f759406b640 0x7f7594147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:57.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.525+0000 7f759be00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75940b31c0 0x7f7594157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:57.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.525+0000 7f759be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75940d04e0 0x7f759415c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:57.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.525+0000 7f759be00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759415b6e0 con 0x7f75940d04e0 2024-05-10T04:26:57.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.525+0000 7f759be00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759415a850 con 0x7f75940b31c0 2024-05-10T04:26:57.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.525+0000 7f759be00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7594145de0 con 0x7f759406b640 2024-05-10T04:26:57.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.525+0000 7f7599e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75940d04e0 0x7f759415c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:57.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.525+0000 7f7599e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75940d04e0 0x7f759415c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44718/0 (socket says 172.21.15.80:44718) 2024-05-10T04:26:57.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.525+0000 7f7599e00700 1 -- 172.21.15.80:0/2919682945 learned_addr learned my addr 172.21.15.80:0/2919682945 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:57.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.525+0000 7f7598a00700 1 --2- 172.21.15.80:0/2919682945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75940b31c0 0x7f7594157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:57.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.525+0000 7f7599400700 1 --2- 172.21.15.80:0/2919682945 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f759406b640 0x7f7594147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:57.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.526+0000 7f7599e00700 1 -- 172.21.15.80:0/2919682945 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f759406b640 msgr2=0x7f7594147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:57.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.526+0000 7f7599e00700 1 --2- 172.21.15.80:0/2919682945 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f759406b640 0x7f7594147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:57.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.526+0000 7f7599e00700 1 -- 172.21.15.80:0/2919682945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75940b31c0 msgr2=0x7f7594157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:57.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.526+0000 7f7599e00700 1 --2- 172.21.15.80:0/2919682945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75940b31c0 0x7f7594157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:57.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.526+0000 7f7599e00700 1 -- 172.21.15.80:0/2919682945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75800094a0 con 0x7f75940d04e0 2024-05-10T04:26:57.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.526+0000 7f7599400700 1 --2- 172.21.15.80:0/2919682945 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f759406b640 0x7f7594147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:26:57.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.526+0000 7f7599e00700 1 --2- 172.21.15.80:0/2919682945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75940d04e0 0x7f759415c510 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f758c00cb80 tx=0x7f758c00ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:57.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.526+0000 7f7591600700 1 -- 172.21.15.80:0/2919682945 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c003c00 con 0x7f75940d04e0 2024-05-10T04:26:57.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.526+0000 7f7591600700 1 -- 172.21.15.80:0/2919682945 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c003d60 con 0x7f75940d04e0 2024-05-10T04:26:57.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.526+0000 7f759be00700 1 -- 172.21.15.80:0/2919682945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7594147ed0 con 0x7f75940d04e0 2024-05-10T04:26:57.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.526+0000 7f7591600700 1 -- 172.21.15.80:0/2919682945 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c00ab00 con 0x7f75940d04e0 2024-05-10T04:26:57.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.527+0000 7f759be00700 1 -- 172.21.15.80:0/2919682945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759415ad40 con 0x7f75940d04e0 2024-05-10T04:26:57.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.528+0000 7f759be00700 1 -- 172.21.15.80:0/2919682945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759415b820 con 0x7f75940d04e0 2024-05-10T04:26:57.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.528+0000 7f7591600700 1 -- 172.21.15.80:0/2919682945 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f758c00ac60 con 0x7f75940d04e0 2024-05-10T04:26:57.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.529+0000 7f7591600700 1 --2- 172.21.15.80:0/2919682945 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f757406acc0 0x7f757406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:57.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.529+0000 7f7591600700 1 -- 172.21.15.80:0/2919682945 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f758c089060 con 0x7f75940d04e0 2024-05-10T04:26:57.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.530+0000 7f7599400700 1 --2- 172.21.15.80:0/2919682945 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f757406acc0 0x7f757406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:57.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.530+0000 7f7599400700 1 --2- 172.21.15.80:0/2919682945 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f757406acc0 0x7f757406d1d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f75880011e0 tx=0x7f7588009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:57.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.534+0000 7f7591600700 1 -- 172.21.15.80:0/2919682945 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f758c0bc900 con 0x7f75940d04e0 2024-05-10T04:26:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.741+0000 7f759be00700 1 -- 172.21.15.80:0/2919682945 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f759406ba50 con 0x7f757406acc0 2024-05-10T04:26:57.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.742+0000 7f7591600700 1 -- 172.21.15.80:0/2919682945 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7588001c70 con 0x7f757406acc0 2024-05-10T04:26:57.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.745+0000 7f759be00700 1 -- 172.21.15.80:0/2919682945 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f757406acc0 msgr2=0x7f757406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:57.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.745+0000 7f759be00700 1 --2- 172.21.15.80:0/2919682945 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f757406acc0 0x7f757406d1d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f75880011e0 tx=0x7f7588009040 comp rx=0 tx=0).stop 2024-05-10T04:26:57.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.745+0000 7f759be00700 1 -- 172.21.15.80:0/2919682945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75940d04e0 msgr2=0x7f759415c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:57.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.745+0000 7f759be00700 1 --2- 172.21.15.80:0/2919682945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75940d04e0 0x7f759415c510 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f758c00cb80 tx=0x7f758c00ce90 comp rx=0 tx=0).stop 2024-05-10T04:26:57.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.745+0000 7f759be00700 1 -- 172.21.15.80:0/2919682945 shutdown_connections 2024-05-10T04:26:57.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.745+0000 7f759be00700 1 --2- 172.21.15.80:0/2919682945 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f757406acc0 0x7f757406d1d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:57.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.745+0000 7f759be00700 1 --2- 172.21.15.80:0/2919682945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75940d04e0 0x7f759415c510 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:57.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.745+0000 7f759be00700 1 --2- 172.21.15.80:0/2919682945 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f759406b640 0x7f7594147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:57.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.745+0000 7f759be00700 1 --2- 172.21.15.80:0/2919682945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75940b31c0 0x7f7594157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:57.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.745+0000 7f759be00700 1 -- 172.21.15.80:0/2919682945 >> 172.21.15.80:0/2919682945 conn(0x7f75940b26a0 msgr2=0x7f759406e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:57.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.745+0000 7f759be00700 1 -- 172.21.15.80:0/2919682945 shutdown_connections 2024-05-10T04:26:57.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:57.745+0000 7f759be00700 1 -- 172.21.15.80:0/2919682945 wait complete. 2024-05-10T04:26:57.747 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 0 to deep-scrub 2024-05-10T04:26:57.771 INFO:tasks.ceph:Scrubbing osd.1 2024-05-10T04:26:57.771 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-10T04:26:58.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.033+0000 7f62da400700 1 Processor -- start 2024-05-10T04:26:58.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.033+0000 7f62da400700 1 -- start start 2024-05-10T04:26:58.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.034+0000 7f62da400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f62d40b33e0 0x7f62d40d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.034+0000 7f62da400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f62d40b5970 0x7f62d40b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.034+0000 7f62da400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62d4162090 0x7f62d41624a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.034+0000 7f62da400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d40b37f0 con 0x7f62d40b5970 2024-05-10T04:26:58.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.034+0000 7f62da400700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d40b62c0 con 0x7f62d40b33e0 2024-05-10T04:26:58.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.034+0000 7f62da400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d4162d80 con 0x7f62d4162090 2024-05-10T04:26:58.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.035+0000 7f62d2a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f62d40b5970 0x7f62d40b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.035+0000 7f62d2a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f62d40b5970 0x7f62d40b5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44734/0 (socket says 172.21.15.80:44734) 2024-05-10T04:26:58.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.035+0000 7f62d2a00700 1 -- 172.21.15.80:0/496770132 learned_addr learned my addr 172.21.15.80:0/496770132 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:58.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.035+0000 7f62d3400700 1 --2- 172.21.15.80:0/496770132 >> v2:172.21.15.106:3300/0 conn(0x7f62d40b33e0 0x7f62d40d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.035+0000 7f62d3e00700 1 --2- 172.21.15.80:0/496770132 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62d4162090 0x7f62d41624a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.035+0000 7f62d2a00700 1 -- 172.21.15.80:0/496770132 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62d4162090 msgr2=0x7f62d41624a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:58.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.035+0000 7f62d2a00700 1 --2- 172.21.15.80:0/496770132 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62d4162090 0x7f62d41624a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.035+0000 7f62d2a00700 1 -- 172.21.15.80:0/496770132 >> v2:172.21.15.106:3300/0 conn(0x7f62d40b33e0 msgr2=0x7f62d40d3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:58.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.035+0000 7f62d2a00700 1 --2- 172.21.15.80:0/496770132 >> v2:172.21.15.106:3300/0 conn(0x7f62d40b33e0 0x7f62d40d3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.035+0000 7f62d2a00700 1 -- 172.21.15.80:0/496770132 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d40d2970 con 0x7f62d40b5970 2024-05-10T04:26:58.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.035+0000 7f62d3e00700 1 --2- 172.21.15.80:0/496770132 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62d4162090 0x7f62d41624a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:26:58.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.036+0000 7f62d2a00700 1 --2- 172.21.15.80:0/496770132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62d40b5970 0x7f62d40b5d80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f62d406d630 tx=0x7f62c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34a0866b5b5e7df server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:58.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.036+0000 7f62d2000700 1 -- 172.21.15.80:0/496770132 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c0011830 con 0x7f62d40b5970 2024-05-10T04:26:58.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.036+0000 7f62d2000700 1 -- 172.21.15.80:0/496770132 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c0011990 con 0x7f62d40b5970 2024-05-10T04:26:58.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.036+0000 7f62d2000700 1 -- 172.21.15.80:0/496770132 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c0011d20 con 0x7f62d40b5970 2024-05-10T04:26:58.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.037+0000 7f62da400700 1 -- 172.21.15.80:0/496770132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62d40b5970 msgr2=0x7f62d40b5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.037+0000 7f62da400700 1 --2- 172.21.15.80:0/496770132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62d40b5970 0x7f62d40b5d80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f62d406d630 tx=0x7f62c0009bd0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.037+0000 7f62da400700 1 -- 172.21.15.80:0/496770132 shutdown_connections 2024-05-10T04:26:58.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.037+0000 7f62da400700 1 --2- 172.21.15.80:0/496770132 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62d4162090 0x7f62d41624a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.037+0000 7f62da400700 1 --2- 172.21.15.80:0/496770132 >> v2:172.21.15.106:3300/0 conn(0x7f62d40b33e0 0x7f62d40d3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.037+0000 7f62da400700 1 --2- 172.21.15.80:0/496770132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62d40b5970 0x7f62d40b5d80 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.037+0000 7f62da400700 1 -- 172.21.15.80:0/496770132 >> 172.21.15.80:0/496770132 conn(0x7f62d40d0b50 msgr2=0x7f62d40d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:58.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.037+0000 7f62da400700 1 -- 172.21.15.80:0/496770132 shutdown_connections 2024-05-10T04:26:58.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.037+0000 7f62da400700 1 -- 172.21.15.80:0/496770132 wait complete. 2024-05-10T04:26:58.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.039+0000 7f62da400700 1 Processor -- start 2024-05-10T04:26:58.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.039+0000 7f62da400700 1 -- start start 2024-05-10T04:26:58.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.041+0000 7f62da400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62d40b33e0 0x7f62d4156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.041+0000 7f62da400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62d40b5970 0x7f62d40cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.041+0000 7f62da400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62d4162090 0x7f62d4158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.041+0000 7f62da400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d415c4c0 con 0x7f62d40b33e0 2024-05-10T04:26:58.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.041+0000 7f62da400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d4159500 con 0x7f62d4162090 2024-05-10T04:26:58.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.041+0000 7f62da400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d41573f0 con 0x7f62d40b5970 2024-05-10T04:26:58.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.041+0000 7f62d3400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62d40b33e0 0x7f62d4156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.041+0000 7f62d3400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62d40b33e0 0x7f62d4156eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44746/0 (socket says 172.21.15.80:44746) 2024-05-10T04:26:58.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.041+0000 7f62d3400700 1 -- 172.21.15.80:0/4061157575 learned_addr learned my addr 172.21.15.80:0/4061157575 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:58.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.041+0000 7f62d2a00700 1 --2- 172.21.15.80:0/4061157575 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62d40b5970 0x7f62d40cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.041+0000 7f62d3e00700 1 --2- 172.21.15.80:0/4061157575 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62d4162090 0x7f62d4158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.041+0000 7f62d3400700 1 -- 172.21.15.80:0/4061157575 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62d40b5970 msgr2=0x7f62d40cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.041+0000 7f62d3400700 1 --2- 172.21.15.80:0/4061157575 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62d40b5970 0x7f62d40cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.041+0000 7f62d3400700 1 -- 172.21.15.80:0/4061157575 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62d4162090 msgr2=0x7f62d4158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.041+0000 7f62d3400700 1 --2- 172.21.15.80:0/4061157575 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62d4162090 0x7f62d4158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.041+0000 7f62d3400700 1 -- 172.21.15.80:0/4061157575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c0009550 con 0x7f62d40b33e0 2024-05-10T04:26:58.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.041+0000 7f62d3e00700 1 --2- 172.21.15.80:0/4061157575 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62d4162090 0x7f62d4158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:26:58.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.042+0000 7f62d3400700 1 --2- 172.21.15.80:0/4061157575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62d40b33e0 0x7f62d4156eb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f62c400e8a0 tx=0x7f62c400ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:58.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.042+0000 7f62cb400700 1 -- 172.21.15.80:0/4061157575 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c4013680 con 0x7f62d40b33e0 2024-05-10T04:26:58.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.042+0000 7f62cb400700 1 -- 172.21.15.80:0/4061157575 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c40137e0 con 0x7f62d40b33e0 2024-05-10T04:26:58.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.042+0000 7f62da400700 1 -- 172.21.15.80:0/4061157575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d40cdae0 con 0x7f62d40b33e0 2024-05-10T04:26:58.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.042+0000 7f62cb400700 1 -- 172.21.15.80:0/4061157575 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c4013b90 con 0x7f62d40b33e0 2024-05-10T04:26:58.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.042+0000 7f62da400700 1 -- 172.21.15.80:0/4061157575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d4159a30 con 0x7f62d40b33e0 2024-05-10T04:26:58.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.043+0000 7f62da400700 1 -- 172.21.15.80:0/4061157575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62d40d2f30 con 0x7f62d40b33e0 2024-05-10T04:26:58.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.044+0000 7f62cb400700 1 -- 172.21.15.80:0/4061157575 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f62c4013cf0 con 0x7f62d40b33e0 2024-05-10T04:26:58.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.045+0000 7f62cb400700 1 --2- 172.21.15.80:0/4061157575 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f62b406acc0 0x7f62b406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.045+0000 7f62cb400700 1 -- 172.21.15.80:0/4061157575 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f62c4089730 con 0x7f62d40b33e0 2024-05-10T04:26:58.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.045+0000 7f62cb400700 1 --2- 172.21.15.80:0/4061157575 >> [v2:172.21.15.80:6816/41472,v1:172.21.15.80:6818/41472] conn(0x7f62b4070b70 0x7f62b4072fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.045+0000 7f62cb400700 1 -- 172.21.15.80:0/4061157575 --> [v2:172.21.15.80:6816/41472,v1:172.21.15.80:6818/41472] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62b40736b0 con 0x7f62b4070b70 2024-05-10T04:26:58.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.045+0000 7f62cb400700 1 -- 172.21.15.80:0/4061157575 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62c4089aa0 con 0x7f62d40b33e0 2024-05-10T04:26:58.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.045+0000 7f62d2a00700 1 --2- 172.21.15.80:0/4061157575 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f62b406acc0 0x7f62b406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.045+0000 7f62d3e00700 1 --2- 172.21.15.80:0/4061157575 >> [v2:172.21.15.80:6816/41472,v1:172.21.15.80:6818/41472] conn(0x7f62b4070b70 0x7f62b4072fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.046+0000 7f62d3e00700 1 --2- 172.21.15.80:0/4061157575 >> [v2:172.21.15.80:6816/41472,v1:172.21.15.80:6818/41472] conn(0x7f62b4070b70 0x7f62b4072fe0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:58.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.046+0000 7f62d2a00700 1 --2- 172.21.15.80:0/4061157575 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f62b406acc0 0x7f62b406d1d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f62c0014040 tx=0x7f62c0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:58.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.047+0000 7f62cb400700 1 -- 172.21.15.80:0/4061157575 <== osd.1 v2:172.21.15.80:6816/41472 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f62b40736b0 con 0x7f62b4070b70 2024-05-10T04:26:58.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.062+0000 7f62da400700 1 -- 172.21.15.80:0/4061157575 --> [v2:172.21.15.80:6816/41472,v1:172.21.15.80:6818/41472] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f62d4074af0 con 0x7f62b4070b70 2024-05-10T04:26:58.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.062+0000 7f62cb400700 1 -- 172.21.15.80:0/4061157575 <== osd.1 v2:172.21.15.80:6816/41472 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f62d4074af0 con 0x7f62b4070b70 2024-05-10T04:26:58.064 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-10T04:26:58.064 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T04:26:58.064 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-10T04:26:58.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.063+0000 7f62da400700 1 -- 172.21.15.80:0/4061157575 >> [v2:172.21.15.80:6816/41472,v1:172.21.15.80:6818/41472] conn(0x7f62b4070b70 msgr2=0x7f62b4072fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.063+0000 7f62da400700 1 --2- 172.21.15.80:0/4061157575 >> [v2:172.21.15.80:6816/41472,v1:172.21.15.80:6818/41472] conn(0x7f62b4070b70 0x7f62b4072fe0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.063+0000 7f62da400700 1 -- 172.21.15.80:0/4061157575 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f62b406acc0 msgr2=0x7f62b406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.063+0000 7f62da400700 1 --2- 172.21.15.80:0/4061157575 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f62b406acc0 0x7f62b406d1d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f62c0014040 tx=0x7f62c0008030 comp rx=0 tx=0).stop 2024-05-10T04:26:58.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.063+0000 7f62da400700 1 -- 172.21.15.80:0/4061157575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62d40b33e0 msgr2=0x7f62d4156eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.063+0000 7f62da400700 1 --2- 172.21.15.80:0/4061157575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62d40b33e0 0x7f62d4156eb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f62c400e8a0 tx=0x7f62c400ebb0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.063+0000 7f62d3e00700 1 -- 172.21.15.80:0/4061157575 reap_dead start 2024-05-10T04:26:58.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.063+0000 7f62da400700 1 -- 172.21.15.80:0/4061157575 shutdown_connections 2024-05-10T04:26:58.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.063+0000 7f62da400700 1 -- 172.21.15.80:0/4061157575 >> 172.21.15.80:0/4061157575 conn(0x7f62d40d0b50 msgr2=0x7f62d40b4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:58.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.063+0000 7f62da400700 1 -- 172.21.15.80:0/4061157575 shutdown_connections 2024-05-10T04:26:58.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.063+0000 7f62da400700 1 -- 172.21.15.80:0/4061157575 wait complete. 2024-05-10T04:26:58.090 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-10T04:26:58.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.348+0000 7f741ce00700 1 Processor -- start 2024-05-10T04:26:58.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.348+0000 7f741ce00700 1 -- start start 2024-05-10T04:26:58.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.350+0000 7f741ce00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f74180cc9c0 0x7f741806b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.350+0000 7f741ce00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74180ce9a0 con 0x7f74180b31c0 2024-05-10T04:26:58.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.350+0000 7f741ce00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74180b02e0 con 0x7f74180d04e0 2024-05-10T04:26:58.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.350+0000 7f741ce00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7418070950 con 0x7f74180cc9c0 2024-05-10T04:26:58.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.350+0000 7f7415e00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f74180b31c0 0x7f74180cfdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45290/0 (socket says 172.21.15.80:45290) 2024-05-10T04:26:58.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.350+0000 7f7415e00700 1 -- 172.21.15.80:0/2652356224 learned_addr learned my addr 172.21.15.80:0/2652356224 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:58.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.350+0000 7f7416800700 1 --2- 172.21.15.80:0/2652356224 >> v2:172.21.15.106:3300/0 conn(0x7f74180cc9c0 0x7f741806b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.350+0000 7f7414a00700 1 -- 172.21.15.80:0/2652356224 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248356730 0 0) 0x7f74180ce9a0 con 0x7f74180b31c0 2024-05-10T04:26:58.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.351+0000 7f7414a00700 1 -- 172.21.15.80:0/2652356224 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73fc0035b0 con 0x7f74180b31c0 2024-05-10T04:26:58.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.351+0000 7f7414a00700 1 -- 172.21.15.80:0/2652356224 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143872508 0 0) 0x7f74180b02e0 con 0x7f74180d04e0 2024-05-10T04:26:58.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.351+0000 7f7414a00700 1 -- 172.21.15.80:0/2652356224 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74180ce9a0 con 0x7f74180d04e0 2024-05-10T04:26:58.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.351+0000 7f7414a00700 1 -- 172.21.15.80:0/2652356224 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 816079844 0 0) 0x7f73fc0035b0 con 0x7f74180b31c0 2024-05-10T04:26:58.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.351+0000 7f7416800700 1 -- 172.21.15.80:0/2652356224 >> v1:172.21.15.106:6789/0 conn(0x7f74180d04e0 legacy=0x7f741806e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.351+0000 7f7416800700 1 -- 172.21.15.80:0/2652356224 >> v1:172.21.15.80:6789/0 conn(0x7f74180b31c0 legacy=0x7f74180cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.351+0000 7f7416800700 1 -- 172.21.15.80:0/2652356224 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741806bb80 con 0x7f74180cc9c0 2024-05-10T04:26:58.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.351+0000 7f7416800700 1 --2- 172.21.15.80:0/2652356224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74180cc9c0 0x7f741806b640 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7410009d90 tx=0x7f741000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9928834580e4eb3c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:58.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.352+0000 7f7414a00700 1 -- 172.21.15.80:0/2652356224 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741000e070 con 0x7f74180cc9c0 2024-05-10T04:26:58.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.352+0000 7f7414a00700 1 -- 172.21.15.80:0/2652356224 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7410003a20 con 0x7f74180cc9c0 2024-05-10T04:26:58.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.352+0000 7f7414a00700 1 -- 172.21.15.80:0/2652356224 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408001670 con 0x7f74180cc9c0 2024-05-10T04:26:58.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.352+0000 7f741ce00700 1 -- 172.21.15.80:0/2652356224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74180cc9c0 msgr2=0x7f741806b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.352+0000 7f741ce00700 1 --2- 172.21.15.80:0/2652356224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74180cc9c0 0x7f741806b640 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7410009d90 tx=0x7f741000b330 comp rx=0 tx=0).stop 2024-05-10T04:26:58.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.352+0000 7f741ce00700 1 -- 172.21.15.80:0/2652356224 shutdown_connections 2024-05-10T04:26:58.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.352+0000 7f741ce00700 1 --2- 172.21.15.80:0/2652356224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74180cc9c0 0x7f741806b640 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.352+0000 7f741ce00700 1 -- 172.21.15.80:0/2652356224 >> 172.21.15.80:0/2652356224 conn(0x7f74180b26a0 msgr2=0x7f74180b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:58.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.352+0000 7f741ce00700 1 -- 172.21.15.80:0/2652356224 shutdown_connections 2024-05-10T04:26:58.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.352+0000 7f741ce00700 1 -- 172.21.15.80:0/2652356224 wait complete. 2024-05-10T04:26:58.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.355+0000 7f741ce00700 1 Processor -- start 2024-05-10T04:26:58.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.355+0000 7f741ce00700 1 -- start start 2024-05-10T04:26:58.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.356+0000 7f741ce00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74180b31c0 0x7f74181e8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.356+0000 7f741ce00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74180cc9c0 0x7f741814baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.356+0000 7f741ce00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74180d04e0 0x7f741814c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.356+0000 7f741ce00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741814d070 con 0x7f74180d04e0 2024-05-10T04:26:58.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.356+0000 7f741ce00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74180b37c0 con 0x7f74180cc9c0 2024-05-10T04:26:58.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.356+0000 7f741ce00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74181e7fb0 con 0x7f74180b31c0 2024-05-10T04:26:58.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.357+0000 7f7416800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74180d04e0 0x7f741814c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.357+0000 7f7416800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74180d04e0 0x7f741814c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44754/0 (socket says 172.21.15.80:44754) 2024-05-10T04:26:58.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.357+0000 7f7416800700 1 -- 172.21.15.80:0/309791396 learned_addr learned my addr 172.21.15.80:0/309791396 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:58.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.357+0000 7f7415400700 1 --2- 172.21.15.80:0/309791396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74180cc9c0 0x7f741814baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.357+0000 7f7415e00700 1 --2- 172.21.15.80:0/309791396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74180b31c0 0x7f74181e8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.357+0000 7f7416800700 1 -- 172.21.15.80:0/309791396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74180b31c0 msgr2=0x7f74181e8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.357+0000 7f7416800700 1 --2- 172.21.15.80:0/309791396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74180b31c0 0x7f74181e8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.357+0000 7f7416800700 1 -- 172.21.15.80:0/309791396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74180cc9c0 msgr2=0x7f741814baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.357+0000 7f7416800700 1 --2- 172.21.15.80:0/309791396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74180cc9c0 0x7f741814baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.357+0000 7f7416800700 1 -- 172.21.15.80:0/309791396 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7410009a70 con 0x7f74180d04e0 2024-05-10T04:26:58.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.357+0000 7f7416800700 1 --2- 172.21.15.80:0/309791396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74180d04e0 0x7f741814c2e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f74180ce6b0 tx=0x7f7410004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:58.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.358+0000 7f740e000700 1 -- 172.21.15.80:0/309791396 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74100044c0 con 0x7f74180d04e0 2024-05-10T04:26:58.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.358+0000 7f740e000700 1 -- 172.21.15.80:0/309791396 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7410004660 con 0x7f74180d04e0 2024-05-10T04:26:58.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.358+0000 7f741ce00700 1 -- 172.21.15.80:0/309791396 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741814bfe0 con 0x7f74180d04e0 2024-05-10T04:26:58.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.358+0000 7f740e000700 1 -- 172.21.15.80:0/309791396 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7410012430 con 0x7f74180d04e0 2024-05-10T04:26:58.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.358+0000 7f741ce00700 1 -- 172.21.15.80:0/309791396 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74181e7960 con 0x7f74180d04e0 2024-05-10T04:26:58.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.359+0000 7f741ce00700 1 -- 172.21.15.80:0/309791396 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7418074af0 con 0x7f74180d04e0 2024-05-10T04:26:58.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.360+0000 7f740e000700 1 -- 172.21.15.80:0/309791396 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7410012590 con 0x7f74180d04e0 2024-05-10T04:26:58.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.361+0000 7f740e000700 1 --2- 172.21.15.80:0/309791396 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f73f806ac90 0x7f73f806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.361+0000 7f740e000700 1 -- 172.21.15.80:0/309791396 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f741008a1c0 con 0x7f74180d04e0 2024-05-10T04:26:58.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.361+0000 7f7415e00700 1 --2- 172.21.15.80:0/309791396 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f73f806ac90 0x7f73f806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.362+0000 7f7415e00700 1 --2- 172.21.15.80:0/309791396 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f73f806ac90 0x7f73f806d1a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7408000fd0 tx=0x7f7408000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:58.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.365+0000 7f740e000700 1 -- 172.21.15.80:0/309791396 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7410055600 con 0x7f74180d04e0 2024-05-10T04:26:58.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.570+0000 7f741ce00700 1 -- 172.21.15.80:0/309791396 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7418070670 con 0x7f73f806ac90 2024-05-10T04:26:58.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.571+0000 7f740e000700 1 -- 172.21.15.80:0/309791396 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7408004ae0 con 0x7f73f806ac90 2024-05-10T04:26:58.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.573+0000 7f741ce00700 1 -- 172.21.15.80:0/309791396 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f73f806ac90 msgr2=0x7f73f806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.573+0000 7f741ce00700 1 --2- 172.21.15.80:0/309791396 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f73f806ac90 0x7f73f806d1a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7408000fd0 tx=0x7f7408000ed0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.573+0000 7f741ce00700 1 -- 172.21.15.80:0/309791396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74180d04e0 msgr2=0x7f741814c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.573+0000 7f741ce00700 1 --2- 172.21.15.80:0/309791396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74180d04e0 0x7f741814c2e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f74180ce6b0 tx=0x7f7410004ad0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.573+0000 7f741ce00700 1 -- 172.21.15.80:0/309791396 shutdown_connections 2024-05-10T04:26:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.573+0000 7f741ce00700 1 --2- 172.21.15.80:0/309791396 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f73f806ac90 0x7f73f806d1a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.573+0000 7f741ce00700 1 --2- 172.21.15.80:0/309791396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74180d04e0 0x7f741814c2e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.573+0000 7f741ce00700 1 --2- 172.21.15.80:0/309791396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74180b31c0 0x7f74181e8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.573+0000 7f741ce00700 1 --2- 172.21.15.80:0/309791396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74180cc9c0 0x7f741814baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.573+0000 7f741ce00700 1 -- 172.21.15.80:0/309791396 >> 172.21.15.80:0/309791396 conn(0x7f74180b26a0 msgr2=0x7f741806fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.573+0000 7f741ce00700 1 -- 172.21.15.80:0/309791396 shutdown_connections 2024-05-10T04:26:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.573+0000 7f741ce00700 1 -- 172.21.15.80:0/309791396 wait complete. 2024-05-10T04:26:58.576 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 1 to deep-scrub 2024-05-10T04:26:58.600 INFO:tasks.ceph:Scrubbing osd.2 2024-05-10T04:26:58.600 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-10T04:26:58.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.863+0000 7f97fde00700 1 Processor -- start 2024-05-10T04:26:58.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.863+0000 7f97fde00700 1 -- start start 2024-05-10T04:26:58.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.865+0000 7f97fde00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f97f80b6240 0x7f97f80d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.865+0000 7f97fde00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97f815d870 0x7f97f815dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.865+0000 7f97fde00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f80d3690 con 0x7f97f80d0600 2024-05-10T04:26:58.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.865+0000 7f97fde00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f80b71e0 con 0x7f97f80b6240 2024-05-10T04:26:58.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.865+0000 7f97fde00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80d2df0 con 0x7f97f815d870 2024-05-10T04:26:58.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.866+0000 7f97fd400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97f815d870 0x7f97f815dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.866+0000 7f97fd400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97f815d870 0x7f97f815dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:53958/0 (socket says 172.21.15.80:53958) 2024-05-10T04:26:58.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.866+0000 7f97fca00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f97f80b6240 0x7f97f80d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.866+0000 7f97fd400700 1 -- 172.21.15.80:0/2798130936 learned_addr learned my addr 172.21.15.80:0/2798130936 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:58.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.866+0000 7f97fd400700 1 -- 172.21.15.80:0/2798130936 >> v2:172.21.15.106:3300/0 conn(0x7f97f80b6240 msgr2=0x7f97f80d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:58.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.866+0000 7f97fd400700 1 --2- 172.21.15.80:0/2798130936 >> v2:172.21.15.106:3300/0 conn(0x7f97f80b6240 0x7f97f80d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.866+0000 7f97fd400700 1 -- 172.21.15.80:0/2798130936 >> v1:172.21.15.106:6789/0 conn(0x7f97f80d0600 legacy=0x7f97f80d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.866+0000 7f97f7400700 1 -- 172.21.15.80:0/2798130936 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1394342540 0 0) 0x7f97f80d3690 con 0x7f97f80d0600 2024-05-10T04:26:58.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.866+0000 7f97fd400700 1 -- 172.21.15.80:0/2798130936 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f80d30d0 con 0x7f97f815d870 2024-05-10T04:26:58.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.867+0000 7f97fd400700 1 --2- 172.21.15.80:0/2798130936 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97f815d870 0x7f97f815dc80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009e50 tx=0x7f97f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de19a9a6553eb1f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:58.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.867+0000 7f97f7400700 1 -- 172.21.15.80:0/2798130936 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f000e070 con 0x7f97f815d870 2024-05-10T04:26:58.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.867+0000 7f97f7400700 1 -- 172.21.15.80:0/2798130936 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f000b910 con 0x7f97f815d870 2024-05-10T04:26:58.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.867+0000 7f97f7400700 1 -- 172.21.15.80:0/2798130936 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f000bcc0 con 0x7f97f815d870 2024-05-10T04:26:58.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.867+0000 7f97fde00700 1 -- 172.21.15.80:0/2798130936 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97f815d870 msgr2=0x7f97f815dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.868+0000 7f97fde00700 1 --2- 172.21.15.80:0/2798130936 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97f815d870 0x7f97f815dc80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009e50 tx=0x7f97f000b330 comp rx=0 tx=0).stop 2024-05-10T04:26:58.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.868+0000 7f97fde00700 1 -- 172.21.15.80:0/2798130936 shutdown_connections 2024-05-10T04:26:58.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.868+0000 7f97fde00700 1 --2- 172.21.15.80:0/2798130936 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97f815d870 0x7f97f815dc80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.868+0000 7f97fde00700 1 --2- 172.21.15.80:0/2798130936 >> v2:172.21.15.106:3300/0 conn(0x7f97f80b6240 0x7f97f80d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.868+0000 7f97fde00700 1 -- 172.21.15.80:0/2798130936 >> 172.21.15.80:0/2798130936 conn(0x7f97f8067700 msgr2=0x7f97f806c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:58.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.868+0000 7f97fde00700 1 -- 172.21.15.80:0/2798130936 shutdown_connections 2024-05-10T04:26:58.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.868+0000 7f97fde00700 1 -- 172.21.15.80:0/2798130936 wait complete. 2024-05-10T04:26:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.870+0000 7f97fde00700 1 Processor -- start 2024-05-10T04:26:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.870+0000 7f97fde00700 1 -- start start 2024-05-10T04:26:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.872+0000 7f97fde00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97f80b6240 0x7f97f81f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.872+0000 7f97fde00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97f80d0600 0x7f97f815a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.872+0000 7f97fde00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97f815d870 0x7f97f815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.872+0000 7f97fde00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f815bae0 con 0x7f97f80b6240 2024-05-10T04:26:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.872+0000 7f97fde00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80cd360 con 0x7f97f80d0600 2024-05-10T04:26:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.872+0000 7f97fde00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80c9e40 con 0x7f97f815d870 2024-05-10T04:26:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.872+0000 7f97fca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97f80b6240 0x7f97f81f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.872+0000 7f97fca00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97f80b6240 0x7f97f81f3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44762/0 (socket says 172.21.15.80:44762) 2024-05-10T04:26:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.872+0000 7f97fca00700 1 -- 172.21.15.80:0/2519758388 learned_addr learned my addr 172.21.15.80:0/2519758388 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.872+0000 7f97fd400700 1 --2- 172.21.15.80:0/2519758388 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97f815d870 0x7f97f815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.872+0000 7f97f7e00700 1 --2- 172.21.15.80:0/2519758388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97f80d0600 0x7f97f815a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.872+0000 7f97fca00700 1 -- 172.21.15.80:0/2519758388 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97f815d870 msgr2=0x7f97f815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.872+0000 7f97fca00700 1 --2- 172.21.15.80:0/2519758388 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97f815d870 0x7f97f815a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.872+0000 7f97fca00700 1 -- 172.21.15.80:0/2519758388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97f80d0600 msgr2=0x7f97f815a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.872+0000 7f97fca00700 1 --2- 172.21.15.80:0/2519758388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97f80d0600 0x7f97f815a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.872+0000 7f97fca00700 1 -- 172.21.15.80:0/2519758388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f0009b30 con 0x7f97f80b6240 2024-05-10T04:26:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.873+0000 7f97fca00700 1 --2- 172.21.15.80:0/2519758388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97f80b6240 0x7f97f81f3c50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00e8a0 tx=0x7f97ec00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.873+0000 7f97f4c00700 1 -- 172.21.15.80:0/2519758388 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec009590 con 0x7f97f80b6240 2024-05-10T04:26:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.873+0000 7f97f4c00700 1 -- 172.21.15.80:0/2519758388 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ec013680 con 0x7f97f80b6240 2024-05-10T04:26:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.873+0000 7f97fde00700 1 -- 172.21.15.80:0/2519758388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f81f4190 con 0x7f97f80b6240 2024-05-10T04:26:58.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.873+0000 7f97f4c00700 1 -- 172.21.15.80:0/2519758388 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0139f0 con 0x7f97f80b6240 2024-05-10T04:26:58.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.873+0000 7f97fde00700 1 -- 172.21.15.80:0/2519758388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f80cbb90 con 0x7f97f80b6240 2024-05-10T04:26:58.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.874+0000 7f97fde00700 1 -- 172.21.15.80:0/2519758388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97f80d2b00 con 0x7f97f80b6240 2024-05-10T04:26:58.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.875+0000 7f97f4c00700 1 -- 172.21.15.80:0/2519758388 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f97ec013b50 con 0x7f97f80b6240 2024-05-10T04:26:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.876+0000 7f97f4c00700 1 --2- 172.21.15.80:0/2519758388 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f97d806acc0 0x7f97d806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.876+0000 7f97f4c00700 1 -- 172.21.15.80:0/2519758388 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f97ec089510 con 0x7f97f80b6240 2024-05-10T04:26:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.876+0000 7f97f4c00700 1 --2- 172.21.15.80:0/2519758388 >> [v2:172.21.15.80:6817/41471,v1:172.21.15.80:6819/41471] conn(0x7f97d8070b70 0x7f97d8072fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.876+0000 7f97f4c00700 1 -- 172.21.15.80:0/2519758388 --> [v2:172.21.15.80:6817/41471,v1:172.21.15.80:6819/41471] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97d80736b0 con 0x7f97d8070b70 2024-05-10T04:26:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.876+0000 7f97f4c00700 1 -- 172.21.15.80:0/2519758388 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97ec089960 con 0x7f97f80b6240 2024-05-10T04:26:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.877+0000 7f97f7e00700 1 --2- 172.21.15.80:0/2519758388 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f97d806acc0 0x7f97d806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.877+0000 7f97fd400700 1 --2- 172.21.15.80:0/2519758388 >> [v2:172.21.15.80:6817/41471,v1:172.21.15.80:6819/41471] conn(0x7f97d8070b70 0x7f97d8072fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.877+0000 7f97f7e00700 1 --2- 172.21.15.80:0/2519758388 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f97d806acc0 0x7f97d806d1d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f97f80d4730 tx=0x7f97e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:58.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.877+0000 7f97fd400700 1 --2- 172.21.15.80:0/2519758388 >> [v2:172.21.15.80:6817/41471,v1:172.21.15.80:6819/41471] conn(0x7f97d8070b70 0x7f97d8072fe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:58.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.878+0000 7f97f4c00700 1 -- 172.21.15.80:0/2519758388 <== osd.2 v2:172.21.15.80:6817/41471 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f97d80736b0 con 0x7f97d8070b70 2024-05-10T04:26:58.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.893+0000 7f97fde00700 1 -- 172.21.15.80:0/2519758388 --> [v2:172.21.15.80:6817/41471,v1:172.21.15.80:6819/41471] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f97f80b73f0 con 0x7f97d8070b70 2024-05-10T04:26:58.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.893+0000 7f97f4c00700 1 -- 172.21.15.80:0/2519758388 <== osd.2 v2:172.21.15.80:6817/41471 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f97f00099b0 con 0x7f97d8070b70 2024-05-10T04:26:58.895 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-10T04:26:58.895 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T04:26:58.895 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-10T04:26:58.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.894+0000 7f97fde00700 1 -- 172.21.15.80:0/2519758388 >> [v2:172.21.15.80:6817/41471,v1:172.21.15.80:6819/41471] conn(0x7f97d8070b70 msgr2=0x7f97d8072fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.894+0000 7f97fde00700 1 --2- 172.21.15.80:0/2519758388 >> [v2:172.21.15.80:6817/41471,v1:172.21.15.80:6819/41471] conn(0x7f97d8070b70 0x7f97d8072fe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.894+0000 7f97fde00700 1 -- 172.21.15.80:0/2519758388 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f97d806acc0 msgr2=0x7f97d806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.894+0000 7f97fde00700 1 --2- 172.21.15.80:0/2519758388 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f97d806acc0 0x7f97d806d1d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f97f80d4730 tx=0x7f97e4009040 comp rx=0 tx=0).stop 2024-05-10T04:26:58.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.894+0000 7f97fde00700 1 -- 172.21.15.80:0/2519758388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97f80b6240 msgr2=0x7f97f81f3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:58.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.894+0000 7f97fde00700 1 --2- 172.21.15.80:0/2519758388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97f80b6240 0x7f97f81f3c50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00e8a0 tx=0x7f97ec00ebb0 comp rx=0 tx=0).stop 2024-05-10T04:26:58.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.894+0000 7f97fd400700 1 -- 172.21.15.80:0/2519758388 reap_dead start 2024-05-10T04:26:58.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.894+0000 7f97fde00700 1 -- 172.21.15.80:0/2519758388 shutdown_connections 2024-05-10T04:26:58.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.894+0000 7f97fde00700 1 -- 172.21.15.80:0/2519758388 >> 172.21.15.80:0/2519758388 conn(0x7f97f8067700 msgr2=0x7f97f80b57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:58.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.894+0000 7f97fde00700 1 -- 172.21.15.80:0/2519758388 shutdown_connections 2024-05-10T04:26:58.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:58.894+0000 7f97fde00700 1 -- 172.21.15.80:0/2519758388 wait complete. 2024-05-10T04:26:58.919 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-10T04:26:59.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.178+0000 7f2d0be00700 1 Processor -- start 2024-05-10T04:26:59.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.178+0000 7f2d0be00700 1 -- start start 2024-05-10T04:26:59.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.180+0000 7f2d0be00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2d040b3280 0x7f2d040d3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.180+0000 7f2d0be00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2d0406c2f0 0x7f2d0406c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.180+0000 7f2d0be00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d040d38d0 con 0x7f2d040b5d00 2024-05-10T04:26:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.180+0000 7f2d0be00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0406cf70 con 0x7f2d0406c2f0 2024-05-10T04:26:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.180+0000 7f2d0be00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0406d250 con 0x7f2d040b3280 2024-05-10T04:26:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.180+0000 7f2d09e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2d0406c2f0 0x7f2d0406c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.180+0000 7f2d09e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2d0406c2f0 0x7f2d0406c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44778/0 (socket says 172.21.15.80:44778) 2024-05-10T04:26:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.180+0000 7f2d09e00700 1 -- 172.21.15.80:0/1429861067 learned_addr learned my addr 172.21.15.80:0/1429861067 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.180+0000 7f2d09400700 1 --2- 172.21.15.80:0/1429861067 >> v2:172.21.15.106:3300/0 conn(0x7f2d040b3280 0x7f2d040d3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.180+0000 7f2d09e00700 1 -- 172.21.15.80:0/1429861067 >> v2:172.21.15.106:3300/0 conn(0x7f2d040b3280 msgr2=0x7f2d040d3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.180+0000 7f2d09e00700 1 --2- 172.21.15.80:0/1429861067 >> v2:172.21.15.106:3300/0 conn(0x7f2d040b3280 0x7f2d040d3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.180+0000 7f2d09e00700 1 -- 172.21.15.80:0/1429861067 >> v1:172.21.15.106:6789/0 conn(0x7f2d040b5d00 legacy=0x7f2d040b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.181+0000 7f2d09e00700 1 -- 172.21.15.80:0/1429861067 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d040d28b0 con 0x7f2d0406c2f0 2024-05-10T04:26:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.181+0000 7f2d09e00700 1 --2- 172.21.15.80:0/1429861067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d0406c2f0 0x7f2d0406c700 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2d0408c9b0 tx=0x7f2cfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b1525d8c6b76b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:59.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.181+0000 7f2d03e00700 1 -- 172.21.15.80:0/1429861067 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc00e070 con 0x7f2d0406c2f0 2024-05-10T04:26:59.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.181+0000 7f2d03e00700 1 -- 172.21.15.80:0/1429861067 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc00b910 con 0x7f2d0406c2f0 2024-05-10T04:26:59.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.181+0000 7f2d03e00700 1 -- 172.21.15.80:0/1429861067 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc00bcc0 con 0x7f2d0406c2f0 2024-05-10T04:26:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.182+0000 7f2d0be00700 1 -- 172.21.15.80:0/1429861067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d0406c2f0 msgr2=0x7f2d0406c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.182+0000 7f2d0be00700 1 --2- 172.21.15.80:0/1429861067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d0406c2f0 0x7f2d0406c700 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2d0408c9b0 tx=0x7f2cfc00b330 comp rx=0 tx=0).stop 2024-05-10T04:26:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.182+0000 7f2d0be00700 1 -- 172.21.15.80:0/1429861067 shutdown_connections 2024-05-10T04:26:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.182+0000 7f2d0be00700 1 --2- 172.21.15.80:0/1429861067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d0406c2f0 0x7f2d0406c700 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.182+0000 7f2d0be00700 1 --2- 172.21.15.80:0/1429861067 >> v2:172.21.15.106:3300/0 conn(0x7f2d040b3280 0x7f2d040d3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.182+0000 7f2d0be00700 1 -- 172.21.15.80:0/1429861067 >> 172.21.15.80:0/1429861067 conn(0x7f2d040d40a0 msgr2=0x7f2d040d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.182+0000 7f2d0be00700 1 -- 172.21.15.80:0/1429861067 shutdown_connections 2024-05-10T04:26:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.182+0000 7f2d0be00700 1 -- 172.21.15.80:0/1429861067 wait complete. 2024-05-10T04:26:59.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.184+0000 7f2d0be00700 1 Processor -- start 2024-05-10T04:26:59.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.184+0000 7f2d0be00700 1 -- start start 2024-05-10T04:26:59.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d0be00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d0406c2f0 0x7f2d04152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:59.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d0be00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d040b3280 0x7f2d040ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:59.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d0be00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2d040b5d00 0x7f2d0414fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:59.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d0be00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d040ab5c0 con 0x7f2d040b3280 2024-05-10T04:26:59.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d0be00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d041527b0 con 0x7f2d0406c2f0 2024-05-10T04:26:59.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d0be00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d04150900 con 0x7f2d040b5d00 2024-05-10T04:26:59.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d08a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d040b3280 0x7f2d040ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:59.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d09400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d0406c2f0 0x7f2d04152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:59.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d09400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d0406c2f0 0x7f2d04152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:59358/0 (socket says 172.21.15.80:59358) 2024-05-10T04:26:59.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d08a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d040b3280 0x7f2d040ab9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44792/0 (socket says 172.21.15.80:44792) 2024-05-10T04:26:59.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d09400700 1 -- 172.21.15.80:0/1483990786 learned_addr learned my addr 172.21.15.80:0/1483990786 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:59.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d09e00700 1 --2- 172.21.15.80:0/1483990786 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2d040b5d00 0x7f2d0414fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:59.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d08a00700 1 -- 172.21.15.80:0/1483990786 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2d040b5d00 msgr2=0x7f2d0414fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:59.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d08a00700 1 --2- 172.21.15.80:0/1483990786 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2d040b5d00 0x7f2d0414fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d08a00700 1 -- 172.21.15.80:0/1483990786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d0406c2f0 msgr2=0x7f2d04152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:59.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d08a00700 1 --2- 172.21.15.80:0/1483990786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d0406c2f0 0x7f2d04152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d08a00700 1 -- 172.21.15.80:0/1483990786 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc009b30 con 0x7f2d040b3280 2024-05-10T04:26:59.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.186+0000 7f2d09400700 1 --2- 172.21.15.80:0/1483990786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d0406c2f0 0x7f2d04152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:26:59.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.187+0000 7f2d08a00700 1 --2- 172.21.15.80:0/1483990786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d040b3280 0x7f2d040ab9e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000c3a0 tx=0x7f2cf000c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:59.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.187+0000 7f2d01600700 1 -- 172.21.15.80:0/1483990786 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf00052d0 con 0x7f2d040b3280 2024-05-10T04:26:59.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.187+0000 7f2d01600700 1 -- 172.21.15.80:0/1483990786 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf0005450 con 0x7f2d040b3280 2024-05-10T04:26:59.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.187+0000 7f2d0be00700 1 -- 172.21.15.80:0/1483990786 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0415ef70 con 0x7f2d040b3280 2024-05-10T04:26:59.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.187+0000 7f2d01600700 1 -- 172.21.15.80:0/1483990786 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0003910 con 0x7f2d040b3280 2024-05-10T04:26:59.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.187+0000 7f2d0be00700 1 -- 172.21.15.80:0/1483990786 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d040aac20 con 0x7f2d040b3280 2024-05-10T04:26:59.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.188+0000 7f2d0be00700 1 -- 172.21.15.80:0/1483990786 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d040ce2f0 con 0x7f2d040b3280 2024-05-10T04:26:59.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.189+0000 7f2d01600700 1 -- 172.21.15.80:0/1483990786 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2cf0003a70 con 0x7f2d040b3280 2024-05-10T04:26:59.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.190+0000 7f2d01600700 1 --2- 172.21.15.80:0/1483990786 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2ce406ac90 0x7f2ce406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:59.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.190+0000 7f2d01600700 1 -- 172.21.15.80:0/1483990786 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2cf0088380 con 0x7f2d040b3280 2024-05-10T04:26:59.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.190+0000 7f2d09400700 1 --2- 172.21.15.80:0/1483990786 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2ce406ac90 0x7f2ce406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:59.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.191+0000 7f2d09400700 1 --2- 172.21.15.80:0/1483990786 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2ce406ac90 0x7f2ce406d1a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80112c0 tx=0x7f2cf8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:59.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.195+0000 7f2d01600700 1 -- 172.21.15.80:0/1483990786 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2cf0053730 con 0x7f2d040b3280 2024-05-10T04:26:59.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.399+0000 7f2d0be00700 1 -- 172.21.15.80:0/1483990786 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d0406cc40 con 0x7f2ce406ac90 2024-05-10T04:26:59.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.400+0000 7f2d01600700 1 -- 172.21.15.80:0/1483990786 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2cf8011c80 con 0x7f2ce406ac90 2024-05-10T04:26:59.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.402+0000 7f2d0be00700 1 -- 172.21.15.80:0/1483990786 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2ce406ac90 msgr2=0x7f2ce406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:59.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.402+0000 7f2d0be00700 1 --2- 172.21.15.80:0/1483990786 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2ce406ac90 0x7f2ce406d1a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80112c0 tx=0x7f2cf8009210 comp rx=0 tx=0).stop 2024-05-10T04:26:59.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.402+0000 7f2d0be00700 1 -- 172.21.15.80:0/1483990786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d040b3280 msgr2=0x7f2d040ab9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:59.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.402+0000 7f2d0be00700 1 --2- 172.21.15.80:0/1483990786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d040b3280 0x7f2d040ab9e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000c3a0 tx=0x7f2cf000c6b0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.403+0000 7f2d0be00700 1 -- 172.21.15.80:0/1483990786 shutdown_connections 2024-05-10T04:26:59.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.403+0000 7f2d0be00700 1 --2- 172.21.15.80:0/1483990786 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2ce406ac90 0x7f2ce406d1a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.403+0000 7f2d0be00700 1 --2- 172.21.15.80:0/1483990786 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2d040b5d00 0x7f2d0414fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.403+0000 7f2d0be00700 1 --2- 172.21.15.80:0/1483990786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d0406c2f0 0x7f2d04152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.403+0000 7f2d0be00700 1 --2- 172.21.15.80:0/1483990786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d040b3280 0x7f2d040ab9e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.403+0000 7f2d0be00700 1 -- 172.21.15.80:0/1483990786 >> 172.21.15.80:0/1483990786 conn(0x7f2d040d40a0 msgr2=0x7f2d040ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:59.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.403+0000 7f2d0be00700 1 -- 172.21.15.80:0/1483990786 shutdown_connections 2024-05-10T04:26:59.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.403+0000 7f2d0be00700 1 -- 172.21.15.80:0/1483990786 wait complete. 2024-05-10T04:26:59.405 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 2 to deep-scrub 2024-05-10T04:26:59.432 INFO:tasks.ceph:Scrubbing osd.3 2024-05-10T04:26:59.432 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-10T04:26:59.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.696+0000 7f5642800700 1 Processor -- start 2024-05-10T04:26:59.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.696+0000 7f5642800700 1 -- start start 2024-05-10T04:26:59.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.698+0000 7f5642800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f563c0ccb30 0x7f563c13dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:59.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.698+0000 7f5642800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f563c06e780 0x7f563c06eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:59.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.698+0000 7f5642800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563c15c480 con 0x7f563c15b960 2024-05-10T04:26:59.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.698+0000 7f5642800700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563c15c6b0 con 0x7f563c0ccb30 2024-05-10T04:26:59.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.698+0000 7f5642800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0cf2d0 con 0x7f563c06e780 2024-05-10T04:26:59.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.698+0000 7f563b400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f563c0ccb30 0x7f563c13dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:59.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.698+0000 7f563be00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f563c15b960 0x7f563c15bd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45302/0 (socket says 172.21.15.80:45302) 2024-05-10T04:26:59.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.698+0000 7f563be00700 1 -- 172.21.15.80:0/2824017353 learned_addr learned my addr 172.21.15.80:0/2824017353 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:26:59.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.698+0000 7f563aa00700 1 --2- 172.21.15.80:0/2824017353 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f563c06e780 0x7f563c06eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:59.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.699+0000 7f563b400700 1 -- 172.21.15.80:0/2824017353 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f563c06e780 msgr2=0x7f563c06eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:26:59.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.699+0000 7f563b400700 1 --2- 172.21.15.80:0/2824017353 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f563c06e780 0x7f563c06eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.699+0000 7f563b400700 1 -- 172.21.15.80:0/2824017353 >> v1:172.21.15.80:6789/0 conn(0x7f563c15b960 legacy=0x7f563c15bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:59.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.699+0000 7f563b400700 1 -- 172.21.15.80:0/2824017353 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c0cc6a0 con 0x7f563c0ccb30 2024-05-10T04:26:59.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.699+0000 7f563a000700 1 -- 172.21.15.80:0/2824017353 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043263737 0 0) 0x7f563c15c480 con 0x7f563c15b960 2024-05-10T04:26:59.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.699+0000 7f563b400700 1 --2- 172.21.15.80:0/2824017353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563c0ccb30 0x7f563c13dde0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f562c00bae0 tx=0x7f562c00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35af9c7c6210583 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:59.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.699+0000 7f563a000700 1 -- 172.21.15.80:0/2824017353 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c00dd30 con 0x7f563c0ccb30 2024-05-10T04:26:59.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.699+0000 7f563a000700 1 -- 172.21.15.80:0/2824017353 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562c00de90 con 0x7f563c0ccb30 2024-05-10T04:26:59.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.699+0000 7f563a000700 1 -- 172.21.15.80:0/2824017353 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c010690 con 0x7f563c0ccb30 2024-05-10T04:26:59.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.700+0000 7f5642800700 1 -- 172.21.15.80:0/2824017353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563c0ccb30 msgr2=0x7f563c13dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:59.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.700+0000 7f5642800700 1 --2- 172.21.15.80:0/2824017353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563c0ccb30 0x7f563c13dde0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f562c00bae0 tx=0x7f562c00bdf0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.700+0000 7f5642800700 1 -- 172.21.15.80:0/2824017353 shutdown_connections 2024-05-10T04:26:59.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.700+0000 7f5642800700 1 --2- 172.21.15.80:0/2824017353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563c0ccb30 0x7f563c13dde0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.700+0000 7f5642800700 1 --2- 172.21.15.80:0/2824017353 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f563c06e780 0x7f563c06eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.700+0000 7f5642800700 1 -- 172.21.15.80:0/2824017353 >> 172.21.15.80:0/2824017353 conn(0x7f563c06b620 msgr2=0x7f563c0b16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:59.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.700+0000 7f5642800700 1 -- 172.21.15.80:0/2824017353 shutdown_connections 2024-05-10T04:26:59.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.700+0000 7f5642800700 1 -- 172.21.15.80:0/2824017353 wait complete. 2024-05-10T04:26:59.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.702+0000 7f5642800700 1 Processor -- start 2024-05-10T04:26:59.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.702+0000 7f5642800700 1 -- start start 2024-05-10T04:26:59.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.704+0000 7f5642800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f563c06e780 0x7f563c1514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:59.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.704+0000 7f5642800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563c15b960 0x7f563c1359c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:59.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.704+0000 7f5642800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f563c135f00 0x7f563c0b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.704+0000 7f5642800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c136330 con 0x7f563c15b960 2024-05-10T04:26:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.704+0000 7f5642800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c13e980 con 0x7f563c06e780 2024-05-10T04:26:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.704+0000 7f5642800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c1553c0 con 0x7f563c135f00 2024-05-10T04:26:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.704+0000 7f563aa00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563c15b960 0x7f563c1359c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.704+0000 7f563aa00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563c15b960 0x7f563c1359c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44810/0 (socket says 172.21.15.80:44810) 2024-05-10T04:26:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.704+0000 7f563aa00700 1 -- 172.21.15.80:0/3036112686 learned_addr learned my addr 172.21.15.80:0/3036112686 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:26:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.704+0000 7f563b400700 1 --2- 172.21.15.80:0/3036112686 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f563c06e780 0x7f563c1514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.704+0000 7f563be00700 1 --2- 172.21.15.80:0/3036112686 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f563c135f00 0x7f563c0b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.705+0000 7f563aa00700 1 -- 172.21.15.80:0/3036112686 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f563c135f00 msgr2=0x7f563c0b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.705+0000 7f563aa00700 1 --2- 172.21.15.80:0/3036112686 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f563c135f00 0x7f563c0b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.705+0000 7f563aa00700 1 -- 172.21.15.80:0/3036112686 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f563c06e780 msgr2=0x7f563c1514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.705+0000 7f563aa00700 1 --2- 172.21.15.80:0/3036112686 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f563c06e780 0x7f563c1514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.705+0000 7f563aa00700 1 -- 172.21.15.80:0/3036112686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562c00b740 con 0x7f563c15b960 2024-05-10T04:26:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.705+0000 7f563b400700 1 --2- 172.21.15.80:0/3036112686 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f563c06e780 0x7f563c1514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:26:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.705+0000 7f563aa00700 1 --2- 172.21.15.80:0/3036112686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563c15b960 0x7f563c1359c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f562800d800 tx=0x7f562800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.705+0000 7f5633400700 1 -- 172.21.15.80:0/3036112686 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56280125f0 con 0x7f563c15b960 2024-05-10T04:26:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.705+0000 7f5633400700 1 -- 172.21.15.80:0/3036112686 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5628012750 con 0x7f563c15b960 2024-05-10T04:26:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.705+0000 7f5642800700 1 -- 172.21.15.80:0/3036112686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563c0b0920 con 0x7f563c15b960 2024-05-10T04:26:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.705+0000 7f5633400700 1 -- 172.21.15.80:0/3036112686 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628012ae0 con 0x7f563c15b960 2024-05-10T04:26:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.705+0000 7f5642800700 1 -- 172.21.15.80:0/3036112686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563c0b0ee0 con 0x7f563c15b960 2024-05-10T04:26:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.706+0000 7f5642800700 1 -- 172.21.15.80:0/3036112686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f563c06f1e0 con 0x7f563c15b960 2024-05-10T04:26:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.707+0000 7f5633400700 1 -- 172.21.15.80:0/3036112686 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5628012c40 con 0x7f563c15b960 2024-05-10T04:26:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.708+0000 7f5633400700 1 --2- 172.21.15.80:0/3036112686 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f561c06ac90 0x7f561c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:59.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.708+0000 7f5633400700 1 -- 172.21.15.80:0/3036112686 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f56280894e0 con 0x7f563c15b960 2024-05-10T04:26:59.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.708+0000 7f5633400700 1 --2- 172.21.15.80:0/3036112686 >> [v2:172.21.15.80:6808/41473,v1:172.21.15.80:6809/41473] conn(0x7f561c070b40 0x7f561c072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:26:59.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.708+0000 7f5633400700 1 -- 172.21.15.80:0/3036112686 --> [v2:172.21.15.80:6808/41473,v1:172.21.15.80:6809/41473] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f561c073680 con 0x7f561c070b40 2024-05-10T04:26:59.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.708+0000 7f5633400700 1 -- 172.21.15.80:0/3036112686 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f562808bac0 con 0x7f563c15b960 2024-05-10T04:26:59.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.709+0000 7f563b400700 1 --2- 172.21.15.80:0/3036112686 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f561c06ac90 0x7f561c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:59.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.709+0000 7f563be00700 1 --2- 172.21.15.80:0/3036112686 >> [v2:172.21.15.80:6808/41473,v1:172.21.15.80:6809/41473] conn(0x7f561c070b40 0x7f561c072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:26:59.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.709+0000 7f563be00700 1 --2- 172.21.15.80:0/3036112686 >> [v2:172.21.15.80:6808/41473,v1:172.21.15.80:6809/41473] conn(0x7f561c070b40 0x7f561c072fb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:59.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.709+0000 7f563b400700 1 --2- 172.21.15.80:0/3036112686 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f561c06ac90 0x7f561c06d1a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f562c00bae0 tx=0x7f562c013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:26:59.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.710+0000 7f5633400700 1 -- 172.21.15.80:0/3036112686 <== osd.3 v2:172.21.15.80:6808/41473 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f561c073680 con 0x7f561c070b40 2024-05-10T04:26:59.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.725+0000 7f5642800700 1 -- 172.21.15.80:0/3036112686 --> [v2:172.21.15.80:6808/41473,v1:172.21.15.80:6809/41473] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f563c0cc330 con 0x7f561c070b40 2024-05-10T04:26:59.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.725+0000 7f5633400700 1 -- 172.21.15.80:0/3036112686 <== osd.3 v2:172.21.15.80:6808/41473 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f56340070b0 con 0x7f561c070b40 2024-05-10T04:26:59.727 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-10T04:26:59.727 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T04:26:59.727 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-10T04:26:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.726+0000 7f5642800700 1 -- 172.21.15.80:0/3036112686 >> [v2:172.21.15.80:6808/41473,v1:172.21.15.80:6809/41473] conn(0x7f561c070b40 msgr2=0x7f561c072fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.726+0000 7f5642800700 1 --2- 172.21.15.80:0/3036112686 >> [v2:172.21.15.80:6808/41473,v1:172.21.15.80:6809/41473] conn(0x7f561c070b40 0x7f561c072fb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.726+0000 7f5642800700 1 -- 172.21.15.80:0/3036112686 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f561c06ac90 msgr2=0x7f561c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.726+0000 7f5642800700 1 --2- 172.21.15.80:0/3036112686 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f561c06ac90 0x7f561c06d1a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f562c00bae0 tx=0x7f562c013000 comp rx=0 tx=0).stop 2024-05-10T04:26:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.726+0000 7f5642800700 1 -- 172.21.15.80:0/3036112686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563c15b960 msgr2=0x7f563c1359c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:26:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.726+0000 7f5642800700 1 --2- 172.21.15.80:0/3036112686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563c15b960 0x7f563c1359c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f562800d800 tx=0x7f562800dbc0 comp rx=0 tx=0).stop 2024-05-10T04:26:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.726+0000 7f563be00700 1 -- 172.21.15.80:0/3036112686 reap_dead start 2024-05-10T04:26:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.726+0000 7f5642800700 1 -- 172.21.15.80:0/3036112686 shutdown_connections 2024-05-10T04:26:59.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.726+0000 7f5642800700 1 -- 172.21.15.80:0/3036112686 >> 172.21.15.80:0/3036112686 conn(0x7f563c06b620 msgr2=0x7f563c15d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:26:59.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.726+0000 7f5642800700 1 -- 172.21.15.80:0/3036112686 shutdown_connections 2024-05-10T04:26:59.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:26:59.726+0000 7f5642800700 1 -- 172.21.15.80:0/3036112686 wait complete. 2024-05-10T04:26:59.752 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-10T04:27:00.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.012+0000 7f6dd5e00700 1 Processor -- start 2024-05-10T04:27:00.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.012+0000 7f6dd5e00700 1 -- start start 2024-05-10T04:27:00.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.013+0000 7f6dd5e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6dd0158c70 0x7f6dd015ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.013+0000 7f6dd5e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6dd00b5c90 0x7f6dd00b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.013+0000 7f6dd5e00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd006c5f0 con 0x7f6dd0162000 2024-05-10T04:27:00.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.013+0000 7f6dd5e00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd00b65e0 con 0x7f6dd00b5c90 2024-05-10T04:27:00.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.013+0000 7f6dd5e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd006d190 con 0x7f6dd0158c70 2024-05-10T04:27:00.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.014+0000 7f6dcf400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6dd00b5c90 0x7f6dd00b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.014+0000 7f6dcf400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6dd00b5c90 0x7f6dd00b60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44820/0 (socket says 172.21.15.80:44820) 2024-05-10T04:27:00.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.014+0000 7f6dcf400700 1 -- 172.21.15.80:0/215610731 learned_addr learned my addr 172.21.15.80:0/215610731 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:27:00.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.014+0000 7f6dcea00700 1 --2- 172.21.15.80:0/215610731 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6dd0158c70 0x7f6dd015ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.014+0000 7f6dcf400700 1 -- 172.21.15.80:0/215610731 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6dd0158c70 msgr2=0x7f6dd015ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:27:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.014+0000 7f6dcf400700 1 --2- 172.21.15.80:0/215610731 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6dd0158c70 0x7f6dd015ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.014+0000 7f6dcf400700 1 -- 172.21.15.80:0/215610731 >> v1:172.21.15.106:6789/0 conn(0x7f6dd0162000 legacy=0x7f6dd006ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.014+0000 7f6dcf400700 1 -- 172.21.15.80:0/215610731 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd0162850 con 0x7f6dd00b5c90 2024-05-10T04:27:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.015+0000 7f6dcf400700 1 --2- 172.21.15.80:0/215610731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dd00b5c90 0x7f6dd00b60a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009e50 tx=0x7f6dc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359a0bf552a794c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.015+0000 7f6dce000700 1 -- 172.21.15.80:0/215610731 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800e070 con 0x7f6dd00b5c90 2024-05-10T04:27:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.015+0000 7f6dce000700 1 -- 172.21.15.80:0/215610731 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc800b9c0 con 0x7f6dd00b5c90 2024-05-10T04:27:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.015+0000 7f6dce000700 1 -- 172.21.15.80:0/215610731 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800bd70 con 0x7f6dd00b5c90 2024-05-10T04:27:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.016+0000 7f6dd5e00700 1 -- 172.21.15.80:0/215610731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dd00b5c90 msgr2=0x7f6dd00b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.016+0000 7f6dd5e00700 1 --2- 172.21.15.80:0/215610731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dd00b5c90 0x7f6dd00b60a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009e50 tx=0x7f6dc800b330 comp rx=0 tx=0).stop 2024-05-10T04:27:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.016+0000 7f6dd5e00700 1 -- 172.21.15.80:0/215610731 shutdown_connections 2024-05-10T04:27:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.016+0000 7f6dd5e00700 1 --2- 172.21.15.80:0/215610731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dd00b5c90 0x7f6dd00b60a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.016+0000 7f6dd5e00700 1 --2- 172.21.15.80:0/215610731 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6dd0158c70 0x7f6dd015ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.016+0000 7f6dd5e00700 1 -- 172.21.15.80:0/215610731 >> 172.21.15.80:0/215610731 conn(0x7f6dd00d0d30 msgr2=0x7f6dd00d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.016+0000 7f6dd5e00700 1 -- 172.21.15.80:0/215610731 shutdown_connections 2024-05-10T04:27:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.016+0000 7f6dd5e00700 1 -- 172.21.15.80:0/215610731 wait complete. 2024-05-10T04:27:00.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.018+0000 7f6dd5e00700 1 Processor -- start 2024-05-10T04:27:00.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.018+0000 7f6dd5e00700 1 -- start start 2024-05-10T04:27:00.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.020+0000 7f6dd5e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6dd00b5c90 0x7f6dd00caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.020+0000 7f6dd5e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6dd0158c70 0x7f6dd00cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.020+0000 7f6dd5e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dd0162000 0x7f6dd01e94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.020+0000 7f6dd5e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd01ea830 con 0x7f6dd0162000 2024-05-10T04:27:00.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.020+0000 7f6dd5e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00ca350 con 0x7f6dd0158c70 2024-05-10T04:27:00.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.020+0000 7f6dd5e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00ca880 con 0x7f6dd00b5c90 2024-05-10T04:27:00.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.020+0000 7f6dcf400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dd0162000 0x7f6dd01e94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.020+0000 7f6dcf400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dd0162000 0x7f6dd01e94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44832/0 (socket says 172.21.15.80:44832) 2024-05-10T04:27:00.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.020+0000 7f6dcf400700 1 -- 172.21.15.80:0/3967373325 learned_addr learned my addr 172.21.15.80:0/3967373325 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:27:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.020+0000 7f6dcea00700 1 --2- 172.21.15.80:0/3967373325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6dd00b5c90 0x7f6dd00caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.020+0000 7f6dc7e00700 1 --2- 172.21.15.80:0/3967373325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6dd0158c70 0x7f6dd00cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.020+0000 7f6dcf400700 1 -- 172.21.15.80:0/3967373325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6dd00b5c90 msgr2=0x7f6dd00caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.020+0000 7f6dcf400700 1 --2- 172.21.15.80:0/3967373325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6dd00b5c90 0x7f6dd00caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.020+0000 7f6dcf400700 1 -- 172.21.15.80:0/3967373325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6dd0158c70 msgr2=0x7f6dd00cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.020+0000 7f6dcf400700 1 --2- 172.21.15.80:0/3967373325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6dd0158c70 0x7f6dd00cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.020+0000 7f6dcf400700 1 -- 172.21.15.80:0/3967373325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc8009b30 con 0x7f6dd0162000 2024-05-10T04:27:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.021+0000 7f6dcf400700 1 --2- 172.21.15.80:0/3967373325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dd0162000 0x7f6dd01e94f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8012000 tx=0x7f6dc8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.021+0000 7f6dc7400700 1 -- 172.21.15.80:0/3967373325 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8004800 con 0x7f6dd0162000 2024-05-10T04:27:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.021+0000 7f6dc7400700 1 -- 172.21.15.80:0/3967373325 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc8004960 con 0x7f6dd0162000 2024-05-10T04:27:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.021+0000 7f6dd5e00700 1 -- 172.21.15.80:0/3967373325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd00ca130 con 0x7f6dd0162000 2024-05-10T04:27:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.021+0000 7f6dc7400700 1 -- 172.21.15.80:0/3967373325 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc801b670 con 0x7f6dd0162000 2024-05-10T04:27:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.021+0000 7f6dd5e00700 1 -- 172.21.15.80:0/3967373325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd01e8a10 con 0x7f6dd0162000 2024-05-10T04:27:00.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.022+0000 7f6dd5e00700 1 -- 172.21.15.80:0/3967373325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd00732b0 con 0x7f6dd0162000 2024-05-10T04:27:00.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.023+0000 7f6dc7400700 1 -- 172.21.15.80:0/3967373325 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6dc801b7d0 con 0x7f6dd0162000 2024-05-10T04:27:00.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.024+0000 7f6dc7400700 1 --2- 172.21.15.80:0/3967373325 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6dac06ac90 0x7f6dac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.025+0000 7f6dc7400700 1 -- 172.21.15.80:0/3967373325 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6dc808a250 con 0x7f6dd0162000 2024-05-10T04:27:00.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.025+0000 7f6dcea00700 1 --2- 172.21.15.80:0/3967373325 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6dac06ac90 0x7f6dac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.026+0000 7f6dcea00700 1 --2- 172.21.15.80:0/3967373325 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6dac06ac90 0x7f6dac06d1a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6dd00d2210 tx=0x7f6dc0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:00.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.029+0000 7f6dc7400700 1 -- 172.21.15.80:0/3967373325 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6dc8055740 con 0x7f6dd0162000 2024-05-10T04:27:00.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.236+0000 7f6dd5e00700 1 -- 172.21.15.80:0/3967373325 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6dd006c280 con 0x7f6dac06ac90 2024-05-10T04:27:00.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.237+0000 7f6dc7400700 1 -- 172.21.15.80:0/3967373325 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6dc0004030 con 0x7f6dac06ac90 2024-05-10T04:27:00.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.239+0000 7f6dd5e00700 1 -- 172.21.15.80:0/3967373325 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6dac06ac90 msgr2=0x7f6dac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.239+0000 7f6dd5e00700 1 --2- 172.21.15.80:0/3967373325 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6dac06ac90 0x7f6dac06d1a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6dd00d2210 tx=0x7f6dc0008040 comp rx=0 tx=0).stop 2024-05-10T04:27:00.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.239+0000 7f6dd5e00700 1 -- 172.21.15.80:0/3967373325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dd0162000 msgr2=0x7f6dd01e94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.239+0000 7f6dd5e00700 1 --2- 172.21.15.80:0/3967373325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dd0162000 0x7f6dd01e94f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8012000 tx=0x7f6dc8004ad0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.239+0000 7f6dd5e00700 1 -- 172.21.15.80:0/3967373325 shutdown_connections 2024-05-10T04:27:00.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.239+0000 7f6dd5e00700 1 --2- 172.21.15.80:0/3967373325 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f6dac06ac90 0x7f6dac06d1a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.239+0000 7f6dd5e00700 1 --2- 172.21.15.80:0/3967373325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dd0162000 0x7f6dd01e94f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.239+0000 7f6dd5e00700 1 --2- 172.21.15.80:0/3967373325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6dd00b5c90 0x7f6dd00caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.239+0000 7f6dd5e00700 1 --2- 172.21.15.80:0/3967373325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6dd0158c70 0x7f6dd00cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.239+0000 7f6dd5e00700 1 -- 172.21.15.80:0/3967373325 >> 172.21.15.80:0/3967373325 conn(0x7f6dd00d0d30 msgr2=0x7f6dd00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:00.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.239+0000 7f6dd5e00700 1 -- 172.21.15.80:0/3967373325 shutdown_connections 2024-05-10T04:27:00.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.239+0000 7f6dd5e00700 1 -- 172.21.15.80:0/3967373325 wait complete. 2024-05-10T04:27:00.241 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 3 to deep-scrub 2024-05-10T04:27:00.267 INFO:tasks.ceph:Scrubbing osd.4 2024-05-10T04:27:00.267 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-10T04:27:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.529+0000 7fd64bc00700 1 Processor -- start 2024-05-10T04:27:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.529+0000 7fd64bc00700 1 -- start start 2024-05-10T04:27:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.531+0000 7fd64bc00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd64415e5e0 0x7fd644161f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.531+0000 7fd64bc00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd6440cea50 0x7fd6440b7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.531+0000 7fd64bc00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6441626b0 con 0x7fd6440b5c10 2024-05-10T04:27:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.531+0000 7fd64bc00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6440cada0 con 0x7fd64415e5e0 2024-05-10T04:27:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.531+0000 7fd64bc00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6441624a0 con 0x7fd6440cea50 2024-05-10T04:27:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.531+0000 7fd649200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd64415e5e0 0x7fd644161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.531+0000 7fd643e00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd6440cea50 0x7fd6440b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.531+0000 7fd649c00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd6440b5c10 0x7fd6440b6020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45306/0 (socket says 172.21.15.80:45306) 2024-05-10T04:27:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.531+0000 7fd649200700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd64415e5e0 0x7fd644161f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44840/0 (socket says 172.21.15.80:44840) 2024-05-10T04:27:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.531+0000 7fd649c00700 1 -- 172.21.15.80:0/2334820509 learned_addr learned my addr 172.21.15.80:0/2334820509 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:27:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.531+0000 7fd649200700 1 -- 172.21.15.80:0/2334820509 >> v2:172.21.15.106:3300/0 conn(0x7fd6440cea50 msgr2=0x7fd6440b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:27:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.532+0000 7fd649200700 1 --2- 172.21.15.80:0/2334820509 >> v2:172.21.15.106:3300/0 conn(0x7fd6440cea50 0x7fd6440b7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.532+0000 7fd649200700 1 -- 172.21.15.80:0/2334820509 >> v1:172.21.15.80:6789/0 conn(0x7fd6440b5c10 legacy=0x7fd6440b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.532+0000 7fd649200700 1 -- 172.21.15.80:0/2334820509 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd644162990 con 0x7fd64415e5e0 2024-05-10T04:27:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.532+0000 7fd643400700 1 -- 172.21.15.80:0/2334820509 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163194512 0 0) 0x7fd6441626b0 con 0x7fd6440b5c10 2024-05-10T04:27:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.532+0000 7fd649200700 1 --2- 172.21.15.80:0/2334820509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd64415e5e0 0x7fd644161f60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd6440d1b90 tx=0x7fd638009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f01e954f0f5599f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.532+0000 7fd643400700 1 -- 172.21.15.80:0/2334820509 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638011830 con 0x7fd64415e5e0 2024-05-10T04:27:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.532+0000 7fd643400700 1 -- 172.21.15.80:0/2334820509 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd638011990 con 0x7fd64415e5e0 2024-05-10T04:27:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.532+0000 7fd643400700 1 -- 172.21.15.80:0/2334820509 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638011d20 con 0x7fd64415e5e0 2024-05-10T04:27:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.533+0000 7fd64bc00700 1 -- 172.21.15.80:0/2334820509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd64415e5e0 msgr2=0x7fd644161f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.533+0000 7fd64bc00700 1 --2- 172.21.15.80:0/2334820509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd64415e5e0 0x7fd644161f60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd6440d1b90 tx=0x7fd638009b20 comp rx=0 tx=0).stop 2024-05-10T04:27:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.533+0000 7fd64bc00700 1 -- 172.21.15.80:0/2334820509 shutdown_connections 2024-05-10T04:27:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.533+0000 7fd64bc00700 1 --2- 172.21.15.80:0/2334820509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd64415e5e0 0x7fd644161f60 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.533+0000 7fd64bc00700 1 --2- 172.21.15.80:0/2334820509 >> v2:172.21.15.106:3300/0 conn(0x7fd6440cea50 0x7fd6440b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.533+0000 7fd64bc00700 1 -- 172.21.15.80:0/2334820509 >> 172.21.15.80:0/2334820509 conn(0x7fd6440d0cd0 msgr2=0x7fd6440d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:00.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.533+0000 7fd64bc00700 1 -- 172.21.15.80:0/2334820509 shutdown_connections 2024-05-10T04:27:00.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.533+0000 7fd64bc00700 1 -- 172.21.15.80:0/2334820509 wait complete. 2024-05-10T04:27:00.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.535+0000 7fd64bc00700 1 Processor -- start 2024-05-10T04:27:00.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.535+0000 7fd64bc00700 1 -- start start 2024-05-10T04:27:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.537+0000 7fd64bc00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6440b5c10 0x7fd6440c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.537+0000 7fd64bc00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6440cea50 0x7fd6441e83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.537+0000 7fd64bc00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd64415e5e0 0x7fd64415ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.537+0000 7fd64bc00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64415faa0 con 0x7fd64415e5e0 2024-05-10T04:27:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.537+0000 7fd64bc00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440cc8e0 con 0x7fd6440cea50 2024-05-10T04:27:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.537+0000 7fd64bc00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440c9f80 con 0x7fd6440b5c10 2024-05-10T04:27:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.537+0000 7fd649c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd64415e5e0 0x7fd64415ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.537+0000 7fd649c00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd64415e5e0 0x7fd64415ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44852/0 (socket says 172.21.15.80:44852) 2024-05-10T04:27:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.537+0000 7fd649c00700 1 -- 172.21.15.80:0/4183502567 learned_addr learned my addr 172.21.15.80:0/4183502567 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:27:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.537+0000 7fd649200700 1 --2- 172.21.15.80:0/4183502567 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6440b5c10 0x7fd6440c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.537+0000 7fd643e00700 1 --2- 172.21.15.80:0/4183502567 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6440cea50 0x7fd6441e83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.538+0000 7fd649c00700 1 -- 172.21.15.80:0/4183502567 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6440b5c10 msgr2=0x7fd6440c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.538+0000 7fd649c00700 1 --2- 172.21.15.80:0/4183502567 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6440b5c10 0x7fd6440c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.538+0000 7fd649c00700 1 -- 172.21.15.80:0/4183502567 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6440cea50 msgr2=0x7fd6441e83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.538+0000 7fd649c00700 1 --2- 172.21.15.80:0/4183502567 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6440cea50 0x7fd6441e83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.538+0000 7fd649c00700 1 -- 172.21.15.80:0/4183502567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6380094a0 con 0x7fd64415e5e0 2024-05-10T04:27:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.538+0000 7fd649c00700 1 --2- 172.21.15.80:0/4183502567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd64415e5e0 0x7fd64415ea20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00cb60 tx=0x7fd63c00ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.538+0000 7fd640c00700 1 -- 172.21.15.80:0/4183502567 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c00a9e0 con 0x7fd64415e5e0 2024-05-10T04:27:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.538+0000 7fd640c00700 1 -- 172.21.15.80:0/4183502567 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63c00ab40 con 0x7fd64415e5e0 2024-05-10T04:27:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.538+0000 7fd640c00700 1 -- 172.21.15.80:0/4183502567 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c0070d0 con 0x7fd64415e5e0 2024-05-10T04:27:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.538+0000 7fd64bc00700 1 -- 172.21.15.80:0/4183502567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6440ccb30 con 0x7fd64415e5e0 2024-05-10T04:27:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.538+0000 7fd64bc00700 1 -- 172.21.15.80:0/4183502567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6440cd0f0 con 0x7fd64415e5e0 2024-05-10T04:27:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.539+0000 7fd64bc00700 1 -- 172.21.15.80:0/4183502567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6440b7880 con 0x7fd64415e5e0 2024-05-10T04:27:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.540+0000 7fd640c00700 1 -- 172.21.15.80:0/4183502567 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd63c007230 con 0x7fd64415e5e0 2024-05-10T04:27:00.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.541+0000 7fd640c00700 1 --2- 172.21.15.80:0/4183502567 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd62406ac90 0x7fd62406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.541+0000 7fd640c00700 1 -- 172.21.15.80:0/4183502567 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd63c088930 con 0x7fd64415e5e0 2024-05-10T04:27:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.541+0000 7fd640c00700 1 --2- 172.21.15.80:0/4183502567 >> [v2:172.21.15.106:6800/41891,v1:172.21.15.106:6801/41891] conn(0x7fd624070b40 0x7fd624072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.541+0000 7fd640c00700 1 -- 172.21.15.80:0/4183502567 --> [v2:172.21.15.106:6800/41891,v1:172.21.15.106:6801/41891] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd624073680 con 0x7fd624070b40 2024-05-10T04:27:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.541+0000 7fd640c00700 1 -- 172.21.15.80:0/4183502567 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd63c08d2c0 con 0x7fd64415e5e0 2024-05-10T04:27:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.542+0000 7fd649200700 1 --2- 172.21.15.80:0/4183502567 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd62406ac90 0x7fd62406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.542+0000 7fd643e00700 1 --2- 172.21.15.80:0/4183502567 >> [v2:172.21.15.106:6800/41891,v1:172.21.15.106:6801/41891] conn(0x7fd624070b40 0x7fd624072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.543+0000 7fd643e00700 1 --2- 172.21.15.80:0/4183502567 >> [v2:172.21.15.106:6800/41891,v1:172.21.15.106:6801/41891] conn(0x7fd624070b40 0x7fd624072fb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.543+0000 7fd649200700 1 --2- 172.21.15.80:0/4183502567 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd62406ac90 0x7fd62406d1a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd6440d1b90 tx=0x7fd638008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.544+0000 7fd640c00700 1 -- 172.21.15.80:0/4183502567 <== osd.4 v2:172.21.15.106:6800/41891 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd624073680 con 0x7fd624070b40 2024-05-10T04:27:00.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.559+0000 7fd64bc00700 1 -- 172.21.15.80:0/4183502567 --> [v2:172.21.15.106:6800/41891,v1:172.21.15.106:6801/41891] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd6440d2640 con 0x7fd624070b40 2024-05-10T04:27:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.560+0000 7fd640c00700 1 -- 172.21.15.80:0/4183502567 <== osd.4 v2:172.21.15.106:6800/41891 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd630009bd0 con 0x7fd624070b40 2024-05-10T04:27:00.561 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-10T04:27:00.561 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T04:27:00.561 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-10T04:27:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.560+0000 7fd64bc00700 1 -- 172.21.15.80:0/4183502567 >> [v2:172.21.15.106:6800/41891,v1:172.21.15.106:6801/41891] conn(0x7fd624070b40 msgr2=0x7fd624072fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.560+0000 7fd64bc00700 1 --2- 172.21.15.80:0/4183502567 >> [v2:172.21.15.106:6800/41891,v1:172.21.15.106:6801/41891] conn(0x7fd624070b40 0x7fd624072fb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.560+0000 7fd64bc00700 1 -- 172.21.15.80:0/4183502567 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd62406ac90 msgr2=0x7fd62406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.560+0000 7fd64bc00700 1 --2- 172.21.15.80:0/4183502567 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fd62406ac90 0x7fd62406d1a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd6440d1b90 tx=0x7fd638008030 comp rx=0 tx=0).stop 2024-05-10T04:27:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.560+0000 7fd64bc00700 1 -- 172.21.15.80:0/4183502567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd64415e5e0 msgr2=0x7fd64415ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.560+0000 7fd64bc00700 1 --2- 172.21.15.80:0/4183502567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd64415e5e0 0x7fd64415ea20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00cb60 tx=0x7fd63c00ce70 comp rx=0 tx=0).stop 2024-05-10T04:27:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.560+0000 7fd649c00700 1 -- 172.21.15.80:0/4183502567 reap_dead start 2024-05-10T04:27:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.561+0000 7fd64bc00700 1 -- 172.21.15.80:0/4183502567 shutdown_connections 2024-05-10T04:27:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.561+0000 7fd64bc00700 1 -- 172.21.15.80:0/4183502567 >> 172.21.15.80:0/4183502567 conn(0x7fd6440d0cd0 msgr2=0x7fd6440ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.561+0000 7fd64bc00700 1 -- 172.21.15.80:0/4183502567 shutdown_connections 2024-05-10T04:27:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.561+0000 7fd64bc00700 1 -- 172.21.15.80:0/4183502567 wait complete. 2024-05-10T04:27:00.588 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-10T04:27:00.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.851+0000 7f0c96400700 1 Processor -- start 2024-05-10T04:27:00.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.852+0000 7f0c96400700 1 -- start start 2024-05-10T04:27:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.853+0000 7f0c96400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c9015e610 0x7f0c900b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.853+0000 7f0c96400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c900d2c00 con 0x7f0c90162150 2024-05-10T04:27:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.853+0000 7f0c96400700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9015ea20 con 0x7f0c900b7910 2024-05-10T04:27:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.853+0000 7f0c96400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c90162630 con 0x7f0c9015e610 2024-05-10T04:27:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.854+0000 7f0c8f400700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0c90162150 0x7f0c900cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45310/0 (socket says 172.21.15.80:45310) 2024-05-10T04:27:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.854+0000 7f0c8f400700 1 -- 172.21.15.80:0/2336246473 learned_addr learned my addr 172.21.15.80:0/2336246473 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:27:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.854+0000 7f0c8ea00700 1 --2- 172.21.15.80:0/2336246473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c9015e610 0x7f0c900b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.854+0000 7f0c8e000700 1 -- 172.21.15.80:0/2336246473 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980906102 0 0) 0x7f0c900d2c00 con 0x7f0c90162150 2024-05-10T04:27:00.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.854+0000 7f0c8e000700 1 -- 172.21.15.80:0/2336246473 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c740035b0 con 0x7f0c90162150 2024-05-10T04:27:00.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.854+0000 7f0c8e000700 1 -- 172.21.15.80:0/2336246473 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246777639 0 0) 0x7f0c9015ea20 con 0x7f0c900b7910 2024-05-10T04:27:00.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.854+0000 7f0c8e000700 1 -- 172.21.15.80:0/2336246473 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c900d2c00 con 0x7f0c900b7910 2024-05-10T04:27:00.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.854+0000 7f0c8ea00700 1 -- 172.21.15.80:0/2336246473 >> v1:172.21.15.106:6789/0 conn(0x7f0c900b7910 legacy=0x7f0c9006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.854+0000 7f0c8ea00700 1 -- 172.21.15.80:0/2336246473 >> v1:172.21.15.80:6789/0 conn(0x7f0c90162150 legacy=0x7f0c900cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.854+0000 7f0c8ea00700 1 -- 172.21.15.80:0/2336246473 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c90162910 con 0x7f0c9015e610 2024-05-10T04:27:00.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.855+0000 7f0c8ea00700 1 --2- 172.21.15.80:0/2336246473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c9015e610 0x7f0c900b73d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009870 tx=0x7f0c7c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff560f3f58b1bee7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:00.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.855+0000 7f0c8e000700 1 -- 172.21.15.80:0/2336246473 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c011830 con 0x7f0c9015e610 2024-05-10T04:27:00.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.855+0000 7f0c8e000700 1 -- 172.21.15.80:0/2336246473 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c011990 con 0x7f0c9015e610 2024-05-10T04:27:00.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.855+0000 7f0c8e000700 1 -- 172.21.15.80:0/2336246473 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c011d20 con 0x7f0c9015e610 2024-05-10T04:27:00.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.856+0000 7f0c96400700 1 -- 172.21.15.80:0/2336246473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c9015e610 msgr2=0x7f0c900b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.856+0000 7f0c96400700 1 --2- 172.21.15.80:0/2336246473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c9015e610 0x7f0c900b73d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009870 tx=0x7f0c7c009b80 comp rx=0 tx=0).stop 2024-05-10T04:27:00.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.856+0000 7f0c96400700 1 -- 172.21.15.80:0/2336246473 shutdown_connections 2024-05-10T04:27:00.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.856+0000 7f0c96400700 1 --2- 172.21.15.80:0/2336246473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c9015e610 0x7f0c900b73d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.856+0000 7f0c96400700 1 -- 172.21.15.80:0/2336246473 >> 172.21.15.80:0/2336246473 conn(0x7f0c900d3e10 msgr2=0x7f0c900d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:00.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.856+0000 7f0c96400700 1 -- 172.21.15.80:0/2336246473 shutdown_connections 2024-05-10T04:27:00.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.856+0000 7f0c96400700 1 -- 172.21.15.80:0/2336246473 wait complete. 2024-05-10T04:27:00.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.858+0000 7f0c96400700 1 Processor -- start 2024-05-10T04:27:00.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.858+0000 7f0c96400700 1 -- start start 2024-05-10T04:27:00.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.860+0000 7f0c96400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c900b7910 0x7f0c901520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.860+0000 7f0c96400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c9015e610 0x7f0c90161200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.860+0000 7f0c96400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c90162150 0x7f0c90152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.860+0000 7f0c96400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c901525f0 con 0x7f0c900b7910 2024-05-10T04:27:00.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.860+0000 7f0c96400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c90156010 con 0x7f0c90162150 2024-05-10T04:27:00.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.860+0000 7f0c96400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c90153710 con 0x7f0c9015e610 2024-05-10T04:27:00.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.860+0000 7f0c8f400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c900b7910 0x7f0c901520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.860+0000 7f0c8f400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c900b7910 0x7f0c901520b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44854/0 (socket says 172.21.15.80:44854) 2024-05-10T04:27:00.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.860+0000 7f0c8f400700 1 -- 172.21.15.80:0/1436532868 learned_addr learned my addr 172.21.15.80:0/1436532868 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:27:00.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.860+0000 7f0c8ea00700 1 --2- 172.21.15.80:0/1436532868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c9015e610 0x7f0c90161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.860+0000 7f0c8fe00700 1 --2- 172.21.15.80:0/1436532868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c90162150 0x7f0c90152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.860+0000 7f0c8f400700 1 -- 172.21.15.80:0/1436532868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c9015e610 msgr2=0x7f0c90161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.860+0000 7f0c8f400700 1 --2- 172.21.15.80:0/1436532868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c9015e610 0x7f0c90161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.860+0000 7f0c8f400700 1 -- 172.21.15.80:0/1436532868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c90162150 msgr2=0x7f0c90152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:00.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.860+0000 7f0c8f400700 1 --2- 172.21.15.80:0/1436532868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c90162150 0x7f0c90152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:00.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.861+0000 7f0c8f400700 1 -- 172.21.15.80:0/1436532868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c0094a0 con 0x7f0c900b7910 2024-05-10T04:27:00.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.861+0000 7f0c8f400700 1 --2- 172.21.15.80:0/1436532868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c900b7910 0x7f0c901520b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0c80001eb0 tx=0x7f0c8000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:00.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.861+0000 7f0c87400700 1 -- 172.21.15.80:0/1436532868 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c80005d70 con 0x7f0c900b7910 2024-05-10T04:27:00.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.861+0000 7f0c87400700 1 -- 172.21.15.80:0/1436532868 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c800070d0 con 0x7f0c900b7910 2024-05-10T04:27:00.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.861+0000 7f0c96400700 1 -- 172.21.15.80:0/1436532868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c901f8af0 con 0x7f0c900b7910 2024-05-10T04:27:00.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.861+0000 7f0c87400700 1 -- 172.21.15.80:0/1436532868 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c80007460 con 0x7f0c900b7910 2024-05-10T04:27:00.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.861+0000 7f0c96400700 1 -- 172.21.15.80:0/1436532868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c90160720 con 0x7f0c900b7910 2024-05-10T04:27:00.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.863+0000 7f0c96400700 1 -- 172.21.15.80:0/1436532868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c90161050 con 0x7f0c900b7910 2024-05-10T04:27:00.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.863+0000 7f0c87400700 1 -- 172.21.15.80:0/1436532868 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0c800075c0 con 0x7f0c900b7910 2024-05-10T04:27:00.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.865+0000 7f0c87400700 1 --2- 172.21.15.80:0/1436532868 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0c7006ac90 0x7f0c7006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:00.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.865+0000 7f0c87400700 1 -- 172.21.15.80:0/1436532868 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0c80088530 con 0x7f0c900b7910 2024-05-10T04:27:00.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.865+0000 7f0c8ea00700 1 --2- 172.21.15.80:0/1436532868 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0c7006ac90 0x7f0c7006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:00.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.866+0000 7f0c8ea00700 1 --2- 172.21.15.80:0/1436532868 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0c7006ac90 0x7f0c7006d1a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0097c0 tx=0x7f0c7c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:00.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:00.869+0000 7f0c87400700 1 -- 172.21.15.80:0/1436532868 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0c800538e0 con 0x7f0c900b7910 2024-05-10T04:27:01.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.071+0000 7f0c96400700 1 -- 172.21.15.80:0/1436532868 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c901605a0 con 0x7f0c7006ac90 2024-05-10T04:27:01.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.072+0000 7f0c87400700 1 -- 172.21.15.80:0/1436532868 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0c7c011bb0 con 0x7f0c7006ac90 2024-05-10T04:27:01.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.074+0000 7f0c96400700 1 -- 172.21.15.80:0/1436532868 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0c7006ac90 msgr2=0x7f0c7006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:01.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.074+0000 7f0c96400700 1 --2- 172.21.15.80:0/1436532868 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0c7006ac90 0x7f0c7006d1a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0097c0 tx=0x7f0c7c01c040 comp rx=0 tx=0).stop 2024-05-10T04:27:01.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.074+0000 7f0c96400700 1 -- 172.21.15.80:0/1436532868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c900b7910 msgr2=0x7f0c901520b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:01.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.074+0000 7f0c96400700 1 --2- 172.21.15.80:0/1436532868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c900b7910 0x7f0c901520b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0c80001eb0 tx=0x7f0c8000c7b0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.074+0000 7f0c96400700 1 -- 172.21.15.80:0/1436532868 shutdown_connections 2024-05-10T04:27:01.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.074+0000 7f0c96400700 1 --2- 172.21.15.80:0/1436532868 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f0c7006ac90 0x7f0c7006d1a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.074+0000 7f0c96400700 1 --2- 172.21.15.80:0/1436532868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c900b7910 0x7f0c901520b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.074+0000 7f0c96400700 1 --2- 172.21.15.80:0/1436532868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c90162150 0x7f0c90152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.074+0000 7f0c96400700 1 --2- 172.21.15.80:0/1436532868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c9015e610 0x7f0c90161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.074+0000 7f0c96400700 1 -- 172.21.15.80:0/1436532868 >> 172.21.15.80:0/1436532868 conn(0x7f0c900d3e10 msgr2=0x7f0c900b4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:01.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.074+0000 7f0c96400700 1 -- 172.21.15.80:0/1436532868 shutdown_connections 2024-05-10T04:27:01.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.074+0000 7f0c96400700 1 -- 172.21.15.80:0/1436532868 wait complete. 2024-05-10T04:27:01.078 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 4 to deep-scrub 2024-05-10T04:27:01.100 INFO:tasks.ceph:Scrubbing osd.5 2024-05-10T04:27:01.101 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-10T04:27:01.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.363+0000 7fa4c1a00700 1 Processor -- start 2024-05-10T04:27:01.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.363+0000 7fa4c1a00700 1 -- start start 2024-05-10T04:27:01.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.364+0000 7fa4c1a00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa4bc0cf130 0x7fa4bc162b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:01.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.364+0000 7fa4c1a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4bc06ccb0 0x7fa4bc15e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:01.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.364+0000 7fa4c1a00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc162700 con 0x7fa4bc0d0710 2024-05-10T04:27:01.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.364+0000 7fa4c1a00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4bc06d0c0 con 0x7fa4bc0cf130 2024-05-10T04:27:01.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.364+0000 7fa4c1a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc15e990 con 0x7fa4bc06ccb0 2024-05-10T04:27:01.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.365+0000 7fa4baa00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa4bc0cf130 0x7fa4bc162b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:01.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.365+0000 7fa4b3e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4bc06ccb0 0x7fa4bc15e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:01.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.365+0000 7fa4bb400700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa4bc0d0710 0x7fa4bc0d0b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:43586/0 (socket says 172.21.15.80:43586) 2024-05-10T04:27:01.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.365+0000 7fa4bb400700 1 -- 172.21.15.80:0/2716314824 learned_addr learned my addr 172.21.15.80:0/2716314824 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:27:01.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.365+0000 7fa4ba000700 1 -- 172.21.15.80:0/2716314824 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337765199 0 0) 0x7fa4bc162700 con 0x7fa4bc0d0710 2024-05-10T04:27:01.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.366+0000 7fa4ba000700 1 -- 172.21.15.80:0/2716314824 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a00035b0 con 0x7fa4bc0d0710 2024-05-10T04:27:01.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.366+0000 7fa4b3e00700 1 -- 172.21.15.80:0/2716314824 >> v2:172.21.15.106:3300/0 conn(0x7fa4bc0cf130 msgr2=0x7fa4bc162b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:27:01.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.366+0000 7fa4b3e00700 1 --2- 172.21.15.80:0/2716314824 >> v2:172.21.15.106:3300/0 conn(0x7fa4bc0cf130 0x7fa4bc162b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.366+0000 7fa4b3e00700 1 -- 172.21.15.80:0/2716314824 >> v1:172.21.15.106:6789/0 conn(0x7fa4bc0d0710 legacy=0x7fa4bc0d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:01.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.366+0000 7fa4b3e00700 1 -- 172.21.15.80:0/2716314824 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc0cf5f0 con 0x7fa4bc06ccb0 2024-05-10T04:27:01.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.366+0000 7fa4baa00700 1 --2- 172.21.15.80:0/2716314824 >> v2:172.21.15.106:3300/0 conn(0x7fa4bc0cf130 0x7fa4bc162b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:27:01.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.366+0000 7fa4b3e00700 1 --2- 172.21.15.80:0/2716314824 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4bc06ccb0 0x7fa4bc15e450 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009840 tx=0x7fa4a4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf77739618b3213 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:01.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.366+0000 7fa4ba000700 1 -- 172.21.15.80:0/2716314824 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4011830 con 0x7fa4bc06ccb0 2024-05-10T04:27:01.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.366+0000 7fa4ba000700 1 -- 172.21.15.80:0/2716314824 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a4011990 con 0x7fa4bc06ccb0 2024-05-10T04:27:01.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.366+0000 7fa4ba000700 1 -- 172.21.15.80:0/2716314824 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4011d00 con 0x7fa4bc06ccb0 2024-05-10T04:27:01.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.367+0000 7fa4c1a00700 1 -- 172.21.15.80:0/2716314824 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4bc06ccb0 msgr2=0x7fa4bc15e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:01.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.367+0000 7fa4c1a00700 1 --2- 172.21.15.80:0/2716314824 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4bc06ccb0 0x7fa4bc15e450 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009840 tx=0x7fa4a4009b50 comp rx=0 tx=0).stop 2024-05-10T04:27:01.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.367+0000 7fa4c1a00700 1 -- 172.21.15.80:0/2716314824 shutdown_connections 2024-05-10T04:27:01.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.367+0000 7fa4c1a00700 1 --2- 172.21.15.80:0/2716314824 >> v2:172.21.15.106:3300/0 conn(0x7fa4bc0cf130 0x7fa4bc162b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.367+0000 7fa4c1a00700 1 --2- 172.21.15.80:0/2716314824 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4bc06ccb0 0x7fa4bc15e450 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.367+0000 7fa4c1a00700 1 -- 172.21.15.80:0/2716314824 >> 172.21.15.80:0/2716314824 conn(0x7fa4bc0b5c00 msgr2=0x7fa4bc0b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:01.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.367+0000 7fa4c1a00700 1 -- 172.21.15.80:0/2716314824 shutdown_connections 2024-05-10T04:27:01.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.367+0000 7fa4c1a00700 1 -- 172.21.15.80:0/2716314824 wait complete. 2024-05-10T04:27:01.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.369+0000 7fa4c1a00700 1 Processor -- start 2024-05-10T04:27:01.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.370+0000 7fa4c1a00700 1 -- start start 2024-05-10T04:27:01.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.371+0000 7fa4c1a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4bc06ccb0 0x7fa4bc1ea060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:01.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.371+0000 7fa4c1a00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4bc0d0710 0x7fa4bc1f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:01.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.371+0000 7fa4c1a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4bc155f30 0x7fa4bc155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:01.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.371+0000 7fa4c1a00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc157320 con 0x7fa4bc155f30 2024-05-10T04:27:01.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.371+0000 7fa4c1a00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc1f4ac0 con 0x7fa4bc0d0710 2024-05-10T04:27:01.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.371+0000 7fa4c1a00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc156450 con 0x7fa4bc06ccb0 2024-05-10T04:27:01.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.372+0000 7fa4bb400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4bc155f30 0x7fa4bc155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:01.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.372+0000 7fa4bb400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4bc155f30 0x7fa4bc155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44862/0 (socket says 172.21.15.80:44862) 2024-05-10T04:27:01.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.372+0000 7fa4bb400700 1 -- 172.21.15.80:0/3183489296 learned_addr learned my addr 172.21.15.80:0/3183489296 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:27:01.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.372+0000 7fa4baa00700 1 --2- 172.21.15.80:0/3183489296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4bc06ccb0 0x7fa4bc1ea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:01.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.372+0000 7fa4b3e00700 1 --2- 172.21.15.80:0/3183489296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4bc0d0710 0x7fa4bc1f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:01.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.372+0000 7fa4bb400700 1 -- 172.21.15.80:0/3183489296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4bc06ccb0 msgr2=0x7fa4bc1ea060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:01.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.372+0000 7fa4bb400700 1 --2- 172.21.15.80:0/3183489296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4bc06ccb0 0x7fa4bc1ea060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.372+0000 7fa4bb400700 1 -- 172.21.15.80:0/3183489296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4bc0d0710 msgr2=0x7fa4bc1f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:01.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.372+0000 7fa4bb400700 1 --2- 172.21.15.80:0/3183489296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4bc0d0710 0x7fa4bc1f4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.372+0000 7fa4bb400700 1 -- 172.21.15.80:0/3183489296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac0094a0 con 0x7fa4bc155f30 2024-05-10T04:27:01.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.372+0000 7fa4bb400700 1 --2- 172.21.15.80:0/3183489296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4bc155f30 0x7fa4bc155650 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400cad0 tx=0x7fa4b400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:01.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.373+0000 7fa4b2a00700 1 -- 172.21.15.80:0/3183489296 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400a9a0 con 0x7fa4bc155f30 2024-05-10T04:27:01.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.373+0000 7fa4b2a00700 1 -- 172.21.15.80:0/3183489296 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b400ab00 con 0x7fa4bc155f30 2024-05-10T04:27:01.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.373+0000 7fa4c1a00700 1 -- 172.21.15.80:0/3183489296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a40094a0 con 0x7fa4bc155f30 2024-05-10T04:27:01.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.373+0000 7fa4b2a00700 1 -- 172.21.15.80:0/3183489296 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400ae90 con 0x7fa4bc155f30 2024-05-10T04:27:01.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.373+0000 7fa4c1a00700 1 -- 172.21.15.80:0/3183489296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc1f4650 con 0x7fa4bc155f30 2024-05-10T04:27:01.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.373+0000 7fa4c1a00700 1 -- 172.21.15.80:0/3183489296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa4bc162390 con 0x7fa4bc155f30 2024-05-10T04:27:01.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.375+0000 7fa4b2a00700 1 -- 172.21.15.80:0/3183489296 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa4b401b3b0 con 0x7fa4bc155f30 2024-05-10T04:27:01.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.375+0000 7fa4b2a00700 1 --2- 172.21.15.80:0/3183489296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa49806ac90 0x7fa49806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:01.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.376+0000 7fa4b2a00700 1 -- 172.21.15.80:0/3183489296 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa4b4088e00 con 0x7fa4bc155f30 2024-05-10T04:27:01.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.376+0000 7fa4b2a00700 1 --2- 172.21.15.80:0/3183489296 >> [v2:172.21.15.106:6824/41894,v1:172.21.15.106:6825/41894] conn(0x7fa4980709d0 0x7fa498072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:01.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.376+0000 7fa4b2a00700 1 -- 172.21.15.80:0/3183489296 --> [v2:172.21.15.106:6824/41894,v1:172.21.15.106:6825/41894] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa498073510 con 0x7fa4980709d0 2024-05-10T04:27:01.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.376+0000 7fa4b2a00700 1 -- 172.21.15.80:0/3183489296 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4b408b3e0 con 0x7fa4bc155f30 2024-05-10T04:27:01.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.376+0000 7fa4baa00700 1 --2- 172.21.15.80:0/3183489296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa49806ac90 0x7fa49806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:01.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.376+0000 7fa4b3e00700 1 --2- 172.21.15.80:0/3183489296 >> [v2:172.21.15.106:6824/41894,v1:172.21.15.106:6825/41894] conn(0x7fa4980709d0 0x7fa498072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:01.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.377+0000 7fa4baa00700 1 --2- 172.21.15.80:0/3183489296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa49806ac90 0x7fa49806d1a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009cd0 tx=0x7fa4ac009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:01.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.377+0000 7fa4b3e00700 1 --2- 172.21.15.80:0/3183489296 >> [v2:172.21.15.106:6824/41894,v1:172.21.15.106:6825/41894] conn(0x7fa4980709d0 0x7fa498072e40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:01.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.378+0000 7fa4b2a00700 1 -- 172.21.15.80:0/3183489296 <== osd.5 v2:172.21.15.106:6824/41894 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa498073510 con 0x7fa4980709d0 2024-05-10T04:27:01.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.394+0000 7fa4c1a00700 1 -- 172.21.15.80:0/3183489296 --> [v2:172.21.15.106:6824/41894,v1:172.21.15.106:6825/41894] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa4bc1620b0 con 0x7fa4980709d0 2024-05-10T04:27:01.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.394+0000 7fa4b2a00700 1 -- 172.21.15.80:0/3183489296 <== osd.5 v2:172.21.15.106:6824/41894 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa4a4021040 con 0x7fa4980709d0 2024-05-10T04:27:01.396 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-10T04:27:01.396 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T04:27:01.396 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-10T04:27:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.395+0000 7fa4c1a00700 1 -- 172.21.15.80:0/3183489296 >> [v2:172.21.15.106:6824/41894,v1:172.21.15.106:6825/41894] conn(0x7fa4980709d0 msgr2=0x7fa498072e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.395+0000 7fa4c1a00700 1 --2- 172.21.15.80:0/3183489296 >> [v2:172.21.15.106:6824/41894,v1:172.21.15.106:6825/41894] conn(0x7fa4980709d0 0x7fa498072e40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.395+0000 7fa4c1a00700 1 -- 172.21.15.80:0/3183489296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa49806ac90 msgr2=0x7fa49806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.395+0000 7fa4c1a00700 1 --2- 172.21.15.80:0/3183489296 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fa49806ac90 0x7fa49806d1a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009cd0 tx=0x7fa4ac009210 comp rx=0 tx=0).stop 2024-05-10T04:27:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.395+0000 7fa4c1a00700 1 -- 172.21.15.80:0/3183489296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4bc155f30 msgr2=0x7fa4bc155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.395+0000 7fa4c1a00700 1 --2- 172.21.15.80:0/3183489296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4bc155f30 0x7fa4bc155650 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400cad0 tx=0x7fa4b400cde0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.395+0000 7fa4bb400700 1 -- 172.21.15.80:0/3183489296 reap_dead start 2024-05-10T04:27:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.395+0000 7fa4c1a00700 1 -- 172.21.15.80:0/3183489296 shutdown_connections 2024-05-10T04:27:01.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.395+0000 7fa4c1a00700 1 -- 172.21.15.80:0/3183489296 >> 172.21.15.80:0/3183489296 conn(0x7fa4bc0b5c00 msgr2=0x7fa4bc0b96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:01.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.395+0000 7fa4c1a00700 1 -- 172.21.15.80:0/3183489296 shutdown_connections 2024-05-10T04:27:01.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.395+0000 7fa4c1a00700 1 -- 172.21.15.80:0/3183489296 wait complete. 2024-05-10T04:27:01.421 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-10T04:27:01.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.684+0000 7f4297e00700 1 Processor -- start 2024-05-10T04:27:01.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.685+0000 7f4297e00700 1 -- start start 2024-05-10T04:27:01.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.686+0000 7f4297e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42980b98e0 0x7f42980d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:01.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.686+0000 7f4297e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42980d0c90 0x7f429815d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:01.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.686+0000 7f4297e00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42980d2e50 con 0x7f42980b6230 2024-05-10T04:27:01.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.686+0000 7f4297e00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42980d3130 con 0x7f42980b98e0 2024-05-10T04:27:01.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.686+0000 7f4297e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42980d3410 con 0x7f42980d0c90 2024-05-10T04:27:01.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.687+0000 7f4296a00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42980b98e0 0x7f42980d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:01.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.687+0000 7f428fe00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f42980b6230 0x7f42980d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45326/0 (socket says 172.21.15.80:45326) 2024-05-10T04:27:01.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.687+0000 7f428fe00700 1 -- 172.21.15.80:0/918939113 learned_addr learned my addr 172.21.15.80:0/918939113 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:27:01.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.687+0000 7f4297400700 1 --2- 172.21.15.80:0/918939113 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42980d0c90 0x7f429815d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:01.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.687+0000 7f4296a00700 1 -- 172.21.15.80:0/918939113 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42980d0c90 msgr2=0x7f429815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:27:01.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.687+0000 7f4296a00700 1 --2- 172.21.15.80:0/918939113 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42980d0c90 0x7f429815d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.687+0000 7f4296a00700 1 -- 172.21.15.80:0/918939113 >> v1:172.21.15.80:6789/0 conn(0x7f42980b6230 legacy=0x7f42980d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:01.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.687+0000 7f4296a00700 1 -- 172.21.15.80:0/918939113 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980b7470 con 0x7f42980b98e0 2024-05-10T04:27:01.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.687+0000 7f4296000700 1 -- 172.21.15.80:0/918939113 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686755295 0 0) 0x7f42980d2e50 con 0x7f42980b6230 2024-05-10T04:27:01.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.687+0000 7f4296a00700 1 --2- 172.21.15.80:0/918939113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42980b98e0 0x7f42980d2520 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4288009840 tx=0x7f4288009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402e9ee968cc72c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:01.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.688+0000 7f4296000700 1 -- 172.21.15.80:0/918939113 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288011830 con 0x7f42980b98e0 2024-05-10T04:27:01.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.688+0000 7f4296000700 1 -- 172.21.15.80:0/918939113 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4288011990 con 0x7f42980b98e0 2024-05-10T04:27:01.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.688+0000 7f4296000700 1 -- 172.21.15.80:0/918939113 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288011d20 con 0x7f42980b98e0 2024-05-10T04:27:01.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.688+0000 7f4297e00700 1 -- 172.21.15.80:0/918939113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42980b98e0 msgr2=0x7f42980d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:01.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.688+0000 7f4297e00700 1 --2- 172.21.15.80:0/918939113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42980b98e0 0x7f42980d2520 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4288009840 tx=0x7f4288009b50 comp rx=0 tx=0).stop 2024-05-10T04:27:01.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.688+0000 7f4297e00700 1 -- 172.21.15.80:0/918939113 shutdown_connections 2024-05-10T04:27:01.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.688+0000 7f4297e00700 1 --2- 172.21.15.80:0/918939113 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42980d0c90 0x7f429815d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.688+0000 7f4297e00700 1 --2- 172.21.15.80:0/918939113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42980b98e0 0x7f42980d2520 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.688+0000 7f4297e00700 1 -- 172.21.15.80:0/918939113 >> 172.21.15.80:0/918939113 conn(0x7f42980676c0 msgr2=0x7f429806c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:01.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.689+0000 7f4297e00700 1 -- 172.21.15.80:0/918939113 shutdown_connections 2024-05-10T04:27:01.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.689+0000 7f4297e00700 1 -- 172.21.15.80:0/918939113 wait complete. 2024-05-10T04:27:01.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.691+0000 7f4297e00700 1 Processor -- start 2024-05-10T04:27:01.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.691+0000 7f4297e00700 1 -- start start 2024-05-10T04:27:01.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.692+0000 7f4297e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42980b6230 0x7f429814bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:01.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.692+0000 7f4297e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42980b98e0 0x7f429814a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:01.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.693+0000 7f4297e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42980d0c90 0x7f4298149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:01.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.693+0000 7f4297e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42981e8710 con 0x7f42980b6230 2024-05-10T04:27:01.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.693+0000 7f4297e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429814ac10 con 0x7f42980b98e0 2024-05-10T04:27:01.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.693+0000 7f4297e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429814ae60 con 0x7f42980d0c90 2024-05-10T04:27:01.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.693+0000 7f4296a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42980b6230 0x7f429814bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:01.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.693+0000 7f4296a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42980b6230 0x7f429814bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44894/0 (socket says 172.21.15.80:44894) 2024-05-10T04:27:01.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.693+0000 7f4296a00700 1 -- 172.21.15.80:0/2243631656 learned_addr learned my addr 172.21.15.80:0/2243631656 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:27:01.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.693+0000 7f4297400700 1 --2- 172.21.15.80:0/2243631656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42980d0c90 0x7f4298149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:01.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.693+0000 7f428fe00700 1 --2- 172.21.15.80:0/2243631656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42980b98e0 0x7f429814a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:01.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.693+0000 7f4296a00700 1 -- 172.21.15.80:0/2243631656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42980d0c90 msgr2=0x7f4298149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:01.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.693+0000 7f4296a00700 1 --2- 172.21.15.80:0/2243631656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42980d0c90 0x7f4298149b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.693+0000 7f4296a00700 1 -- 172.21.15.80:0/2243631656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42980b98e0 msgr2=0x7f429814a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:01.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.693+0000 7f4296a00700 1 --2- 172.21.15.80:0/2243631656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42980b98e0 0x7f429814a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.693+0000 7f4296a00700 1 -- 172.21.15.80:0/2243631656 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42880094a0 con 0x7f42980b6230 2024-05-10T04:27:01.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.694+0000 7f4296a00700 1 --2- 172.21.15.80:0/2243631656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42980b6230 0x7f429814bf00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4288009b90 tx=0x7f4288004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:01.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.694+0000 7f428ea00700 1 -- 172.21.15.80:0/2243631656 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42880036a0 con 0x7f42980b6230 2024-05-10T04:27:01.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.694+0000 7f428ea00700 1 -- 172.21.15.80:0/2243631656 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428801e070 con 0x7f42980b6230 2024-05-10T04:27:01.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.694+0000 7f428ea00700 1 -- 172.21.15.80:0/2243631656 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288003a20 con 0x7f42980b6230 2024-05-10T04:27:01.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.694+0000 7f4297e00700 1 -- 172.21.15.80:0/2243631656 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429814b140 con 0x7f42980b6230 2024-05-10T04:27:01.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.694+0000 7f4297e00700 1 -- 172.21.15.80:0/2243631656 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429814b700 con 0x7f42980b6230 2024-05-10T04:27:01.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.695+0000 7f4297e00700 1 -- 172.21.15.80:0/2243631656 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4298074af0 con 0x7f42980b6230 2024-05-10T04:27:01.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.696+0000 7f428ea00700 1 -- 172.21.15.80:0/2243631656 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4288003b80 con 0x7f42980b6230 2024-05-10T04:27:01.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.697+0000 7f428ea00700 1 --2- 172.21.15.80:0/2243631656 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f427406ac90 0x7f427406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:01.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.697+0000 7f428ea00700 1 -- 172.21.15.80:0/2243631656 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f428808a0f0 con 0x7f42980b6230 2024-05-10T04:27:01.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.697+0000 7f428fe00700 1 --2- 172.21.15.80:0/2243631656 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f427406ac90 0x7f427406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:01.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.698+0000 7f428fe00700 1 --2- 172.21.15.80:0/2243631656 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f427406ac90 0x7f427406d1a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f42981f7950 tx=0x7f4280007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:01.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.702+0000 7f428ea00700 1 -- 172.21.15.80:0/2243631656 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4288055530 con 0x7f42980b6230 2024-05-10T04:27:01.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.905+0000 7f4297e00700 1 -- 172.21.15.80:0/2243631656 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f42981613d0 con 0x7f427406ac90 2024-05-10T04:27:01.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.906+0000 7f428ea00700 1 -- 172.21.15.80:0/2243631656 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f42981613d0 con 0x7f427406ac90 2024-05-10T04:27:01.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.909+0000 7f4297e00700 1 -- 172.21.15.80:0/2243631656 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f427406ac90 msgr2=0x7f427406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:01.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.909+0000 7f4297e00700 1 --2- 172.21.15.80:0/2243631656 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f427406ac90 0x7f427406d1a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f42981f7950 tx=0x7f4280007c90 comp rx=0 tx=0).stop 2024-05-10T04:27:01.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.909+0000 7f4297e00700 1 -- 172.21.15.80:0/2243631656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42980b6230 msgr2=0x7f429814bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:01.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.909+0000 7f4297e00700 1 --2- 172.21.15.80:0/2243631656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42980b6230 0x7f429814bf00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4288009b90 tx=0x7f4288004750 comp rx=0 tx=0).stop 2024-05-10T04:27:01.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.909+0000 7f4297e00700 1 -- 172.21.15.80:0/2243631656 shutdown_connections 2024-05-10T04:27:01.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.909+0000 7f4297e00700 1 --2- 172.21.15.80:0/2243631656 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f427406ac90 0x7f427406d1a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.909+0000 7f4297e00700 1 --2- 172.21.15.80:0/2243631656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42980b6230 0x7f429814bf00 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.909+0000 7f4297e00700 1 --2- 172.21.15.80:0/2243631656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42980d0c90 0x7f4298149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.909+0000 7f4297e00700 1 --2- 172.21.15.80:0/2243631656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42980b98e0 0x7f429814a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:01.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.909+0000 7f4297e00700 1 -- 172.21.15.80:0/2243631656 >> 172.21.15.80:0/2243631656 conn(0x7f42980676c0 msgr2=0x7f429806c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:01.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.909+0000 7f4297e00700 1 -- 172.21.15.80:0/2243631656 shutdown_connections 2024-05-10T04:27:01.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:01.909+0000 7f4297e00700 1 -- 172.21.15.80:0/2243631656 wait complete. 2024-05-10T04:27:01.911 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 5 to deep-scrub 2024-05-10T04:27:01.938 INFO:tasks.ceph:Scrubbing osd.6 2024-05-10T04:27:01.938 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-10T04:27:02.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.201+0000 7f7fe3e00700 1 Processor -- start 2024-05-10T04:27:02.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.201+0000 7f7fe3e00700 1 -- start start 2024-05-10T04:27:02.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.203+0000 7f7fe3e00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7fdc0cf120 0x7f7fdc0cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:02.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.203+0000 7f7fe3e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fdc15a960 0x7f7fdc06e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:02.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.203+0000 7f7fe3e00700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fdc0b4ee0 con 0x7f7fdc071ee0 2024-05-10T04:27:02.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.203+0000 7f7fe3e00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fdc0b2b10 con 0x7f7fdc0cf120 2024-05-10T04:27:02.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.203+0000 7f7fe3e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc0ce000 con 0x7f7fdc15a960 2024-05-10T04:27:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.204+0000 7f7fe0a00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fdc15a960 0x7f7fdc06e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.204+0000 7f7fe1e00700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7fdc071ee0 0x7f7fdc0722f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:43596/0 (socket says 172.21.15.80:43596) 2024-05-10T04:27:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.204+0000 7f7fe1e00700 1 -- 172.21.15.80:0/220964316 learned_addr learned my addr 172.21.15.80:0/220964316 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:27:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.204+0000 7f7fe1400700 1 --2- 172.21.15.80:0/220964316 >> v2:172.21.15.106:3300/0 conn(0x7f7fdc0cf120 0x7f7fdc0cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.204+0000 7f7fe0a00700 1 -- 172.21.15.80:0/220964316 >> v2:172.21.15.106:3300/0 conn(0x7f7fdc0cf120 msgr2=0x7f7fdc0cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:27:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.204+0000 7f7fe0a00700 1 --2- 172.21.15.80:0/220964316 >> v2:172.21.15.106:3300/0 conn(0x7f7fdc0cf120 0x7f7fdc0cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.204+0000 7f7fe0a00700 1 -- 172.21.15.80:0/220964316 >> v1:172.21.15.106:6789/0 conn(0x7f7fdc071ee0 legacy=0x7f7fdc0722f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.204+0000 7f7fe0a00700 1 -- 172.21.15.80:0/220964316 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc0b4640 con 0x7f7fdc15a960 2024-05-10T04:27:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.204+0000 7f7fe0a00700 1 --2- 172.21.15.80:0/220964316 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fdc15a960 0x7f7fdc06e080 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8009840 tx=0x7f7fc8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b53859e5384d33eb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.205+0000 7f7fdbe00700 1 -- 172.21.15.80:0/220964316 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8011830 con 0x7f7fdc15a960 2024-05-10T04:27:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.205+0000 7f7fdbe00700 1 -- 172.21.15.80:0/220964316 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc8011990 con 0x7f7fdc15a960 2024-05-10T04:27:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.205+0000 7f7fdbe00700 1 -- 172.21.15.80:0/220964316 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8011d20 con 0x7f7fdc15a960 2024-05-10T04:27:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.205+0000 7f7fe3e00700 1 -- 172.21.15.80:0/220964316 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fdc15a960 msgr2=0x7f7fdc06e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.205+0000 7f7fe3e00700 1 --2- 172.21.15.80:0/220964316 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fdc15a960 0x7f7fdc06e080 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8009840 tx=0x7f7fc8009b50 comp rx=0 tx=0).stop 2024-05-10T04:27:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.205+0000 7f7fe3e00700 1 -- 172.21.15.80:0/220964316 shutdown_connections 2024-05-10T04:27:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.205+0000 7f7fe3e00700 1 --2- 172.21.15.80:0/220964316 >> v2:172.21.15.106:3300/0 conn(0x7f7fdc0cf120 0x7f7fdc0cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.205+0000 7f7fe3e00700 1 --2- 172.21.15.80:0/220964316 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fdc15a960 0x7f7fdc06e080 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.205+0000 7f7fe3e00700 1 -- 172.21.15.80:0/220964316 >> 172.21.15.80:0/220964316 conn(0x7f7fdc06b620 msgr2=0x7f7fdc0b16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.205+0000 7f7fe3e00700 1 -- 172.21.15.80:0/220964316 shutdown_connections 2024-05-10T04:27:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.205+0000 7f7fe3e00700 1 -- 172.21.15.80:0/220964316 wait complete. 2024-05-10T04:27:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.208+0000 7f7fe3e00700 1 Processor -- start 2024-05-10T04:27:02.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.208+0000 7f7fe3e00700 1 -- start start 2024-05-10T04:27:02.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.209+0000 7f7fe3e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fdc071ee0 0x7f7fdc1f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:02.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.209+0000 7f7fe3e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fdc0cf120 0x7f7fdc159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:02.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.209+0000 7f7fe3e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fdc15a960 0x7f7fdc159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:02.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.209+0000 7f7fe3e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc1f8d00 con 0x7f7fdc0cf120 2024-05-10T04:27:02.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.209+0000 7f7fe3e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc1f5050 con 0x7f7fdc071ee0 2024-05-10T04:27:02.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.209+0000 7f7fe3e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc1646a0 con 0x7f7fdc15a960 2024-05-10T04:27:02.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.209+0000 7f7fe0a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fdc0cf120 0x7f7fdc159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:02.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.210+0000 7f7fe0a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fdc0cf120 0x7f7fdc159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44896/0 (socket says 172.21.15.80:44896) 2024-05-10T04:27:02.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.210+0000 7f7fe0a00700 1 -- 172.21.15.80:0/2972841586 learned_addr learned my addr 172.21.15.80:0/2972841586 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:27:02.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.210+0000 7f7fe1400700 1 --2- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fdc071ee0 0x7f7fdc1f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:02.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.210+0000 7f7fe1e00700 1 --2- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fdc15a960 0x7f7fdc159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:02.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.210+0000 7f7fe0a00700 1 -- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fdc15a960 msgr2=0x7f7fdc159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:02.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.210+0000 7f7fe0a00700 1 --2- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fdc15a960 0x7f7fdc159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:02.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.210+0000 7f7fe0a00700 1 -- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fdc071ee0 msgr2=0x7f7fdc1f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:02.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.210+0000 7f7fe0a00700 1 --2- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fdc071ee0 0x7f7fdc1f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:02.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.210+0000 7f7fe0a00700 1 -- 172.21.15.80:0/2972841586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc80094a0 con 0x7f7fdc0cf120 2024-05-10T04:27:02.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.210+0000 7f7fe1e00700 1 --2- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fdc15a960 0x7f7fdc159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:27:02.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.210+0000 7f7fe1400700 1 --2- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fdc071ee0 0x7f7fdc1f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:27:02.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.210+0000 7f7fe0a00700 1 --2- 172.21.15.80:0/2972841586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fdc0cf120 0x7f7fdc159930 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8009fd0 tx=0x7f7fc8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:02.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.210+0000 7f7fd9600700 1 -- 172.21.15.80:0/2972841586 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80036a0 con 0x7f7fdc0cf120 2024-05-10T04:27:02.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.211+0000 7f7fd9600700 1 -- 172.21.15.80:0/2972841586 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc801e070 con 0x7f7fdc0cf120 2024-05-10T04:27:02.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.211+0000 7f7fe3e00700 1 -- 172.21.15.80:0/2972841586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fdc164980 con 0x7f7fdc0cf120 2024-05-10T04:27:02.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.211+0000 7f7fd9600700 1 -- 172.21.15.80:0/2972841586 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8003a60 con 0x7f7fdc0cf120 2024-05-10T04:27:02.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.211+0000 7f7fe3e00700 1 -- 172.21.15.80:0/2972841586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fdc1f8a80 con 0x7f7fdc0cf120 2024-05-10T04:27:02.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.211+0000 7f7fe3e00700 1 -- 172.21.15.80:0/2972841586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7fdc06e5c0 con 0x7f7fdc0cf120 2024-05-10T04:27:02.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.213+0000 7f7fd9600700 1 -- 172.21.15.80:0/2972841586 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7fc8003bc0 con 0x7f7fdc0cf120 2024-05-10T04:27:02.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.213+0000 7f7fd9600700 1 --2- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7fbc06ac90 0x7f7fbc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:02.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.214+0000 7f7fd9600700 1 -- 172.21.15.80:0/2972841586 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7fc808a760 con 0x7f7fdc0cf120 2024-05-10T04:27:02.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.214+0000 7f7fd9600700 1 --2- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:6816/41893,v1:172.21.15.106:6817/41893] conn(0x7f7fbc070b40 0x7f7fbc072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:02.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.214+0000 7f7fd9600700 1 -- 172.21.15.80:0/2972841586 --> [v2:172.21.15.106:6816/41893,v1:172.21.15.106:6817/41893] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7fbc073680 con 0x7f7fbc070b40 2024-05-10T04:27:02.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.214+0000 7f7fd9600700 1 -- 172.21.15.80:0/2972841586 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fc808aad0 con 0x7f7fdc0cf120 2024-05-10T04:27:02.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.214+0000 7f7fe1400700 1 --2- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7fbc06ac90 0x7f7fbc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:02.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.214+0000 7f7fe1e00700 1 --2- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:6816/41893,v1:172.21.15.106:6817/41893] conn(0x7f7fbc070b40 0x7f7fbc072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:02.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.215+0000 7f7fe1e00700 1 --2- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:6816/41893,v1:172.21.15.106:6817/41893] conn(0x7f7fbc070b40 0x7f7fbc072fb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:02.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.215+0000 7f7fe1400700 1 --2- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7fbc06ac90 0x7f7fbc06d1a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0cd550 tx=0x7f7fd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:02.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.216+0000 7f7fd9600700 1 -- 172.21.15.80:0/2972841586 <== osd.6 v2:172.21.15.106:6816/41893 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7fbc073680 con 0x7f7fbc070b40 2024-05-10T04:27:02.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.231+0000 7f7fe3e00700 1 -- 172.21.15.80:0/2972841586 --> [v2:172.21.15.106:6816/41893,v1:172.21.15.106:6817/41893] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7fdc0b4c00 con 0x7f7fbc070b40 2024-05-10T04:27:02.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.232+0000 7f7fd9600700 1 -- 172.21.15.80:0/2972841586 <== osd.6 v2:172.21.15.106:6816/41893 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7fd4001c40 con 0x7f7fbc070b40 2024-05-10T04:27:02.234 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-10T04:27:02.234 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T04:27:02.234 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-10T04:27:02.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.232+0000 7f7fe3e00700 1 -- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:6816/41893,v1:172.21.15.106:6817/41893] conn(0x7f7fbc070b40 msgr2=0x7f7fbc072fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:02.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.232+0000 7f7fe3e00700 1 --2- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:6816/41893,v1:172.21.15.106:6817/41893] conn(0x7f7fbc070b40 0x7f7fbc072fb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:02.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.233+0000 7f7fe3e00700 1 -- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7fbc06ac90 msgr2=0x7f7fbc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:02.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.233+0000 7f7fe3e00700 1 --2- 172.21.15.80:0/2972841586 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f7fbc06ac90 0x7f7fbc06d1a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0cd550 tx=0x7f7fd0008040 comp rx=0 tx=0).stop 2024-05-10T04:27:02.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.233+0000 7f7fe3e00700 1 -- 172.21.15.80:0/2972841586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fdc0cf120 msgr2=0x7f7fdc159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:02.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.233+0000 7f7fe3e00700 1 --2- 172.21.15.80:0/2972841586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fdc0cf120 0x7f7fdc159930 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8009fd0 tx=0x7f7fc8004750 comp rx=0 tx=0).stop 2024-05-10T04:27:02.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.233+0000 7f7fe1e00700 1 -- 172.21.15.80:0/2972841586 reap_dead start 2024-05-10T04:27:02.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.233+0000 7f7fe3e00700 1 -- 172.21.15.80:0/2972841586 shutdown_connections 2024-05-10T04:27:02.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.233+0000 7f7fe3e00700 1 -- 172.21.15.80:0/2972841586 >> 172.21.15.80:0/2972841586 conn(0x7f7fdc06b620 msgr2=0x7f7fdc15b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:02.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.233+0000 7f7fe3e00700 1 -- 172.21.15.80:0/2972841586 shutdown_connections 2024-05-10T04:27:02.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.233+0000 7f7fe3e00700 1 -- 172.21.15.80:0/2972841586 wait complete. 2024-05-10T04:27:02.261 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-10T04:27:02.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.523+0000 7fb7d2800700 1 Processor -- start 2024-05-10T04:27:02.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.523+0000 7fb7d2800700 1 -- start start 2024-05-10T04:27:02.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.525+0000 7fb7d2800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb7cc141530 0x7fb7cc15c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:02.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.525+0000 7fb7d2800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7cc0ce760 0x7fb7cc0ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:02.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.525+0000 7fb7d2800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7cc15bc00 con 0x7fb7cc06f3f0 2024-05-10T04:27:02.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.525+0000 7fb7d2800700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7cc06ddf0 con 0x7fb7cc141530 2024-05-10T04:27:02.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.525+0000 7fb7d2800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc15b680 con 0x7fb7cc0ce760 2024-05-10T04:27:02.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.525+0000 7fb7caa00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb7cc141530 0x7fb7cc15c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:02.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.525+0000 7fb7cb400700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb7cc06f3f0 0x7fb7cc15f680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45336/0 (socket says 172.21.15.80:45336) 2024-05-10T04:27:02.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.525+0000 7fb7cb400700 1 -- 172.21.15.80:0/4128255400 learned_addr learned my addr 172.21.15.80:0/4128255400 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:27:02.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.525+0000 7fb7cbe00700 1 --2- 172.21.15.80:0/4128255400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7cc0ce760 0x7fb7cc0ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:02.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.526+0000 7fb7caa00700 1 -- 172.21.15.80:0/4128255400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7cc0ce760 msgr2=0x7fb7cc0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:27:02.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.526+0000 7fb7caa00700 1 --2- 172.21.15.80:0/4128255400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7cc0ce760 0x7fb7cc0ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:02.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.526+0000 7fb7caa00700 1 -- 172.21.15.80:0/4128255400 >> v1:172.21.15.80:6789/0 conn(0x7fb7cc06f3f0 legacy=0x7fb7cc15f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:02.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.526+0000 7fb7caa00700 1 -- 172.21.15.80:0/4128255400 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc0cf0b0 con 0x7fb7cc141530 2024-05-10T04:27:02.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.526+0000 7fb7ca000700 1 -- 172.21.15.80:0/4128255400 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256385604 0 0) 0x7fb7cc15bc00 con 0x7fb7cc06f3f0 2024-05-10T04:27:02.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.526+0000 7fb7caa00700 1 --2- 172.21.15.80:0/4128255400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc141530 0x7fb7cc15c090 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009840 tx=0x7fb7b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1160c5798b09a8f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:02.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.526+0000 7fb7ca000700 1 -- 172.21.15.80:0/4128255400 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8011830 con 0x7fb7cc141530 2024-05-10T04:27:02.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.526+0000 7fb7ca000700 1 -- 172.21.15.80:0/4128255400 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b8011990 con 0x7fb7cc141530 2024-05-10T04:27:02.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.526+0000 7fb7ca000700 1 -- 172.21.15.80:0/4128255400 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8011d20 con 0x7fb7cc141530 2024-05-10T04:27:02.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.527+0000 7fb7d2800700 1 -- 172.21.15.80:0/4128255400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc141530 msgr2=0x7fb7cc15c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:02.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.527+0000 7fb7d2800700 1 --2- 172.21.15.80:0/4128255400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc141530 0x7fb7cc15c090 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009840 tx=0x7fb7b8009b50 comp rx=0 tx=0).stop 2024-05-10T04:27:02.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.527+0000 7fb7d2800700 1 -- 172.21.15.80:0/4128255400 shutdown_connections 2024-05-10T04:27:02.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.527+0000 7fb7d2800700 1 --2- 172.21.15.80:0/4128255400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7cc0ce760 0x7fb7cc0ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:02.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.527+0000 7fb7d2800700 1 --2- 172.21.15.80:0/4128255400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc141530 0x7fb7cc15c090 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:02.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.527+0000 7fb7d2800700 1 -- 172.21.15.80:0/4128255400 >> 172.21.15.80:0/4128255400 conn(0x7fb7cc0cfa80 msgr2=0x7fb7cc0cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:02.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.527+0000 7fb7d2800700 1 -- 172.21.15.80:0/4128255400 shutdown_connections 2024-05-10T04:27:02.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.527+0000 7fb7d2800700 1 -- 172.21.15.80:0/4128255400 wait complete. 2024-05-10T04:27:02.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.529+0000 7fb7d2800700 1 Processor -- start 2024-05-10T04:27:02.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.529+0000 7fb7d2800700 1 -- start start 2024-05-10T04:27:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.531+0000 7fb7d2800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7cc06f3f0 0x7fb7cc1e8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.531+0000 7fb7d2800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0ce760 0x7fb7cc142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.531+0000 7fb7d2800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7cc141530 0x7fb7cc143350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.531+0000 7fb7d2800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc1e9450 con 0x7fb7cc0ce760 2024-05-10T04:27:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.531+0000 7fb7d2800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc159fa0 con 0x7fb7cc141530 2024-05-10T04:27:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.531+0000 7fb7d2800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc143960 con 0x7fb7cc06f3f0 2024-05-10T04:27:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.531+0000 7fb7caa00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0ce760 0x7fb7cc142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.531+0000 7fb7caa00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0ce760 0x7fb7cc142e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44918/0 (socket says 172.21.15.80:44918) 2024-05-10T04:27:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.531+0000 7fb7caa00700 1 -- 172.21.15.80:0/1235969608 learned_addr learned my addr 172.21.15.80:0/1235969608 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:27:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.531+0000 7fb7cb400700 1 --2- 172.21.15.80:0/1235969608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7cc06f3f0 0x7fb7cc1e8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.531+0000 7fb7cbe00700 1 --2- 172.21.15.80:0/1235969608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7cc141530 0x7fb7cc143350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.531+0000 7fb7caa00700 1 -- 172.21.15.80:0/1235969608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7cc06f3f0 msgr2=0x7fb7cc1e8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.532+0000 7fb7caa00700 1 --2- 172.21.15.80:0/1235969608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7cc06f3f0 0x7fb7cc1e8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:02.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.532+0000 7fb7caa00700 1 -- 172.21.15.80:0/1235969608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7cc141530 msgr2=0x7fb7cc143350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:02.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.532+0000 7fb7caa00700 1 --2- 172.21.15.80:0/1235969608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7cc141530 0x7fb7cc143350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:02.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.532+0000 7fb7caa00700 1 -- 172.21.15.80:0/1235969608 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b80094a0 con 0x7fb7cc0ce760 2024-05-10T04:27:02.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.532+0000 7fb7cbe00700 1 --2- 172.21.15.80:0/1235969608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7cc141530 0x7fb7cc143350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:27:02.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.532+0000 7fb7caa00700 1 --2- 172.21.15.80:0/1235969608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0ce760 0x7fb7cc142e10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80090b0 tx=0x7fb7b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:02.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.532+0000 7fb7c3400700 1 -- 172.21.15.80:0/1235969608 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b80038a0 con 0x7fb7cc0ce760 2024-05-10T04:27:02.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.532+0000 7fb7c3400700 1 -- 172.21.15.80:0/1235969608 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b801e070 con 0x7fb7cc0ce760 2024-05-10T04:27:02.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.532+0000 7fb7d2800700 1 -- 172.21.15.80:0/1235969608 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7cc143bb0 con 0x7fb7cc0ce760 2024-05-10T04:27:02.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.532+0000 7fb7c3400700 1 -- 172.21.15.80:0/1235969608 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8003c20 con 0x7fb7cc0ce760 2024-05-10T04:27:02.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.532+0000 7fb7d2800700 1 -- 172.21.15.80:0/1235969608 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7cc144170 con 0x7fb7cc0ce760 2024-05-10T04:27:02.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.533+0000 7fb7d2800700 1 -- 172.21.15.80:0/1235969608 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7cc06ef10 con 0x7fb7cc0ce760 2024-05-10T04:27:02.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.534+0000 7fb7c3400700 1 -- 172.21.15.80:0/1235969608 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb7b801a420 con 0x7fb7cc0ce760 2024-05-10T04:27:02.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.535+0000 7fb7c3400700 1 --2- 172.21.15.80:0/1235969608 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb7ac06ac90 0x7fb7ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:02.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.535+0000 7fb7c3400700 1 -- 172.21.15.80:0/1235969608 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb7b808a1f0 con 0x7fb7cc0ce760 2024-05-10T04:27:02.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.535+0000 7fb7cb400700 1 --2- 172.21.15.80:0/1235969608 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb7ac06ac90 0x7fb7ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:02.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.536+0000 7fb7cb400700 1 --2- 172.21.15.80:0/1235969608 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb7ac06ac90 0x7fb7ac06d1a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc000f60 tx=0x7fb7bc007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:02.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.539+0000 7fb7c3400700 1 -- 172.21.15.80:0/1235969608 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb7b8055630 con 0x7fb7cc0ce760 2024-05-10T04:27:02.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.747+0000 7fb7d2800700 1 -- 172.21.15.80:0/1235969608 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7cc0cc0a0 con 0x7fb7ac06ac90 2024-05-10T04:27:02.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.748+0000 7fb7c3400700 1 -- 172.21.15.80:0/1235969608 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb7cc0cc0a0 con 0x7fb7ac06ac90 2024-05-10T04:27:02.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.751+0000 7fb7d2800700 1 -- 172.21.15.80:0/1235969608 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb7ac06ac90 msgr2=0x7fb7ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:02.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.751+0000 7fb7d2800700 1 --2- 172.21.15.80:0/1235969608 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb7ac06ac90 0x7fb7ac06d1a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc000f60 tx=0x7fb7bc007c90 comp rx=0 tx=0).stop 2024-05-10T04:27:02.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.751+0000 7fb7d2800700 1 -- 172.21.15.80:0/1235969608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0ce760 msgr2=0x7fb7cc142e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:02.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.751+0000 7fb7d2800700 1 --2- 172.21.15.80:0/1235969608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0ce760 0x7fb7cc142e10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80090b0 tx=0x7fb7b8004750 comp rx=0 tx=0).stop 2024-05-10T04:27:02.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.751+0000 7fb7d2800700 1 -- 172.21.15.80:0/1235969608 shutdown_connections 2024-05-10T04:27:02.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.751+0000 7fb7d2800700 1 --2- 172.21.15.80:0/1235969608 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7fb7ac06ac90 0x7fb7ac06d1a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:02.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.751+0000 7fb7d2800700 1 --2- 172.21.15.80:0/1235969608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7cc141530 0x7fb7cc143350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:02.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.751+0000 7fb7d2800700 1 --2- 172.21.15.80:0/1235969608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7cc06f3f0 0x7fb7cc1e8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:02.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.751+0000 7fb7d2800700 1 --2- 172.21.15.80:0/1235969608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0ce760 0x7fb7cc142e10 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:02.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.751+0000 7fb7d2800700 1 -- 172.21.15.80:0/1235969608 >> 172.21.15.80:0/1235969608 conn(0x7fb7cc0cfa80 msgr2=0x7fb7cc15d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:02.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.751+0000 7fb7d2800700 1 -- 172.21.15.80:0/1235969608 shutdown_connections 2024-05-10T04:27:02.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:02.751+0000 7fb7d2800700 1 -- 172.21.15.80:0/1235969608 wait complete. 2024-05-10T04:27:02.755 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 6 to deep-scrub 2024-05-10T04:27:02.777 INFO:tasks.ceph:Scrubbing osd.7 2024-05-10T04:27:02.777 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-10T04:27:03.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.042+0000 7f23c1e00700 1 Processor -- start 2024-05-10T04:27:03.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.042+0000 7f23c1e00700 1 -- start start 2024-05-10T04:27:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.044+0000 7f23c1e00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f23bc06b6d0 0x7f23bc15e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.044+0000 7f23c1e00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f23bc0b30d0 0x7f23bc0cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.044+0000 7f23c1e00700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23bc0b34e0 con 0x7f23bc0d01c0 2024-05-10T04:27:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.044+0000 7f23c1e00700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23bc0ccb30 con 0x7f23bc0b30d0 2024-05-10T04:27:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.044+0000 7f23c1e00700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23bc0cce10 con 0x7f23bc06b6d0 2024-05-10T04:27:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.044+0000 7f23bbe00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f23bc0b30d0 0x7f23bc0cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.044+0000 7f23bbe00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f23bc0b30d0 0x7f23bc0cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40180/0 (socket says 172.21.15.80:40180) 2024-05-10T04:27:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.044+0000 7f23bbe00700 1 -- 172.21.15.80:0/2732708610 learned_addr learned my addr 172.21.15.80:0/2732708610 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:27:03.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.044+0000 7f23c1400700 1 --1- 172.21.15.80:0/2732708610 >> v1:172.21.15.80:6789/0 conn(0x7f23bc0d01c0 0x7f23bc0cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46584/0 (socket says 172.21.15.80:46584) 2024-05-10T04:27:03.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.045+0000 7f23c0a00700 1 --2- 172.21.15.80:0/2732708610 >> v2:172.21.15.106:3300/0 conn(0x7f23bc06b6d0 0x7f23bc15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.045+0000 7f23bbe00700 1 -- 172.21.15.80:0/2732708610 >> v2:172.21.15.106:3300/0 conn(0x7f23bc06b6d0 msgr2=0x7f23bc15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:27:03.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.045+0000 7f23bbe00700 1 --2- 172.21.15.80:0/2732708610 >> v2:172.21.15.106:3300/0 conn(0x7f23bc06b6d0 0x7f23bc15e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.045+0000 7f23bbe00700 1 -- 172.21.15.80:0/2732708610 >> v1:172.21.15.80:6789/0 conn(0x7f23bc0d01c0 legacy=0x7f23bc0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.045+0000 7f23bbe00700 1 -- 172.21.15.80:0/2732708610 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc0b1c50 con 0x7f23bc0b30d0 2024-05-10T04:27:03.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.045+0000 7f23bb400700 1 -- 172.21.15.80:0/2732708610 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204806285 0 0) 0x7f23bc0b34e0 con 0x7f23bc0d01c0 2024-05-10T04:27:03.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.045+0000 7f23c0a00700 1 --2- 172.21.15.80:0/2732708610 >> v2:172.21.15.106:3300/0 conn(0x7f23bc06b6d0 0x7f23bc15e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:27:03.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.045+0000 7f23bbe00700 1 --2- 172.21.15.80:0/2732708610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23bc0b30d0 0x7f23bc0cfc80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f23bc06dfc0 tx=0x7f23a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25979c93732c96a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:03.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.045+0000 7f23bb400700 1 -- 172.21.15.80:0/2732708610 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a800b870 con 0x7f23bc0b30d0 2024-05-10T04:27:03.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.045+0000 7f23bb400700 1 -- 172.21.15.80:0/2732708610 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a800b9d0 con 0x7f23bc0b30d0 2024-05-10T04:27:03.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.046+0000 7f23bb400700 1 -- 172.21.15.80:0/2732708610 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a800bd60 con 0x7f23bc0b30d0 2024-05-10T04:27:03.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.046+0000 7f23c1e00700 1 -- 172.21.15.80:0/2732708610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23bc0b30d0 msgr2=0x7f23bc0cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.046+0000 7f23c1e00700 1 --2- 172.21.15.80:0/2732708610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23bc0b30d0 0x7f23bc0cfc80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f23bc06dfc0 tx=0x7f23a8009bd0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.046+0000 7f23c1e00700 1 -- 172.21.15.80:0/2732708610 shutdown_connections 2024-05-10T04:27:03.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.046+0000 7f23c1e00700 1 --2- 172.21.15.80:0/2732708610 >> v2:172.21.15.106:3300/0 conn(0x7f23bc06b6d0 0x7f23bc15e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.046+0000 7f23c1e00700 1 --2- 172.21.15.80:0/2732708610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23bc0b30d0 0x7f23bc0cfc80 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.046+0000 7f23c1e00700 1 -- 172.21.15.80:0/2732708610 >> 172.21.15.80:0/2732708610 conn(0x7f23bc0b25b0 msgr2=0x7f23bc0b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:03.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.046+0000 7f23c1e00700 1 -- 172.21.15.80:0/2732708610 shutdown_connections 2024-05-10T04:27:03.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.046+0000 7f23c1e00700 1 -- 172.21.15.80:0/2732708610 wait complete. 2024-05-10T04:27:03.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.049+0000 7f23c1e00700 1 Processor -- start 2024-05-10T04:27:03.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.049+0000 7f23c1e00700 1 -- start start 2024-05-10T04:27:03.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.050+0000 7f23c1e00700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f23bc06b6d0 0x7f23bc15b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.050+0000 7f23c1e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23bc0b30d0 0x7f23bc157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.050+0000 7f23c1e00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23bc0d01c0 0x7f23bc0c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.050+0000 7f23c1e00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc1599f0 con 0x7f23bc0b30d0 2024-05-10T04:27:03.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.050+0000 7f23c1e00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc0ade80 con 0x7f23bc0d01c0 2024-05-10T04:27:03.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.050+0000 7f23c1e00700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc158b20 con 0x7f23bc06b6d0 2024-05-10T04:27:03.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.050+0000 7f23bbe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23bc0b30d0 0x7f23bc157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.051+0000 7f23bbe00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23bc0b30d0 0x7f23bc157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40194/0 (socket says 172.21.15.80:40194) 2024-05-10T04:27:03.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.051+0000 7f23bbe00700 1 -- 172.21.15.80:0/1458890495 learned_addr learned my addr 172.21.15.80:0/1458890495 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:27:03.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.051+0000 7f23c1400700 1 --2- 172.21.15.80:0/1458890495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23bc0d01c0 0x7f23bc0c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.051+0000 7f23bbe00700 1 -- 172.21.15.80:0/1458890495 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f23bc06b6d0 msgr2=0x7f23bc15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.051+0000 7f23c0a00700 1 --2- 172.21.15.80:0/1458890495 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f23bc06b6d0 0x7f23bc15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.051+0000 7f23bbe00700 1 --2- 172.21.15.80:0/1458890495 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f23bc06b6d0 0x7f23bc15b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.051+0000 7f23bbe00700 1 -- 172.21.15.80:0/1458890495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23bc0d01c0 msgr2=0x7f23bc0c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.051+0000 7f23bbe00700 1 --2- 172.21.15.80:0/1458890495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23bc0d01c0 0x7f23bc0c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.051+0000 7f23bbe00700 1 -- 172.21.15.80:0/1458890495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a8009550 con 0x7f23bc0b30d0 2024-05-10T04:27:03.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.051+0000 7f23c1400700 1 --2- 172.21.15.80:0/1458890495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23bc0d01c0 0x7f23bc0c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:27:03.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.051+0000 7f23bbe00700 1 --2- 172.21.15.80:0/1458890495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23bc0b30d0 0x7f23bc157dd0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f23a8000c00 tx=0x7f23a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:03.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.051+0000 7f23b8c00700 1 -- 172.21.15.80:0/1458890495 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8004520 con 0x7f23bc0b30d0 2024-05-10T04:27:03.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.051+0000 7f23b8c00700 1 -- 172.21.15.80:0/1458890495 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a801e070 con 0x7f23bc0b30d0 2024-05-10T04:27:03.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.051+0000 7f23b8c00700 1 -- 172.21.15.80:0/1458890495 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a80038a0 con 0x7f23bc0b30d0 2024-05-10T04:27:03.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.051+0000 7f23c1e00700 1 -- 172.21.15.80:0/1458890495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23bc158d70 con 0x7f23bc0b30d0 2024-05-10T04:27:03.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.052+0000 7f23c1e00700 1 -- 172.21.15.80:0/1458890495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23bc159330 con 0x7f23bc0b30d0 2024-05-10T04:27:03.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.052+0000 7f23c1e00700 1 -- 172.21.15.80:0/1458890495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f23bc06bb70 con 0x7f23bc0b30d0 2024-05-10T04:27:03.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.053+0000 7f23b8c00700 1 -- 172.21.15.80:0/1458890495 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f23a8003a00 con 0x7f23bc0b30d0 2024-05-10T04:27:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.054+0000 7f23b8c00700 1 --2- 172.21.15.80:0/1458890495 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f239c06ac90 0x7f239c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.054+0000 7f23b8c00700 1 -- 172.21.15.80:0/1458890495 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f23a8020070 con 0x7f23bc0b30d0 2024-05-10T04:27:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.055+0000 7f23b8c00700 1 --2- 172.21.15.80:0/1458890495 >> [v2:172.21.15.106:6808/41892,v1:172.21.15.106:6809/41892] conn(0x7f239c070b40 0x7f239c072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.055+0000 7f23b8c00700 1 -- 172.21.15.80:0/1458890495 --> [v2:172.21.15.106:6808/41892,v1:172.21.15.106:6809/41892] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f239c073680 con 0x7f239c070b40 2024-05-10T04:27:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.055+0000 7f23b8c00700 1 -- 172.21.15.80:0/1458890495 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23a808ca10 con 0x7f23bc0b30d0 2024-05-10T04:27:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.055+0000 7f23c0a00700 1 --2- 172.21.15.80:0/1458890495 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f239c06ac90 0x7f239c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.055+0000 7f23c1400700 1 --2- 172.21.15.80:0/1458890495 >> [v2:172.21.15.106:6808/41892,v1:172.21.15.106:6809/41892] conn(0x7f239c070b40 0x7f239c072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.055+0000 7f23c0a00700 1 --2- 172.21.15.80:0/1458890495 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f239c06ac90 0x7f239c06d1a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f23bc071b40 tx=0x7f23b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:03.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.056+0000 7f23c1400700 1 --2- 172.21.15.80:0/1458890495 >> [v2:172.21.15.106:6808/41892,v1:172.21.15.106:6809/41892] conn(0x7f239c070b40 0x7f239c072fb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:03.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.057+0000 7f23b8c00700 1 -- 172.21.15.80:0/1458890495 <== osd.7 v2:172.21.15.106:6808/41892 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f239c073680 con 0x7f239c070b40 2024-05-10T04:27:03.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.072+0000 7f23c1e00700 1 -- 172.21.15.80:0/1458890495 --> [v2:172.21.15.106:6808/41892,v1:172.21.15.106:6809/41892] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f23bc0d05d0 con 0x7f239c070b40 2024-05-10T04:27:03.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.073+0000 7f23b8c00700 1 -- 172.21.15.80:0/1458890495 <== osd.7 v2:172.21.15.106:6808/41892 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f23b40070e0 con 0x7f239c070b40 2024-05-10T04:27:03.074 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-10T04:27:03.074 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T04:27:03.074 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-10T04:27:03.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.073+0000 7f23c1e00700 1 -- 172.21.15.80:0/1458890495 >> [v2:172.21.15.106:6808/41892,v1:172.21.15.106:6809/41892] conn(0x7f239c070b40 msgr2=0x7f239c072fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.073+0000 7f23c1e00700 1 --2- 172.21.15.80:0/1458890495 >> [v2:172.21.15.106:6808/41892,v1:172.21.15.106:6809/41892] conn(0x7f239c070b40 0x7f239c072fb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.073+0000 7f23c1e00700 1 -- 172.21.15.80:0/1458890495 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f239c06ac90 msgr2=0x7f239c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.073+0000 7f23c1e00700 1 --2- 172.21.15.80:0/1458890495 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f239c06ac90 0x7f239c06d1a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f23bc071b40 tx=0x7f23b0008040 comp rx=0 tx=0).stop 2024-05-10T04:27:03.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.073+0000 7f23c1e00700 1 -- 172.21.15.80:0/1458890495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23bc0b30d0 msgr2=0x7f23bc157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.073+0000 7f23c1e00700 1 --2- 172.21.15.80:0/1458890495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23bc0b30d0 0x7f23bc157dd0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f23a8000c00 tx=0x7f23a8004750 comp rx=0 tx=0).stop 2024-05-10T04:27:03.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.073+0000 7f23c1400700 1 -- 172.21.15.80:0/1458890495 reap_dead start 2024-05-10T04:27:03.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.073+0000 7f23c1e00700 1 -- 172.21.15.80:0/1458890495 shutdown_connections 2024-05-10T04:27:03.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.073+0000 7f23c1e00700 1 -- 172.21.15.80:0/1458890495 >> 172.21.15.80:0/1458890495 conn(0x7f23bc0b25b0 msgr2=0x7f23bc0b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:03.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.073+0000 7f23c1e00700 1 -- 172.21.15.80:0/1458890495 shutdown_connections 2024-05-10T04:27:03.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.073+0000 7f23c1e00700 1 -- 172.21.15.80:0/1458890495 wait complete. 2024-05-10T04:27:03.099 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-10T04:27:03.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.360+0000 7f3555600700 1 Processor -- start 2024-05-10T04:27:03.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.360+0000 7f3555600700 1 -- start start 2024-05-10T04:27:03.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.362+0000 7f3555600700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35500ce760 0x7f35500ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.362+0000 7f3555600700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355015bc00 con 0x7f3550141530 2024-05-10T04:27:03.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.362+0000 7f3555600700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35500cf0b0 con 0x7f355006f3f0 2024-05-10T04:27:03.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.362+0000 7f3555600700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355006ddf0 con 0x7f35500ce760 2024-05-10T04:27:03.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.362+0000 7f354e000700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3550141530 0x7f355015c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46592/0 (socket says 172.21.15.80:46592) 2024-05-10T04:27:03.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.362+0000 7f354e000700 1 -- 172.21.15.80:0/2547586485 learned_addr learned my addr 172.21.15.80:0/2547586485 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:27:03.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.362+0000 7f354f400700 1 --2- 172.21.15.80:0/2547586485 >> v2:172.21.15.80:3300/0 conn(0x7f35500ce760 0x7f35500ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.362+0000 7f354d600700 1 -- 172.21.15.80:0/2547586485 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497244174 0 0) 0x7f355015bc00 con 0x7f3550141530 2024-05-10T04:27:03.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.362+0000 7f354d600700 1 -- 172.21.15.80:0/2547586485 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35340035b0 con 0x7f3550141530 2024-05-10T04:27:03.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.362+0000 7f354f400700 1 -- 172.21.15.80:0/2547586485 >> v1:172.21.15.106:6789/0 conn(0x7f355006f3f0 legacy=0x7f355015f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.362+0000 7f354f400700 1 -- 172.21.15.80:0/2547586485 >> v1:172.21.15.80:6789/0 conn(0x7f3550141530 legacy=0x7f355015c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.362+0000 7f354f400700 1 -- 172.21.15.80:0/2547586485 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355006d850 con 0x7f35500ce760 2024-05-10T04:27:03.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.363+0000 7f354f400700 1 --2- 172.21.15.80:0/2547586485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35500ce760 0x7f35500ceb70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3548009d90 tx=0x7f354800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44af58f5956e4a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:03.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.363+0000 7f354d600700 1 -- 172.21.15.80:0/2547586485 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354800e070 con 0x7f35500ce760 2024-05-10T04:27:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.363+0000 7f354d600700 1 -- 172.21.15.80:0/2547586485 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354800bb20 con 0x7f35500ce760 2024-05-10T04:27:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.363+0000 7f354d600700 1 -- 172.21.15.80:0/2547586485 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548012430 con 0x7f35500ce760 2024-05-10T04:27:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.364+0000 7f3555600700 1 -- 172.21.15.80:0/2547586485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35500ce760 msgr2=0x7f35500ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.364+0000 7f3555600700 1 --2- 172.21.15.80:0/2547586485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35500ce760 0x7f35500ceb70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3548009d90 tx=0x7f354800b330 comp rx=0 tx=0).stop 2024-05-10T04:27:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.364+0000 7f3555600700 1 -- 172.21.15.80:0/2547586485 shutdown_connections 2024-05-10T04:27:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.364+0000 7f3555600700 1 --2- 172.21.15.80:0/2547586485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35500ce760 0x7f35500ceb70 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.364+0000 7f3555600700 1 -- 172.21.15.80:0/2547586485 >> 172.21.15.80:0/2547586485 conn(0x7f35500cfa80 msgr2=0x7f35500cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.364+0000 7f3555600700 1 -- 172.21.15.80:0/2547586485 shutdown_connections 2024-05-10T04:27:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.364+0000 7f3555600700 1 -- 172.21.15.80:0/2547586485 wait complete. 2024-05-10T04:27:03.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.366+0000 7f3555600700 1 Processor -- start 2024-05-10T04:27:03.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.366+0000 7f3555600700 1 -- start start 2024-05-10T04:27:03.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.368+0000 7f3555600700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f355006f3f0 0x7f355013ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.368+0000 7f3555600700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35500ce760 0x7f3550143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.368+0000 7f3555600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3550141530 0x7f3550141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.368+0000 7f3555600700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35501428c0 con 0x7f35500ce760 2024-05-10T04:27:03.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.368+0000 7f3555600700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3550140510 con 0x7f355006f3f0 2024-05-10T04:27:03.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.368+0000 7f3555600700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35500a8670 con 0x7f3550141530 2024-05-10T04:27:03.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.368+0000 7f354e000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35500ce760 0x7f3550143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.368+0000 7f354ea00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f355006f3f0 0x7f355013ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.368+0000 7f354ea00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f355006f3f0 0x7f355013ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:56816/0 (socket says 172.21.15.80:56816) 2024-05-10T04:27:03.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.368+0000 7f354ea00700 1 -- 172.21.15.80:0/3911832749 learned_addr learned my addr 172.21.15.80:0/3911832749 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:27:03.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.368+0000 7f354e000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35500ce760 0x7f3550143f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40222/0 (socket says 172.21.15.80:40222) 2024-05-10T04:27:03.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.368+0000 7f354f400700 1 --2- 172.21.15.80:0/3911832749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3550141530 0x7f3550141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.368+0000 7f354e000700 1 -- 172.21.15.80:0/3911832749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3550141530 msgr2=0x7f3550141ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.368+0000 7f354e000700 1 --2- 172.21.15.80:0/3911832749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3550141530 0x7f3550141ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.368+0000 7f354e000700 1 -- 172.21.15.80:0/3911832749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f355006f3f0 msgr2=0x7f355013ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.368+0000 7f354e000700 1 --2- 172.21.15.80:0/3911832749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f355006f3f0 0x7f355013ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.368+0000 7f354e000700 1 -- 172.21.15.80:0/3911832749 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3548009a70 con 0x7f35500ce760 2024-05-10T04:27:03.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.369+0000 7f354e000700 1 --2- 172.21.15.80:0/3911832749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35500ce760 0x7f3550143f40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f353c00c400 tx=0x7f353c00c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:03.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.369+0000 7f3546a00700 1 -- 172.21.15.80:0/3911832749 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c005d70 con 0x7f35500ce760 2024-05-10T04:27:03.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.369+0000 7f3546a00700 1 -- 172.21.15.80:0/3911832749 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c00ce30 con 0x7f35500ce760 2024-05-10T04:27:03.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.369+0000 7f3546a00700 1 -- 172.21.15.80:0/3911832749 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0072f0 con 0x7f35500ce760 2024-05-10T04:27:03.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.369+0000 7f3555600700 1 -- 172.21.15.80:0/3911832749 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35500a8950 con 0x7f35500ce760 2024-05-10T04:27:03.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.369+0000 7f3555600700 1 -- 172.21.15.80:0/3911832749 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35500a8f10 con 0x7f35500ce760 2024-05-10T04:27:03.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.370+0000 7f3555600700 1 -- 172.21.15.80:0/3911832749 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3550074af0 con 0x7f35500ce760 2024-05-10T04:27:03.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.371+0000 7f3546a00700 1 -- 172.21.15.80:0/3911832749 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f353c007450 con 0x7f35500ce760 2024-05-10T04:27:03.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.373+0000 7f3546a00700 1 --2- 172.21.15.80:0/3911832749 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f353006ac90 0x7f353006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.373+0000 7f3546a00700 1 -- 172.21.15.80:0/3911832749 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f353c088370 con 0x7f35500ce760 2024-05-10T04:27:03.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.373+0000 7f354ea00700 1 --2- 172.21.15.80:0/3911832749 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f353006ac90 0x7f353006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.374+0000 7f354ea00700 1 --2- 172.21.15.80:0/3911832749 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f353006ac90 0x7f353006d1a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3540000f60 tx=0x7f3540009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:03.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.377+0000 7f3546a00700 1 -- 172.21.15.80:0/3911832749 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f353c0537b0 con 0x7f35500ce760 2024-05-10T04:27:03.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.581+0000 7f3555600700 1 -- 172.21.15.80:0/3911832749 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f3550068590 con 0x7f353006ac90 2024-05-10T04:27:03.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.581+0000 7f3546a00700 1 -- 172.21.15.80:0/3911832749 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3550068590 con 0x7f353006ac90 2024-05-10T04:27:03.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.584+0000 7f3555600700 1 -- 172.21.15.80:0/3911832749 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f353006ac90 msgr2=0x7f353006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.584+0000 7f3555600700 1 --2- 172.21.15.80:0/3911832749 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f353006ac90 0x7f353006d1a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3540000f60 tx=0x7f3540009040 comp rx=0 tx=0).stop 2024-05-10T04:27:03.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.584+0000 7f3555600700 1 -- 172.21.15.80:0/3911832749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35500ce760 msgr2=0x7f3550143f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.584+0000 7f3555600700 1 --2- 172.21.15.80:0/3911832749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35500ce760 0x7f3550143f40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f353c00c400 tx=0x7f353c00c710 comp rx=0 tx=0).stop 2024-05-10T04:27:03.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.584+0000 7f3555600700 1 -- 172.21.15.80:0/3911832749 shutdown_connections 2024-05-10T04:27:03.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.584+0000 7f3555600700 1 --2- 172.21.15.80:0/3911832749 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f353006ac90 0x7f353006d1a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.584+0000 7f3555600700 1 --2- 172.21.15.80:0/3911832749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3550141530 0x7f3550141ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.584+0000 7f3555600700 1 --2- 172.21.15.80:0/3911832749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f355006f3f0 0x7f355013ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.584+0000 7f3555600700 1 --2- 172.21.15.80:0/3911832749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35500ce760 0x7f3550143f40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.584+0000 7f3555600700 1 -- 172.21.15.80:0/3911832749 >> 172.21.15.80:0/3911832749 conn(0x7f35500cfa80 msgr2=0x7f35500cb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:03.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.584+0000 7f3555600700 1 -- 172.21.15.80:0/3911832749 shutdown_connections 2024-05-10T04:27:03.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.584+0000 7f3555600700 1 -- 172.21.15.80:0/3911832749 wait complete. 2024-05-10T04:27:03.586 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 7 to deep-scrub 2024-05-10T04:27:03.610 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:27:03.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.867+0000 7f2f72000700 1 Processor -- start 2024-05-10T04:27:03.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.867+0000 7f2f72000700 1 -- start start 2024-05-10T04:27:03.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.869+0000 7f2f72000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c0b2ac0 0x7f2f6c0ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.869+0000 7f2f72000700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2f6c071d30 0x7f2f6c15add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.869+0000 7f2f72000700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c15e4e0 con 0x7f2f6c0cf320 2024-05-10T04:27:03.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.869+0000 7f2f72000700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6c15e7c0 con 0x7f2f6c071d30 2024-05-10T04:27:03.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.869+0000 7f2f72000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c15eaa0 con 0x7f2f6c0b2ac0 2024-05-10T04:27:03.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.869+0000 7f2f6aa00700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2f6c0cf320 0x7f2f6c071620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46600/0 (socket says 172.21.15.80:46600) 2024-05-10T04:27:03.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.869+0000 7f2f6aa00700 1 -- 172.21.15.80:0/3012592019 learned_addr learned my addr 172.21.15.80:0/3012592019 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:27:03.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.869+0000 7f2f6b400700 1 --2- 172.21.15.80:0/3012592019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c0b2ac0 0x7f2f6c0ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.869+0000 7f2f6be00700 1 --2- 172.21.15.80:0/3012592019 >> v2:172.21.15.106:3300/0 conn(0x7f2f6c071d30 0x7f2f6c15add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.869+0000 7f2f6a000700 1 -- 172.21.15.80:0/3012592019 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294534701 0 0) 0x7f2f6c15e4e0 con 0x7f2f6c0cf320 2024-05-10T04:27:03.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.870+0000 7f2f6a000700 1 -- 172.21.15.80:0/3012592019 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f500035b0 con 0x7f2f6c0cf320 2024-05-10T04:27:03.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.870+0000 7f2f6a000700 1 -- 172.21.15.80:0/3012592019 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4196194701 0 0) 0x7f2f500035b0 con 0x7f2f6c0cf320 2024-05-10T04:27:03.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.870+0000 7f2f6a000700 1 -- 172.21.15.80:0/3012592019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c0b2ac0 msgr2=0x7f2f6c0ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:27:03.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.870+0000 7f2f6a000700 1 --2- 172.21.15.80:0/3012592019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c0b2ac0 0x7f2f6c0ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.870+0000 7f2f6a000700 1 -- 172.21.15.80:0/3012592019 >> v2:172.21.15.106:3300/0 conn(0x7f2f6c071d30 msgr2=0x7f2f6c15add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:27:03.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.870+0000 7f2f6a000700 1 --2- 172.21.15.80:0/3012592019 >> v2:172.21.15.106:3300/0 conn(0x7f2f6c071d30 0x7f2f6c15add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.870+0000 7f2f6a000700 1 -- 172.21.15.80:0/3012592019 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c15ed80 con 0x7f2f6c0cf320 2024-05-10T04:27:03.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.870+0000 7f2f6a000700 1 -- 172.21.15.80:0/3012592019 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7f2f58001670 con 0x7f2f6c0cf320 2024-05-10T04:27:03.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.870+0000 7f2f6a000700 1 -- 172.21.15.80:0/3012592019 >> v1:172.21.15.80:6789/0 conn(0x7f2f6c0cf320 legacy=0x7f2f6c071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.870+0000 7f2f6a000700 1 --2- 172.21.15.80:0/3012592019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c0b2ac0 0x7f2f50003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.870+0000 7f2f6a000700 1 --2- 172.21.15.80:0/3012592019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f50003fd0 0x7f2f50004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.870+0000 7f2f6a000700 1 --2- 172.21.15.80:0/3012592019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f50004d90 0x7f2f500051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.870+0000 7f2f6a000700 1 -- 172.21.15.80:0/3012592019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c15e7c0 con 0x7f2f50003fd0 2024-05-10T04:27:03.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.870+0000 7f2f6a000700 1 -- 172.21.15.80:0/3012592019 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c15eaa0 con 0x7f2f50004d90 2024-05-10T04:27:03.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.870+0000 7f2f6a000700 1 -- 172.21.15.80:0/3012592019 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5000dcd0 con 0x7f2f6c0b2ac0 2024-05-10T04:27:03.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.870+0000 7f2f6aa00700 1 --2- 172.21.15.80:0/3012592019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f50003fd0 0x7f2f50004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.871+0000 7f2f6b400700 1 --2- 172.21.15.80:0/3012592019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c0b2ac0 0x7f2f50003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.871+0000 7f2f6be00700 1 --2- 172.21.15.80:0/3012592019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f50004d90 0x7f2f500051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.871+0000 7f2f6aa00700 1 -- 172.21.15.80:0/3012592019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c0b2ac0 msgr2=0x7f2f50003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:27:03.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.871+0000 7f2f6aa00700 1 --2- 172.21.15.80:0/3012592019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c0b2ac0 0x7f2f50003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.871+0000 7f2f6aa00700 1 -- 172.21.15.80:0/3012592019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f50004d90 msgr2=0x7f2f500051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:27:03.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.871+0000 7f2f6aa00700 1 --2- 172.21.15.80:0/3012592019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f50004d90 0x7f2f500051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.871+0000 7f2f6aa00700 1 -- 172.21.15.80:0/3012592019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f500035b0 con 0x7f2f50003fd0 2024-05-10T04:27:03.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.871+0000 7f2f6aa00700 1 --2- 172.21.15.80:0/3012592019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f50003fd0 0x7f2f50004850 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c158a40 tx=0x7f2f50005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa3fbd9dd49210f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:03.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.871+0000 7f2f6a000700 1 -- 172.21.15.80:0/3012592019 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f58007b70 con 0x7f2f50003fd0 2024-05-10T04:27:03.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.871+0000 7f2f6a000700 1 -- 172.21.15.80:0/3012592019 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5800ccd0 con 0x7f2f50003fd0 2024-05-10T04:27:03.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.871+0000 7f2f6a000700 1 -- 172.21.15.80:0/3012592019 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f58005ba0 con 0x7f2f50003fd0 2024-05-10T04:27:03.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.872+0000 7f2f72000700 1 -- 172.21.15.80:0/3012592019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f50003fd0 msgr2=0x7f2f50004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.872+0000 7f2f72000700 1 --2- 172.21.15.80:0/3012592019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f50003fd0 0x7f2f50004850 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c158a40 tx=0x7f2f50005880 comp rx=0 tx=0).stop 2024-05-10T04:27:03.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.872+0000 7f2f6be00700 1 -- 172.21.15.80:0/3012592019 reap_dead start 2024-05-10T04:27:03.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.872+0000 7f2f72000700 1 -- 172.21.15.80:0/3012592019 shutdown_connections 2024-05-10T04:27:03.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.872+0000 7f2f72000700 1 -- 172.21.15.80:0/3012592019 >> 172.21.15.80:0/3012592019 conn(0x7f2f6c06b470 msgr2=0x7f2f6c0b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:03.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.872+0000 7f2f72000700 1 -- 172.21.15.80:0/3012592019 shutdown_connections 2024-05-10T04:27:03.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.872+0000 7f2f72000700 1 -- 172.21.15.80:0/3012592019 wait complete. 2024-05-10T04:27:03.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.875+0000 7f2f72000700 1 Processor -- start 2024-05-10T04:27:03.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.875+0000 7f2f72000700 1 -- start start 2024-05-10T04:27:03.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.876+0000 7f2f72000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f50003fd0 0x7f2f6c140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.876+0000 7f2f72000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f6c15dc40 0x7f2f6c1554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.876+0000 7f2f72000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c1f7e30 0x7f2f6c13dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.876+0000 7f2f72000700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c155fa0 con 0x7f2f50003fd0 2024-05-10T04:27:03.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.876+0000 7f2f72000700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c140cf0 con 0x7f2f6c15dc40 2024-05-10T04:27:03.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.876+0000 7f2f72000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c144460 con 0x7f2f6c1f7e30 2024-05-10T04:27:03.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.876+0000 7f2f6b400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f50003fd0 0x7f2f6c140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.876+0000 7f2f6b400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f50003fd0 0x7f2f6c140640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40234/0 (socket says 172.21.15.80:40234) 2024-05-10T04:27:03.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.876+0000 7f2f6b400700 1 -- 172.21.15.80:0/3333194415 learned_addr learned my addr 172.21.15.80:0/3333194415 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:27:03.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.877+0000 7f2f6b400700 1 -- 172.21.15.80:0/3333194415 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c1f7e30 msgr2=0x7f2f6c13dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.877+0000 7f2f6b400700 1 --2- 172.21.15.80:0/3333194415 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c1f7e30 0x7f2f6c13dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.877+0000 7f2f6b400700 1 -- 172.21.15.80:0/3333194415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f6c15dc40 msgr2=0x7f2f6c1554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.877+0000 7f2f6b400700 1 --2- 172.21.15.80:0/3333194415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f6c15dc40 0x7f2f6c1554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.877+0000 7f2f6b400700 1 -- 172.21.15.80:0/3333194415 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c140f40 con 0x7f2f50003fd0 2024-05-10T04:27:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.877+0000 7f2f6b400700 1 --2- 172.21.15.80:0/3333194415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f50003fd0 0x7f2f6c140640 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c012ae0 tx=0x7f2f5c012ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.877+0000 7f2f63400700 1 -- 172.21.15.80:0/3333194415 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c00c070 con 0x7f2f50003fd0 2024-05-10T04:27:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.877+0000 7f2f63400700 1 -- 172.21.15.80:0/3333194415 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c010cf0 con 0x7f2f50003fd0 2024-05-10T04:27:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.877+0000 7f2f72000700 1 -- 172.21.15.80:0/3333194415 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c141220 con 0x7f2f50003fd0 2024-05-10T04:27:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.877+0000 7f2f63400700 1 -- 172.21.15.80:0/3333194415 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c01c6b0 con 0x7f2f50003fd0 2024-05-10T04:27:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.877+0000 7f2f72000700 1 -- 172.21.15.80:0/3333194415 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c1f7630 con 0x7f2f50003fd0 2024-05-10T04:27:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.878+0000 7f2f72000700 1 -- 172.21.15.80:0/3333194415 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c074af0 con 0x7f2f50003fd0 2024-05-10T04:27:03.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.879+0000 7f2f63400700 1 -- 172.21.15.80:0/3333194415 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2f5c019070 con 0x7f2f50003fd0 2024-05-10T04:27:03.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.880+0000 7f2f63400700 1 --2- 172.21.15.80:0/3333194415 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2f4c06acc0 0x7f2f4c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:03.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.880+0000 7f2f63400700 1 -- 172.21.15.80:0/3333194415 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2f5c089900 con 0x7f2f50003fd0 2024-05-10T04:27:03.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.881+0000 7f2f6aa00700 1 --2- 172.21.15.80:0/3333194415 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2f4c06acc0 0x7f2f4c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:03.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.881+0000 7f2f6aa00700 1 --2- 172.21.15.80:0/3333194415 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2f4c06acc0 0x7f2f4c06d1d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c1f74f0 tx=0x7f2f5800f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:03.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:03.885+0000 7f2f63400700 1 -- 172.21.15.80:0/3333194415 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2f5c054d70 con 0x7f2f50003fd0 2024-05-10T04:27:04.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:04.085+0000 7f2f72000700 1 -- 172.21.15.80:0/3333194415 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f6c151cf0 con 0x7f2f4c06acc0 2024-05-10T04:27:04.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:04.088+0000 7f2f63400700 1 -- 172.21.15.80:0/3333194415 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50561 (secure 0 0 0) 0x7f2f6c151cf0 con 0x7f2f4c06acc0 2024-05-10T04:27:04.090 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:27:04.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:04.090+0000 7f2f72000700 1 -- 172.21.15.80:0/3333194415 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2f4c06acc0 msgr2=0x7f2f4c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:04.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:04.090+0000 7f2f72000700 1 --2- 172.21.15.80:0/3333194415 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2f4c06acc0 0x7f2f4c06d1d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c1f74f0 tx=0x7f2f5800f000 comp rx=0 tx=0).stop 2024-05-10T04:27:04.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:04.090+0000 7f2f72000700 1 -- 172.21.15.80:0/3333194415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f50003fd0 msgr2=0x7f2f6c140640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:04.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:04.090+0000 7f2f72000700 1 --2- 172.21.15.80:0/3333194415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f50003fd0 0x7f2f6c140640 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c012ae0 tx=0x7f2f5c012ea0 comp rx=0 tx=0).stop 2024-05-10T04:27:04.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:04.091+0000 7f2f72000700 1 -- 172.21.15.80:0/3333194415 shutdown_connections 2024-05-10T04:27:04.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:04.091+0000 7f2f72000700 1 --2- 172.21.15.80:0/3333194415 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f2f4c06acc0 0x7f2f4c06d1d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:04.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:04.091+0000 7f2f72000700 1 --2- 172.21.15.80:0/3333194415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f50003fd0 0x7f2f6c140640 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:04.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:04.091+0000 7f2f72000700 1 --2- 172.21.15.80:0/3333194415 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f6c1f7e30 0x7f2f6c13dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:04.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:04.091+0000 7f2f72000700 1 --2- 172.21.15.80:0/3333194415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f6c15dc40 0x7f2f6c1554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:04.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:04.091+0000 7f2f72000700 1 -- 172.21.15.80:0/3333194415 >> 172.21.15.80:0/3333194415 conn(0x7f2f6c06b470 msgr2=0x7f2f6c0ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:04.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:04.091+0000 7f2f72000700 1 -- 172.21.15.80:0/3333194415 shutdown_connections 2024-05-10T04:27:04.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:04.091+0000 7f2f72000700 1 -- 172.21.15.80:0/3333194415 wait complete. 2024-05-10T04:27:04.093 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-10T04:27:04.117 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2024-05-10T04:27:02.809092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224804,"kb_used_data":4520,"kb_used_omap":12,"kb_used_meta":220147,"kb_avail":754749916,"statfs":{"total":773094113280,"available":772863913984,"internally_reserved":0,"allocated":4628480,"data_stored":2537024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":225431096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002484"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T04:26:49.984374+0000","last_change":"2024-05-10T04:22:27.829537+0000","last_active":"2024-05-10T04:26:49.984374+0000","last_peered":"2024-05-10T04:26:49.984374+0000","last_clean":"2024-05-10T04:26:49.984374+0000","last_became_active":"2024-05-10T04:22:27.828179+0000","last_became_peered":"2024-05-10T04:22:27.828179+0000","last_unstale":"2024-05-10T04:26:49.984374+0000","last_undegraded":"2024-05-10T04:26:49.984374+0000","last_fullsized":"2024-05-10T04:26:49.984374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:22:26.813824+0000","last_clean_scrub_stamp":"2024-05-10T04:22:26.813824+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:23.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":759904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82599999999999996,"5min":1.216,"15min":1.216},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81799999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73299999999999998,"15min":0.74399999999999999},"min":{"1min":0.58699999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92700000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.625,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.79900000000000004,"5min":1.181,"15min":1.181},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.68300000000000005,"15min":0.68600000000000005},"min":{"1min":0.53900000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.3320000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73999999999999999,"15min":0.76000000000000001},"min":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86899999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69999999999999996,"15min":0.70999999999999996},"min":{"1min":0.504,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85999999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.79200000000000004},"min":{"1min":0.54100000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92700000000000005,"5min":1.155,"15min":1.155},"last":0.52600000000000002}]},{"osd":4,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68300000000000005,"15min":0.68000000000000005},"min":{"1min":0.52100000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95599999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71699999999999997,"15min":0.71399999999999997},"min":{"1min":0.50900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85999999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76400000000000001,"15min":0.77800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.99299999999999999,"5min":1.056,"15min":1.056},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.503,"5min":0.438,"15min":0.438},"max":{"1min":0.94899999999999995,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.85999999999999999,"15min":0.86599999999999999},"min":{"1min":0.71599999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0189999999999999,"5min":1.252,"15min":1.252},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.84899999999999998,"15min":0.877},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0349999999999999,"5min":2.206,"15min":2.206},"last":0.69899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71099999999999997,"15min":0.71499999999999997},"min":{"1min":0.50600000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95699999999999996,"5min":1,"15min":1},"last":0.77200000000000002}]},{"osd":1,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.91900000000000004,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95699999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78500000000000003}]},{"osd":2,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.68600000000000005},"min":{"1min":0.51700000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89500000000000002,"5min":1.048,"15min":1.048},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.53900000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88300000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.623}]},{"osd":3,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70599999999999996,"15min":0.69299999999999995},"min":{"1min":0.58099999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85599999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.497,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89800000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.51500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.95399999999999996,"5min":1.079,"15min":1.079},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45600000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.90200000000000002,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.747,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95399999999999996,"5min":1.036,"15min":1.036},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.63900000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.999,"5min":1.01,"15min":1.01},"last":0.84499999999999997}]},{"osd":7,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":0.99199999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82999999999999996,"15min":0.83799999999999997},"min":{"1min":0.63700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97999999999999998,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.80900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.496,"15min":0.57099999999999995},"min":{"1min":0.311,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.52100000000000002,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.55000000000000004,"15min":0.61199999999999999},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.65700000000000003,"5min":3.347,"15min":3.347},"last":0.53300000000000003}]},{"osd":2,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.502,"15min":0.53200000000000003},"min":{"1min":0.39800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.56399999999999995,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.48099999999999998,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.51500000000000001,"5min":1.294,"15min":1.294},"last":0.47499999999999998}]},{"osd":3,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56899999999999995,"15min":0.61799999999999999},"min":{"1min":0.42899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.57599999999999996,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.502},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.52800000000000002,"15min":0.59799999999999998},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.60199999999999998,"5min":3.629,"15min":3.629},"last":0.43099999999999999}]},{"osd":4,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.94999999999999996,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.77600000000000002,"15min":0.78300000000000003},"min":{"1min":0.58799999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.90100000000000002,"5min":1.464,"15min":1.464},"last":0.85199999999999998}]},{"osd":5,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.77200000000000002,"15min":0.80400000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90600000000000003,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76400000000000001,"15min":0.76500000000000001},"min":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.91900000000000004,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.80500000000000005,"15min":0.81599999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91800000000000004,"5min":2.391,"15min":2.391},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78200000000000003,"15min":0.81699999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.89400000000000002,"5min":1.625,"15min":1.625},"last":0.89800000000000002}]},{"osd":7,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78900000000000003,"15min":0.83699999999999997},"min":{"1min":0.57299999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89500000000000002,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81000000000000005,"15min":0.84299999999999997},"min":{"1min":0.58499999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.99199999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.88600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":1024000,"data_stored":759904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.48899999999999999,"15min":0.52100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57199999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.371},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.52000000000000002,"15min":0.55200000000000005},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.51100000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.47099999999999997,"15min":0.51900000000000002},"min":{"1min":0.33200000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.47199999999999998,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54700000000000004,"15min":0.59499999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.57699999999999996,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57199999999999995,"15min":0.626},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.61099999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.52700000000000002,"15min":0.56200000000000006},"min":{"1min":0.38,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.56399999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.65500000000000003}]},{"osd":4,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85599999999999998,"5min":1.034,"15min":1.034},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.78400000000000003,"15min":0.79400000000000004},"min":{"1min":0.59299999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.93899999999999995,"5min":1.492,"15min":1.492},"last":0.77700000000000002}]},{"osd":5,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70499999999999996,"15min":0.69599999999999995},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.79600000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.56999999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91000000000000003,"5min":1.071,"15min":1.071},"last":0.82699999999999996}]},{"osd":6,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.51700000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94999999999999996,"5min":1.091,"15min":1.091},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.58199999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0049999999999999,"5min":1.052,"15min":1.052},"last":0.76200000000000001}]},{"osd":7,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.81499999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.96299999999999997,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.92200000000000004,"5min":1.105,"15min":1.105},"last":0.80300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.52500000000000002,"15min":0.63300000000000001},"min":{"1min":0.28699999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.621,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.501},{"interface":"front","average":{"1min":0.432,"5min":0.52500000000000002,"15min":0.63},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52300000000000002,"5min":5.883,"15min":5.883},"last":0.38200000000000001}]},{"osd":1,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.56399999999999995,"15min":0.65400000000000003},"min":{"1min":0.33600000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64800000000000002,"5min":4.1440000000000001,"15min":4.1440000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.58699999999999997,"15min":0.69299999999999995},"min":{"1min":0.39300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73699999999999999,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.48799999999999999}]},{"osd":3,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51800000000000002,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.60199999999999998,"5min":3.452,"15min":3.452},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58499999999999996,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.64600000000000002,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.79500000000000004,"15min":0.82699999999999996},"min":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.95899999999999996,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.86699999999999999},"min":{"1min":0.60699999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94199999999999995,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.77300000000000002}]},{"osd":5,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77600000000000002,"15min":0.82799999999999996},"min":{"1min":0.55500000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94299999999999995,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.58999999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92400000000000004,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.63800000000000001}]},{"osd":6,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78200000000000003,"15min":0.84799999999999998},"min":{"1min":0.56200000000000006,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98899999999999999,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.79900000000000004,"15min":0.84599999999999997},"min":{"1min":0.59499999999999997,"5min":0.501,"15min":0.501},"max":{"1min":0.99299999999999999,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.628}]},{"osd":7,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80400000000000005,"15min":0.83699999999999997},"min":{"1min":0.63800000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.97699999999999998,"5min":1.986,"15min":1.986},"last":0.753},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.84699999999999998,"15min":0.91500000000000004},"min":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.996,"5min":3.419,"15min":3.419},"last":0.65700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.42799999999999999,"15min":0.433},"min":{"1min":0.308,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.53000000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.47099999999999997,"15min":0.47999999999999998},"min":{"1min":0.33100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.59199999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.38900000000000001}]},{"osd":1,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.51500000000000001,"15min":0.57699999999999996},"min":{"1min":0.318,"5min":0.312,"15min":0.312},"max":{"1min":0.61599999999999999,"5min":3.6829999999999998,"15min":3.6829999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.50700000000000001,"15min":0.51800000000000002},"min":{"1min":0.374,"5min":0.316,"15min":0.316},"max":{"1min":0.61199999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.64200000000000002,"15min":0.73599999999999999},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69799999999999995,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.64500000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.628,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.58799999999999997}]},{"osd":4,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.73299999999999998},"min":{"1min":0.58599999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97299999999999998,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82899999999999996,"15min":0.88500000000000001},"min":{"1min":0.60699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0029999999999999,"5min":4.0010000000000003,"15min":4.0010000000000003},"last":0.81299999999999994}]},{"osd":5,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.82699999999999996,"15min":0.88900000000000001},"min":{"1min":0.61299999999999999,"5min":0.501,"15min":0.501},"max":{"1min":0.94699999999999995,"5min":4.024,"15min":4.024},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.501,"5min":0.495,"15min":0.495},"max":{"1min":1.014,"5min":1.456,"15min":1.456},"last":0.80400000000000005}]},{"osd":6,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76800000000000002,"15min":0.76600000000000001},"min":{"1min":0.58099999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.97699999999999998,"5min":1.502,"15min":1.502},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77300000000000002,"15min":0.77600000000000002},"min":{"1min":0.624,"5min":0.497,"15min":0.497},"max":{"1min":0.95899999999999996,"5min":1.474,"15min":1.474},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.66300000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0289999999999999,"5min":1.369,"15min":1.369},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.88400000000000001,"15min":0.96099999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0469999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.89700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.71199999999999997,"15min":0.74299999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89900000000000002,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97299999999999998,"5min":2.641,"15min":2.641},"last":0.71799999999999997}]},{"osd":1,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.42999999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.754},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.48199999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.996,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.629}]},{"osd":2,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68000000000000005,"15min":0.66800000000000004},"min":{"1min":0.48399999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89700000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76400000000000001,"15min":0.77600000000000002},"min":{"1min":0.52600000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99299999999999999,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.47199999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":1.024,"15min":1.024},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.79700000000000004,"15min":0.81499999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.95499999999999996,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":0.85199999999999998}]},{"osd":5,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.65100000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.46800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.96099999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67500000000000004}]},{"osd":6,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.47499999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.58599999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.55800000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0149999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.82899999999999996,"15min":0.82299999999999995},"min":{"1min":0.65500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0269999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.77600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.64200000000000002,"15min":0.66700000000000004},"min":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70499999999999996,"5min":2.032,"15min":2.032},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.69199999999999995,"15min":0.73699999999999999},"min":{"1min":0.46400000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81399999999999995,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.68000000000000005}]},{"osd":1,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.73499999999999999,"15min":0.78100000000000003},"min":{"1min":0.53700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80200000000000005,"5min":2.089,"15min":2.089},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.53700000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.75900000000000001,"5min":1.964,"15min":1.964},"last":0.66200000000000003}]},{"osd":2,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.75700000000000001,"15min":0.82099999999999995},"min":{"1min":0.51000000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93100000000000005,"5min":2.577,"15min":2.577},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78800000000000003,"15min":0.84099999999999997},"min":{"1min":0.622,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.82799999999999996,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.70799999999999996}]},{"osd":3,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.77700000000000002,"15min":0.81699999999999995},"min":{"1min":0.55600000000000005,"5min":0.436,"15min":0.436},"max":{"1min":0.86299999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.753},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.77300000000000002,"15min":0.79800000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86099999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.76300000000000001}]},{"osd":4,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68500000000000005,"15min":0.71699999999999997},"min":{"1min":0.52800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.871,"5min":1.458,"15min":1.458},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77000000000000002,"15min":0.80400000000000005},"min":{"1min":0.61599999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89700000000000002,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.754,"15min":0.73299999999999998},"min":{"1min":0.58799999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92800000000000005,"5min":1.595,"15min":1.595},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79000000000000004,"15min":0.79700000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91400000000000003,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.86299999999999999,"15min":0.94399999999999995},"min":{"1min":0.56699999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95699999999999996,"5min":4.0700000000000003,"15min":4.0700000000000003},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.83299999999999996,"15min":0.874},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94399999999999995,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.83499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:27:04.121 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-10T04:22:26.813824+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=26, tm_sec=55, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T04:27:04.121 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-10T04:27:24.122 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:27:24.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.405+0000 7f110c800700 1 Processor -- start 2024-05-10T04:27:24.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.405+0000 7f110c800700 1 -- start start 2024-05-10T04:27:24.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.407+0000 7f110c800700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f110415b870 0x7f110415c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:24.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.407+0000 7f110c800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11040cdde0 0x7f11040b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:24.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.407+0000 7f110c800700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11040cf360 con 0x7f11040ce1f0 2024-05-10T04:27:24.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.407+0000 7f110c800700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110415c730 con 0x7f110415b870 2024-05-10T04:27:24.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.407+0000 7f110c800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11040ce750 con 0x7f11040cdde0 2024-05-10T04:27:24.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.407+0000 7f110a800700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f11040ce1f0 0x7f110415ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41054/0 (socket says 172.21.15.80:41054) 2024-05-10T04:27:24.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.407+0000 7f110a800700 1 -- 172.21.15.80:0/3805026084 learned_addr learned my addr 172.21.15.80:0/3805026084 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:27:24.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.407+0000 7f1109e00700 1 --2- 172.21.15.80:0/3805026084 >> v2:172.21.15.106:3300/0 conn(0x7f110415b870 0x7f110415c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:24.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.407+0000 7f1109400700 1 --2- 172.21.15.80:0/3805026084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11040cdde0 0x7f11040b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:24.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.407+0000 7f1108a00700 1 -- 172.21.15.80:0/3805026084 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212267094 0 0) 0x7f11040cf360 con 0x7f11040ce1f0 2024-05-10T04:27:24.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.407+0000 7f1108a00700 1 -- 172.21.15.80:0/3805026084 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10ec0035b0 con 0x7f11040ce1f0 2024-05-10T04:27:24.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.408+0000 7f1108a00700 1 -- 172.21.15.80:0/3805026084 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2019394016 0 0) 0x7f10ec0035b0 con 0x7f11040ce1f0 2024-05-10T04:27:24.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.408+0000 7f1108a00700 1 -- 172.21.15.80:0/3805026084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11040cdde0 msgr2=0x7f11040b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:27:24.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.408+0000 7f1108a00700 1 --2- 172.21.15.80:0/3805026084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11040cdde0 0x7f11040b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:24.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.408+0000 7f1108a00700 1 -- 172.21.15.80:0/3805026084 >> v2:172.21.15.106:3300/0 conn(0x7f110415b870 msgr2=0x7f110415c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:27:24.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.408+0000 7f1108a00700 1 --2- 172.21.15.80:0/3805026084 >> v2:172.21.15.106:3300/0 conn(0x7f110415b870 0x7f110415c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:24.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.408+0000 7f1108a00700 1 -- 172.21.15.80:0/3805026084 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11040cea30 con 0x7f11040ce1f0 2024-05-10T04:27:24.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.408+0000 7f1108a00700 1 -- 172.21.15.80:0/3805026084 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 15702072 0 0) 0x7f11000019f0 con 0x7f11040ce1f0 2024-05-10T04:27:24.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.408+0000 7f1108a00700 1 -- 172.21.15.80:0/3805026084 >> v1:172.21.15.80:6789/0 conn(0x7f11040ce1f0 legacy=0x7f110415ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:24.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.408+0000 7f1108a00700 1 --2- 172.21.15.80:0/3805026084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11040cdde0 0x7f10ec003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:24.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.408+0000 7f1108a00700 1 --2- 172.21.15.80:0/3805026084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10ec003fd0 0x7f10ec004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.408+0000 7f1108a00700 1 --2- 172.21.15.80:0/3805026084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10ec004d90 0x7f10ec0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.408+0000 7f1108a00700 1 -- 172.21.15.80:0/3805026084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110415c730 con 0x7f10ec004d90 2024-05-10T04:27:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.408+0000 7f1108a00700 1 -- 172.21.15.80:0/3805026084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11040ce750 con 0x7f10ec003fd0 2024-05-10T04:27:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.408+0000 7f1108a00700 1 -- 172.21.15.80:0/3805026084 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec00dd00 con 0x7f11040cdde0 2024-05-10T04:27:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.408+0000 7f110a800700 1 --2- 172.21.15.80:0/3805026084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10ec004d90 0x7f10ec0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.408+0000 7f1109e00700 1 --2- 172.21.15.80:0/3805026084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11040cdde0 0x7f10ec003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.408+0000 7f1109400700 1 --2- 172.21.15.80:0/3805026084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10ec003fd0 0x7f10ec004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.409+0000 7f1109e00700 1 -- 172.21.15.80:0/3805026084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10ec003fd0 msgr2=0x7f10ec004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:27:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.409+0000 7f1109e00700 1 --2- 172.21.15.80:0/3805026084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10ec003fd0 0x7f10ec004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.409+0000 7f1109e00700 1 -- 172.21.15.80:0/3805026084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10ec004d90 msgr2=0x7f10ec0051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:27:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.409+0000 7f1109e00700 1 --2- 172.21.15.80:0/3805026084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10ec004d90 0x7f10ec0051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.409+0000 7f1109e00700 1 -- 172.21.15.80:0/3805026084 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec0035b0 con 0x7f11040cdde0 2024-05-10T04:27:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.409+0000 7f110a800700 1 --2- 172.21.15.80:0/3805026084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10ec004d90 0x7f10ec0051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:27:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.409+0000 7f1109e00700 1 --2- 172.21.15.80:0/3805026084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11040cdde0 0x7f10ec003a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009b30 tx=0x7f10ec005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fa5fbb4f5cac036 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.409+0000 7f1108a00700 1 -- 172.21.15.80:0/3805026084 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f800e6c0 con 0x7f11040cdde0 2024-05-10T04:27:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.409+0000 7f1108a00700 1 -- 172.21.15.80:0/3805026084 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f800e820 con 0x7f11040cdde0 2024-05-10T04:27:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.409+0000 7f1108a00700 1 -- 172.21.15.80:0/3805026084 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f800eb90 con 0x7f11040cdde0 2024-05-10T04:27:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.410+0000 7f110c800700 1 -- 172.21.15.80:0/3805026084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11040cdde0 msgr2=0x7f10ec003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.410+0000 7f110c800700 1 --2- 172.21.15.80:0/3805026084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11040cdde0 0x7f10ec003a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009b30 tx=0x7f10ec005880 comp rx=0 tx=0).stop 2024-05-10T04:27:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.410+0000 7f110a800700 1 -- 172.21.15.80:0/3805026084 reap_dead start 2024-05-10T04:27:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.410+0000 7f110c800700 1 -- 172.21.15.80:0/3805026084 shutdown_connections 2024-05-10T04:27:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.410+0000 7f110c800700 1 -- 172.21.15.80:0/3805026084 >> 172.21.15.80:0/3805026084 conn(0x7f110406b470 msgr2=0x7f11040b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.410+0000 7f110c800700 1 -- 172.21.15.80:0/3805026084 shutdown_connections 2024-05-10T04:27:24.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.410+0000 7f110c800700 1 -- 172.21.15.80:0/3805026084 wait complete. 2024-05-10T04:27:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.412+0000 7f110c800700 1 Processor -- start 2024-05-10T04:27:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.413+0000 7f110c800700 1 -- start start 2024-05-10T04:27:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.414+0000 7f110c800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11040cdde0 0x7f1104139490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.414+0000 7f110c800700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f110415ef70 0x7f110415a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.414+0000 7f110c800700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f110415a6f0 0x7f11041f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.414+0000 7f110c800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1104135150 con 0x7f11040cdde0 2024-05-10T04:27:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.414+0000 7f110c800700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1104135ae0 con 0x7f110415a6f0 2024-05-10T04:27:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.414+0000 7f110c800700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1104135d20 con 0x7f110415ef70 2024-05-10T04:27:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.414+0000 7f1109e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11040cdde0 0x7f1104139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.414+0000 7f1109e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11040cdde0 0x7f1104139490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41612/0 (socket says 172.21.15.80:41612) 2024-05-10T04:27:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.414+0000 7f1109e00700 1 -- 172.21.15.80:0/3447296111 learned_addr learned my addr 172.21.15.80:0/3447296111 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:27:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.415+0000 7f110a800700 1 --2- 172.21.15.80:0/3447296111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f110415a6f0 0x7f11041f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.415+0000 7f1109400700 1 --2- 172.21.15.80:0/3447296111 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f110415ef70 0x7f110415a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.415+0000 7f1109e00700 1 -- 172.21.15.80:0/3447296111 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f110415ef70 msgr2=0x7f110415a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.415+0000 7f1109e00700 1 --2- 172.21.15.80:0/3447296111 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f110415ef70 0x7f110415a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.415+0000 7f1109e00700 1 -- 172.21.15.80:0/3447296111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f110415a6f0 msgr2=0x7f11041f3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.415+0000 7f1109e00700 1 --2- 172.21.15.80:0/3447296111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f110415a6f0 0x7f11041f3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.415+0000 7f1109e00700 1 -- 172.21.15.80:0/3447296111 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110415dc20 con 0x7f11040cdde0 2024-05-10T04:27:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.415+0000 7f110a800700 1 --2- 172.21.15.80:0/3447296111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f110415a6f0 0x7f11041f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:27:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.415+0000 7f1109400700 1 --2- 172.21.15.80:0/3447296111 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f110415ef70 0x7f110415a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:27:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.415+0000 7f1109e00700 1 --2- 172.21.15.80:0/3447296111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11040cdde0 0x7f1104139490 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00de90 tx=0x7f10f80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.415+0000 7f10fe000700 1 -- 172.21.15.80:0/3447296111 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f800e6c0 con 0x7f11040cdde0 2024-05-10T04:27:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.415+0000 7f10fe000700 1 -- 172.21.15.80:0/3447296111 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f8013e10 con 0x7f11040cdde0 2024-05-10T04:27:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.415+0000 7f10fe000700 1 -- 172.21.15.80:0/3447296111 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f801c690 con 0x7f11040cdde0 2024-05-10T04:27:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.415+0000 7f110c800700 1 -- 172.21.15.80:0/3447296111 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11041399d0 con 0x7f11040cdde0 2024-05-10T04:27:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.416+0000 7f110c800700 1 -- 172.21.15.80:0/3447296111 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1104135f70 con 0x7f11040cdde0 2024-05-10T04:27:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.416+0000 7f110c800700 1 -- 172.21.15.80:0/3447296111 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1104133a50 con 0x7f11040cdde0 2024-05-10T04:27:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.417+0000 7f10fe000700 1 -- 172.21.15.80:0/3447296111 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f10f801c7f0 con 0x7f11040cdde0 2024-05-10T04:27:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.418+0000 7f10fe000700 1 --2- 172.21.15.80:0/3447296111 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f10e806ac90 0x7f10e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.418+0000 7f10fe000700 1 -- 172.21.15.80:0/3447296111 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f10f808aaf0 con 0x7f11040cdde0 2024-05-10T04:27:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.419+0000 7f1109400700 1 --2- 172.21.15.80:0/3447296111 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f10e806ac90 0x7f10e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.420+0000 7f1109400700 1 --2- 172.21.15.80:0/3447296111 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f10e806ac90 0x7f10e806d1a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f110415b600 tx=0x7f10f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:24.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.423+0000 7f10fe000700 1 -- 172.21.15.80:0/3447296111 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f10f80560e0 con 0x7f11040cdde0 2024-05-10T04:27:24.483 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:27:24.488 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:27:24.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.645+0000 7f110c800700 1 -- 172.21.15.80:0/3447296111 --> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1104135150 con 0x7f10e806ac90 2024-05-10T04:27:24.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.648+0000 7f10fe000700 1 -- 172.21.15.80:0/3447296111 <== mgr.4104 v2:172.21.15.106:6832/41218 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50544 (secure 0 0 0) 0x7f1104135150 con 0x7f10e806ac90 2024-05-10T04:27:24.650 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:27:24.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.650+0000 7f110c800700 1 -- 172.21.15.80:0/3447296111 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f10e806ac90 msgr2=0x7f10e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:24.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.650+0000 7f110c800700 1 --2- 172.21.15.80:0/3447296111 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f10e806ac90 0x7f10e806d1a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f110415b600 tx=0x7f10f4008040 comp rx=0 tx=0).stop 2024-05-10T04:27:24.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.650+0000 7f110c800700 1 -- 172.21.15.80:0/3447296111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11040cdde0 msgr2=0x7f1104139490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:24.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.650+0000 7f110c800700 1 --2- 172.21.15.80:0/3447296111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11040cdde0 0x7f1104139490 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00de90 tx=0x7f10f80047c0 comp rx=0 tx=0).stop 2024-05-10T04:27:24.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.651+0000 7f110c800700 1 -- 172.21.15.80:0/3447296111 shutdown_connections 2024-05-10T04:27:24.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.651+0000 7f110c800700 1 --2- 172.21.15.80:0/3447296111 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f10e806ac90 0x7f10e806d1a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:24.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.651+0000 7f110c800700 1 --2- 172.21.15.80:0/3447296111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11040cdde0 0x7f1104139490 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:24.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.651+0000 7f110c800700 1 --2- 172.21.15.80:0/3447296111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f110415a6f0 0x7f11041f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:24.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.651+0000 7f110c800700 1 --2- 172.21.15.80:0/3447296111 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f110415ef70 0x7f110415a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:24.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.651+0000 7f110c800700 1 -- 172.21.15.80:0/3447296111 >> 172.21.15.80:0/3447296111 conn(0x7f110406b470 msgr2=0x7f11040cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:24.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.651+0000 7f110c800700 1 -- 172.21.15.80:0/3447296111 shutdown_connections 2024-05-10T04:27:24.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.651+0000 7f110c800700 1 -- 172.21.15.80:0/3447296111 wait complete. 2024-05-10T04:27:24.653 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-10T04:27:24.680 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-05-10T04:27:22.814268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224792,"kb_used_data":4520,"kb_used_omap":12,"kb_used_meta":220147,"kb_avail":754749928,"statfs":{"total":773094113280,"available":772863926272,"internally_reserved":0,"allocated":4628480,"data_stored":2537024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":225431096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003079"},"pg_stats":[{"pgid":"1.0","version":"37'119","reported_seq":194,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T04:27:04.737839+0000","last_change":"2024-05-10T04:27:04.737967+0000","last_active":"2024-05-10T04:27:04.737839+0000","last_peered":"2024-05-10T04:27:04.737839+0000","last_clean":"2024-05-10T04:27:04.737839+0000","last_became_active":"2024-05-10T04:22:27.828179+0000","last_became_peered":"2024-05-10T04:22:27.828179+0000","last_unstale":"2024-05-10T04:27:04.737839+0000","last_undegraded":"2024-05-10T04:27:04.737839+0000","last_fullsized":"2024-05-10T04:27:04.737839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'119","last_scrub_stamp":"2024-05-10T04:27:04.737802+0000","last_deep_scrub":"37'119","last_deep_scrub_stamp":"2024-05-10T04:27:04.737802+0000","last_clean_scrub_stamp":"2024-05-10T04:27:04.737802+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:58:50.170648+0000","scrub_duration":0.0067947420000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1024000,"data_stored":759904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82599999999999996,"5min":1.216,"15min":1.216},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81799999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.71299999999999997}]},{"osd":1,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73299999999999998,"15min":0.74399999999999999},"min":{"1min":0.58699999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92700000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.625,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.79900000000000004,"5min":1.181,"15min":1.181},"last":0.67500000000000004}]},{"osd":2,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.68300000000000005,"15min":0.68600000000000005},"min":{"1min":0.53900000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.3320000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73999999999999999,"15min":0.76000000000000001},"min":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86899999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.81100000000000005}]},{"osd":3,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69999999999999996,"15min":0.70999999999999996},"min":{"1min":0.504,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85999999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.79200000000000004},"min":{"1min":0.54100000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92700000000000005,"5min":1.155,"15min":1.155},"last":0.68899999999999995}]},{"osd":4,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68300000000000005,"15min":0.68000000000000005},"min":{"1min":0.52100000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95599999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71699999999999997,"15min":0.71399999999999997},"min":{"1min":0.50900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85999999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76400000000000001,"15min":0.77800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.99299999999999999,"5min":1.056,"15min":1.056},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.503,"5min":0.438,"15min":0.438},"max":{"1min":0.94899999999999995,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.85999999999999999,"15min":0.86599999999999999},"min":{"1min":0.71599999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0189999999999999,"5min":1.252,"15min":1.252},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.84899999999999998,"15min":0.877},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0349999999999999,"5min":2.206,"15min":2.206},"last":0.79000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71099999999999997,"15min":0.71499999999999997},"min":{"1min":0.50600000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95699999999999996,"5min":1,"15min":1},"last":0.64600000000000002}]},{"osd":1,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.91900000000000004,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95699999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.88600000000000001}]},{"osd":2,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.68600000000000005},"min":{"1min":0.51700000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89500000000000002,"5min":1.048,"15min":1.048},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.53900000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88300000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.75600000000000001}]},{"osd":3,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70599999999999996,"15min":0.69299999999999995},"min":{"1min":0.58099999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85599999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.497,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89800000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.73199999999999998}]},{"osd":4,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.51500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.95399999999999996,"5min":1.079,"15min":1.079},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45600000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.90200000000000002,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.747,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95399999999999996,"5min":1.036,"15min":1.036},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.63900000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.999,"5min":1.01,"15min":1.01},"last":0.83999999999999997}]},{"osd":7,"last update":"Fri May 10 04:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":0.99199999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82999999999999996,"15min":0.83799999999999997},"min":{"1min":0.63700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97999999999999998,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.82199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.496,"15min":0.57099999999999995},"min":{"1min":0.311,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.52100000000000002,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.55000000000000004,"15min":0.61199999999999999},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.65700000000000003,"5min":3.347,"15min":3.347},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.502,"15min":0.53200000000000003},"min":{"1min":0.39800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.56399999999999995,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.48099999999999998,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.51500000000000001,"5min":1.294,"15min":1.294},"last":0.45300000000000001}]},{"osd":3,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56899999999999995,"15min":0.61799999999999999},"min":{"1min":0.42899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.57599999999999996,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.52800000000000002,"15min":0.59799999999999998},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.60199999999999998,"5min":3.629,"15min":3.629},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.94999999999999996,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.77600000000000002,"15min":0.78300000000000003},"min":{"1min":0.58799999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.90100000000000002,"5min":1.464,"15min":1.464},"last":0.93600000000000005}]},{"osd":5,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.77200000000000002,"15min":0.80400000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90600000000000003,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.016},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76400000000000001,"15min":0.76500000000000001},"min":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.91900000000000004,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.873}]},{"osd":6,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.80500000000000005,"15min":0.81599999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91800000000000004,"5min":2.391,"15min":2.391},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78200000000000003,"15min":0.81699999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.89400000000000002,"5min":1.625,"15min":1.625},"last":0.82599999999999996}]},{"osd":7,"last update":"Fri May 10 04:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78900000000000003,"15min":0.83699999999999997},"min":{"1min":0.57299999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89500000000000002,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81000000000000005,"15min":0.84299999999999997},"min":{"1min":0.58499999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.99199999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.90200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":1024000,"data_stored":759904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.48899999999999999,"15min":0.52100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57199999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.52000000000000002,"15min":0.55200000000000005},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.51100000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.47099999999999997,"15min":0.51900000000000002},"min":{"1min":0.33200000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.47199999999999998,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54700000000000004,"15min":0.59499999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.57699999999999996,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.58099999999999996}]},{"osd":3,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57199999999999995,"15min":0.626},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.61099999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.627},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.52700000000000002,"15min":0.56200000000000006},"min":{"1min":0.38,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.56399999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85599999999999998,"5min":1.034,"15min":1.034},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.78400000000000003,"15min":0.79400000000000004},"min":{"1min":0.59299999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.93899999999999995,"5min":1.492,"15min":1.492},"last":0.79400000000000004}]},{"osd":5,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70499999999999996,"15min":0.69599999999999995},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.79600000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.749},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.56999999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91000000000000003,"5min":1.071,"15min":1.071},"last":0.68899999999999995}]},{"osd":6,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.51700000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94999999999999996,"5min":1.091,"15min":1.091},"last":0.877},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.58199999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0049999999999999,"5min":1.052,"15min":1.052},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri May 10 04:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.81499999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.96299999999999997,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.92200000000000004,"5min":1.105,"15min":1.105},"last":0.78400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.52500000000000002,"15min":0.63300000000000001},"min":{"1min":0.28699999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.621,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.52500000000000002,"15min":0.63},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52300000000000002,"5min":5.883,"15min":5.883},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.56399999999999995,"15min":0.65400000000000003},"min":{"1min":0.33600000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64800000000000002,"5min":4.1440000000000001,"15min":4.1440000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.58699999999999997,"15min":0.69299999999999995},"min":{"1min":0.39300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73699999999999999,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51800000000000002,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.60199999999999998,"5min":3.452,"15min":3.452},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58499999999999996,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.64600000000000002,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.61499999999999999}]},{"osd":4,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.79500000000000004,"15min":0.82699999999999996},"min":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.95899999999999996,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.86699999999999999},"min":{"1min":0.60699999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94199999999999995,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77600000000000002,"15min":0.82799999999999996},"min":{"1min":0.55500000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94299999999999995,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":0.753},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.58999999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92400000000000004,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.76500000000000001}]},{"osd":6,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78200000000000003,"15min":0.84799999999999998},"min":{"1min":0.56200000000000006,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98899999999999999,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.79900000000000004,"15min":0.84599999999999997},"min":{"1min":0.59499999999999997,"5min":0.501,"15min":0.501},"max":{"1min":0.99299999999999999,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.81899999999999995}]},{"osd":7,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80400000000000005,"15min":0.83699999999999997},"min":{"1min":0.63800000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.97699999999999998,"5min":1.986,"15min":1.986},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.84699999999999998,"15min":0.91500000000000004},"min":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.996,"5min":3.419,"15min":3.419},"last":0.73999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.42799999999999999,"15min":0.433},"min":{"1min":0.308,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.53000000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.434,"5min":0.47099999999999997,"15min":0.47999999999999998},"min":{"1min":0.33100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.59199999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.499}]},{"osd":1,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.51500000000000001,"15min":0.57699999999999996},"min":{"1min":0.318,"5min":0.312,"15min":0.312},"max":{"1min":0.61599999999999999,"5min":3.6829999999999998,"15min":3.6829999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.50700000000000001,"15min":0.51800000000000002},"min":{"1min":0.374,"5min":0.316,"15min":0.316},"max":{"1min":0.61199999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.64200000000000002,"15min":0.73599999999999999},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69799999999999995,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.64500000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.628,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.65800000000000003}]},{"osd":4,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.73299999999999998},"min":{"1min":0.58599999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97299999999999998,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82899999999999996,"15min":0.88500000000000001},"min":{"1min":0.60699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0029999999999999,"5min":4.0010000000000003,"15min":4.0010000000000003},"last":0.755}]},{"osd":5,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.82699999999999996,"15min":0.88900000000000001},"min":{"1min":0.61299999999999999,"5min":0.501,"15min":0.501},"max":{"1min":0.94699999999999995,"5min":4.024,"15min":4.024},"last":0.88},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.501,"5min":0.495,"15min":0.495},"max":{"1min":1.014,"5min":1.456,"15min":1.456},"last":0.74299999999999999}]},{"osd":6,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76800000000000002,"15min":0.76600000000000001},"min":{"1min":0.58099999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.97699999999999998,"5min":1.502,"15min":1.502},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77300000000000002,"15min":0.77600000000000002},"min":{"1min":0.624,"5min":0.497,"15min":0.497},"max":{"1min":0.95899999999999996,"5min":1.474,"15min":1.474},"last":0.90900000000000003}]},{"osd":7,"last update":"Fri May 10 04:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.66300000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0289999999999999,"5min":1.369,"15min":1.369},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.88400000000000001,"15min":0.96099999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0469999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.92400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.71199999999999997,"15min":0.74299999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89900000000000002,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97299999999999998,"5min":2.641,"15min":2.641},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.42999999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.751},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.48199999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.996,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.81000000000000005}]},{"osd":2,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68000000000000005,"15min":0.66800000000000004},"min":{"1min":0.48399999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89700000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76400000000000001,"15min":0.77600000000000002},"min":{"1min":0.52600000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99299999999999999,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.47199999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":1.024,"15min":1.024},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.79700000000000004,"15min":0.81499999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.95499999999999996,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.65100000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.46800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.96099999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.47499999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.58599999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri May 10 04:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.55800000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0149999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.624},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.82899999999999996,"15min":0.82299999999999995},"min":{"1min":0.65500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0269999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.85499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.64200000000000002,"15min":0.66700000000000004},"min":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70499999999999996,"5min":2.032,"15min":2.032},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.69199999999999995,"15min":0.73699999999999999},"min":{"1min":0.46400000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81399999999999995,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.73499999999999999,"15min":0.78100000000000003},"min":{"1min":0.53700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80200000000000005,"5min":2.089,"15min":2.089},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.53700000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.75900000000000001,"5min":1.964,"15min":1.964},"last":0.69699999999999995}]},{"osd":2,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.75700000000000001,"15min":0.82099999999999995},"min":{"1min":0.51000000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93100000000000005,"5min":2.577,"15min":2.577},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78800000000000003,"15min":0.84099999999999997},"min":{"1min":0.622,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.82799999999999996,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.71899999999999997}]},{"osd":3,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.77700000000000002,"15min":0.81699999999999995},"min":{"1min":0.55600000000000005,"5min":0.436,"15min":0.436},"max":{"1min":0.86299999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.77300000000000002,"15min":0.79800000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86099999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.873}]},{"osd":4,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68500000000000005,"15min":0.71699999999999997},"min":{"1min":0.52800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.871,"5min":1.458,"15min":1.458},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77000000000000002,"15min":0.80400000000000005},"min":{"1min":0.61599999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89700000000000002,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":0.48199999999999998}]},{"osd":6,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.754,"15min":0.73299999999999998},"min":{"1min":0.58799999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92800000000000005,"5min":1.595,"15min":1.595},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79000000000000004,"15min":0.79700000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91400000000000003,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.46000000000000002}]},{"osd":7,"last update":"Fri May 10 04:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.86299999999999999,"15min":0.94399999999999995},"min":{"1min":0.56699999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95699999999999996,"5min":4.0700000000000003,"15min":4.0700000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.83299999999999996,"15min":0.874},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94399999999999995,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.52300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:27:24.682 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-10T04:27:24.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.939+0000 7f00e9400700 1 Processor -- start 2024-05-10T04:27:24.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.939+0000 7f00e9400700 1 -- start start 2024-05-10T04:27:24.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.940+0000 7f00e9400700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f00e40b3280 0x7f00e40d3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:24.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.940+0000 7f00e9400700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f00e40b5d00 0x7f00e40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:24.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.940+0000 7f00e9400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e40d38d0 con 0x7f00e406c2f0 2024-05-10T04:27:24.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.940+0000 7f00e9400700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e40b6650 con 0x7f00e40b3280 2024-05-10T04:27:24.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.940+0000 7f00e9400700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e406cf70 con 0x7f00e40b5d00 2024-05-10T04:27:24.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.941+0000 7f00e2800700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f00e40b3280 0x7f00e40d3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:24.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.941+0000 7f00e3200700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f00e406c2f0 0x7f00e406c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41064/0 (socket says 172.21.15.80:41064) 2024-05-10T04:27:24.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.941+0000 7f00e3200700 1 -- 172.21.15.80:0/1422897865 learned_addr learned my addr 172.21.15.80:0/1422897865 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:27:24.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.941+0000 7f00e1e00700 1 --2- 172.21.15.80:0/1422897865 >> v2:172.21.15.106:3300/0 conn(0x7f00e40b5d00 0x7f00e40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:24.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.941+0000 7f00e2800700 1 -- 172.21.15.80:0/1422897865 >> v2:172.21.15.106:3300/0 conn(0x7f00e40b5d00 msgr2=0x7f00e40b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:27:24.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.941+0000 7f00e2800700 1 --2- 172.21.15.80:0/1422897865 >> v2:172.21.15.106:3300/0 conn(0x7f00e40b5d00 0x7f00e40b6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:24.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.941+0000 7f00e2800700 1 -- 172.21.15.80:0/1422897865 >> v1:172.21.15.80:6789/0 conn(0x7f00e406c2f0 legacy=0x7f00e406c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:24.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.941+0000 7f00e2800700 1 -- 172.21.15.80:0/1422897865 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e406d250 con 0x7f00e40b3280 2024-05-10T04:27:24.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.941+0000 7f00e1400700 1 -- 172.21.15.80:0/1422897865 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338536500 0 0) 0x7f00e40d38d0 con 0x7f00e406c2f0 2024-05-10T04:27:24.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.942+0000 7f00e2800700 1 --2- 172.21.15.80:0/1422897865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00e40b3280 0x7f00e40d3390 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f00e40ba030 tx=0x7f00d4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489b79248bf0c82 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:24.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.942+0000 7f00e1400700 1 -- 172.21.15.80:0/1422897865 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4011830 con 0x7f00e40b3280 2024-05-10T04:27:24.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.942+0000 7f00e1400700 1 -- 172.21.15.80:0/1422897865 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d4011990 con 0x7f00e40b3280 2024-05-10T04:27:24.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.942+0000 7f00e1400700 1 -- 172.21.15.80:0/1422897865 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4011d20 con 0x7f00e40b3280 2024-05-10T04:27:24.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.942+0000 7f00e9400700 1 -- 172.21.15.80:0/1422897865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00e40b3280 msgr2=0x7f00e40d3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:24.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.942+0000 7f00e9400700 1 --2- 172.21.15.80:0/1422897865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00e40b3280 0x7f00e40d3390 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f00e40ba030 tx=0x7f00d4009b20 comp rx=0 tx=0).stop 2024-05-10T04:27:24.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.942+0000 7f00e9400700 1 -- 172.21.15.80:0/1422897865 shutdown_connections 2024-05-10T04:27:24.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.942+0000 7f00e9400700 1 --2- 172.21.15.80:0/1422897865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00e40b3280 0x7f00e40d3390 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:24.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.943+0000 7f00e9400700 1 --2- 172.21.15.80:0/1422897865 >> v2:172.21.15.106:3300/0 conn(0x7f00e40b5d00 0x7f00e40b6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:24.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.943+0000 7f00e9400700 1 -- 172.21.15.80:0/1422897865 >> 172.21.15.80:0/1422897865 conn(0x7f00e40d40a0 msgr2=0x7f00e40d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:24.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.943+0000 7f00e9400700 1 -- 172.21.15.80:0/1422897865 shutdown_connections 2024-05-10T04:27:24.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.943+0000 7f00e9400700 1 -- 172.21.15.80:0/1422897865 wait complete. 2024-05-10T04:27:24.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.945+0000 7f00e9400700 1 Processor -- start 2024-05-10T04:27:24.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.946+0000 7f00e9400700 1 -- start start 2024-05-10T04:27:24.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.947+0000 7f00e9400700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00e406c2f0 0x7f00e41528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:24.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.947+0000 7f00e9400700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00e40b3280 0x7f00e414ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:24.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.947+0000 7f00e9400700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00e40b5d00 0x7f00e40b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:24.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.947+0000 7f00e9400700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e4152400 con 0x7f00e40b3280 2024-05-10T04:27:24.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.947+0000 7f00e9400700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e4152f60 con 0x7f00e406c2f0 2024-05-10T04:27:24.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.947+0000 7f00e9400700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e4150510 con 0x7f00e40b5d00 2024-05-10T04:27:24.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.948+0000 7f00e1e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00e40b3280 0x7f00e414ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:24.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.948+0000 7f00e1e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00e40b3280 0x7f00e414ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41628/0 (socket says 172.21.15.80:41628) 2024-05-10T04:27:24.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.948+0000 7f00e1e00700 1 -- 172.21.15.80:0/333880841 learned_addr learned my addr 172.21.15.80:0/333880841 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:27:24.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.948+0000 7f00e2800700 1 --2- 172.21.15.80:0/333880841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00e406c2f0 0x7f00e41528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:24.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.948+0000 7f00e3200700 1 --2- 172.21.15.80:0/333880841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00e40b5d00 0x7f00e40b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:24.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.948+0000 7f00e1e00700 1 -- 172.21.15.80:0/333880841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00e40b5d00 msgr2=0x7f00e40b8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:24.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.948+0000 7f00e1e00700 1 --2- 172.21.15.80:0/333880841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00e40b5d00 0x7f00e40b8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:24.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.948+0000 7f00e1e00700 1 -- 172.21.15.80:0/333880841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00e406c2f0 msgr2=0x7f00e41528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:24.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.948+0000 7f00e1e00700 1 --2- 172.21.15.80:0/333880841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00e406c2f0 0x7f00e41528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:24.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.948+0000 7f00e1e00700 1 -- 172.21.15.80:0/333880841 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d40094a0 con 0x7f00e40b3280 2024-05-10T04:27:24.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.948+0000 7f00e3200700 1 --2- 172.21.15.80:0/333880841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00e40b5d00 0x7f00e40b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:27:24.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.948+0000 7f00e1e00700 1 --2- 172.21.15.80:0/333880841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00e40b3280 0x7f00e414ffd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f00d000d7d0 tx=0x7f00d000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:24.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.948+0000 7f00daa00700 1 -- 172.21.15.80:0/333880841 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d00125f0 con 0x7f00e40b3280 2024-05-10T04:27:24.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.949+0000 7f00daa00700 1 -- 172.21.15.80:0/333880841 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d0012750 con 0x7f00e40b3280 2024-05-10T04:27:24.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.949+0000 7f00e9400700 1 -- 172.21.15.80:0/333880841 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e41531b0 con 0x7f00e40b3280 2024-05-10T04:27:24.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.949+0000 7f00daa00700 1 -- 172.21.15.80:0/333880841 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0012b00 con 0x7f00e40b3280 2024-05-10T04:27:24.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.949+0000 7f00e9400700 1 -- 172.21.15.80:0/333880841 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e4153770 con 0x7f00e40b3280 2024-05-10T04:27:24.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.950+0000 7f00e9400700 1 -- 172.21.15.80:0/333880841 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e40732b0 con 0x7f00e40b3280 2024-05-10T04:27:24.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.951+0000 7f00daa00700 1 -- 172.21.15.80:0/333880841 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f00d0012c60 con 0x7f00e40b3280 2024-05-10T04:27:24.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.952+0000 7f00daa00700 1 --2- 172.21.15.80:0/333880841 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f00c406ac90 0x7f00c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:24.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.952+0000 7f00daa00700 1 -- 172.21.15.80:0/333880841 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f00d00892c0 con 0x7f00e40b3280 2024-05-10T04:27:24.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.952+0000 7f00e2800700 1 --2- 172.21.15.80:0/333880841 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f00c406ac90 0x7f00c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:24.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.953+0000 7f00e2800700 1 --2- 172.21.15.80:0/333880841 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f00c406ac90 0x7f00c406d1a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f00d40090b0 tx=0x7f00d401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:24.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:24.957+0000 7f00daa00700 1 -- 172.21.15.80:0/333880841 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f00d0054670 con 0x7f00e40b3280 2024-05-10T04:27:25.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.166+0000 7f00e9400700 1 -- 172.21.15.80:0/333880841 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f00e4074ac0 con 0x7f00e40b3280 2024-05-10T04:27:25.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.171+0000 7f00daa00700 1 -- 172.21.15.80:0/333880841 <== mon.0 v2:172.21.15.80:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00d00890d0 con 0x7f00e40b3280 2024-05-10T04:27:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.172+0000 7f00daa00700 1 -- 172.21.15.80:0/333880841 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f00d0057c90 con 0x7f00e40b3280 2024-05-10T04:27:25.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.175+0000 7f00e9400700 1 -- 172.21.15.80:0/333880841 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f00c406ac90 msgr2=0x7f00c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:25.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.175+0000 7f00e9400700 1 --2- 172.21.15.80:0/333880841 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f00c406ac90 0x7f00c406d1a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f00d40090b0 tx=0x7f00d401c040 comp rx=0 tx=0).stop 2024-05-10T04:27:25.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.175+0000 7f00e9400700 1 -- 172.21.15.80:0/333880841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00e40b3280 msgr2=0x7f00e414ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:25.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.175+0000 7f00e9400700 1 --2- 172.21.15.80:0/333880841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00e40b3280 0x7f00e414ffd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f00d000d7d0 tx=0x7f00d000db90 comp rx=0 tx=0).stop 2024-05-10T04:27:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.175+0000 7f00e9400700 1 -- 172.21.15.80:0/333880841 shutdown_connections 2024-05-10T04:27:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.175+0000 7f00e9400700 1 --2- 172.21.15.80:0/333880841 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f00c406ac90 0x7f00c406d1a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.175+0000 7f00e9400700 1 --2- 172.21.15.80:0/333880841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00e40b5d00 0x7f00e40b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.175+0000 7f00e9400700 1 --2- 172.21.15.80:0/333880841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00e406c2f0 0x7f00e41528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.175+0000 7f00e9400700 1 --2- 172.21.15.80:0/333880841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00e40b3280 0x7f00e414ffd0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.175+0000 7f00e9400700 1 -- 172.21.15.80:0/333880841 >> 172.21.15.80:0/333880841 conn(0x7f00e40d40a0 msgr2=0x7f00e40ccf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.175+0000 7f00e9400700 1 -- 172.21.15.80:0/333880841 shutdown_connections 2024-05-10T04:27:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.175+0000 7f00e9400700 1 -- 172.21.15.80:0/333880841 wait complete. 2024-05-10T04:27:25.202 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T04:27:25.202 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:27:25.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.460+0000 7f741a000700 1 Processor -- start 2024-05-10T04:27:25.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.460+0000 7f741a000700 1 -- start start 2024-05-10T04:27:25.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.462+0000 7f741a000700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7414141560 0x7f74140cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:25.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.462+0000 7f741a000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f741415f170 0x7f741406da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:25.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.462+0000 7f741a000700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74140ce730 con 0x7f74140ce320 2024-05-10T04:27:25.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.462+0000 7f741a000700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74140ce960 con 0x7f7414141560 2024-05-10T04:27:25.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.462+0000 7f741a000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74140cec40 con 0x7f741415f170 2024-05-10T04:27:25.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.463+0000 7f7418c00700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7414141560 0x7f74140cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:25.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.463+0000 7f7419600700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f741415f170 0x7f741406da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:25.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.463+0000 7f7413e00700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f74140ce320 0x7f741415ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:56546/0 (socket says 172.21.15.80:56546) 2024-05-10T04:27:25.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.463+0000 7f7413e00700 1 -- 172.21.15.80:0/1630380114 learned_addr learned my addr 172.21.15.80:0/1630380114 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-10T04:27:25.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.463+0000 7f7413400700 1 -- 172.21.15.80:0/1630380114 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894346532 0 0) 0x7f74140ce730 con 0x7f74140ce320 2024-05-10T04:27:25.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.463+0000 7f7413400700 1 -- 172.21.15.80:0/1630380114 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73fc0035b0 con 0x7f74140ce320 2024-05-10T04:27:25.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.463+0000 7f7418c00700 1 -- 172.21.15.80:0/1630380114 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f741415f170 msgr2=0x7f741406da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:27:25.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.463+0000 7f7418c00700 1 --2- 172.21.15.80:0/1630380114 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f741415f170 0x7f741406da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:25.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.463+0000 7f7418c00700 1 -- 172.21.15.80:0/1630380114 >> v1:172.21.15.106:6789/0 conn(0x7f74140ce320 legacy=0x7f741415ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:25.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.463+0000 7f7418c00700 1 -- 172.21.15.80:0/1630380114 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74140cef20 con 0x7f7414141560 2024-05-10T04:27:25.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.463+0000 7f7419600700 1 --2- 172.21.15.80:0/1630380114 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f741415f170 0x7f741406da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:27:25.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.464+0000 7f7418c00700 1 --2- 172.21.15.80:0/1630380114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7414141560 0x7f74140cdde0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7408009840 tx=0x7f7408009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=189fef4cf5afee2b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:25.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.464+0000 7f7413400700 1 -- 172.21.15.80:0/1630380114 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408011830 con 0x7f7414141560 2024-05-10T04:27:25.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.464+0000 7f7413400700 1 -- 172.21.15.80:0/1630380114 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7408011990 con 0x7f7414141560 2024-05-10T04:27:25.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.464+0000 7f7413400700 1 -- 172.21.15.80:0/1630380114 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408011d40 con 0x7f7414141560 2024-05-10T04:27:25.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.465+0000 7f741a000700 1 -- 172.21.15.80:0/1630380114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7414141560 msgr2=0x7f74140cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:25.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.465+0000 7f741a000700 1 --2- 172.21.15.80:0/1630380114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7414141560 0x7f74140cdde0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7408009840 tx=0x7f7408009b50 comp rx=0 tx=0).stop 2024-05-10T04:27:25.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.465+0000 7f741a000700 1 -- 172.21.15.80:0/1630380114 shutdown_connections 2024-05-10T04:27:25.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.465+0000 7f741a000700 1 --2- 172.21.15.80:0/1630380114 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f741415f170 0x7f741406da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:25.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.465+0000 7f741a000700 1 --2- 172.21.15.80:0/1630380114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7414141560 0x7f74140cdde0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:25.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.465+0000 7f741a000700 1 -- 172.21.15.80:0/1630380114 >> 172.21.15.80:0/1630380114 conn(0x7f74140b1dd0 msgr2=0x7f74140cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:25.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.465+0000 7f741a000700 1 -- 172.21.15.80:0/1630380114 shutdown_connections 2024-05-10T04:27:25.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.465+0000 7f741a000700 1 -- 172.21.15.80:0/1630380114 wait complete. 2024-05-10T04:27:25.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.467+0000 7f741a000700 1 Processor -- start 2024-05-10T04:27:25.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.467+0000 7f741a000700 1 -- start start 2024-05-10T04:27:25.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.469+0000 7f741a000700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74140ce320 0x7f74141592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:25.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.469+0000 7f741a000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74141434b0 0x7f74141438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:25.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.469+0000 7f741a000700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74141f79a0 0x7f74141f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:25.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.469+0000 7f741a000700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74140b4280 con 0x7f74141434b0 2024-05-10T04:27:25.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.469+0000 7f741a000700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741412fe70 con 0x7f74141f79a0 2024-05-10T04:27:25.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.469+0000 7f741a000700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7414143fc0 con 0x7f74140ce320 2024-05-10T04:27:25.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.469+0000 7f7413e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74141434b0 0x7f74141438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:25.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.469+0000 7f7413e00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74141434b0 0x7f74141438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41638/0 (socket says 172.21.15.80:41638) 2024-05-10T04:27:25.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.469+0000 7f7413e00700 1 -- 172.21.15.80:0/1109123380 learned_addr learned my addr 172.21.15.80:0/1109123380 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-10T04:27:25.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.469+0000 7f7418c00700 1 --2- 172.21.15.80:0/1109123380 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74140ce320 0x7f74141592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:25.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.469+0000 7f7419600700 1 --2- 172.21.15.80:0/1109123380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74141f79a0 0x7f74141f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:25.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.470+0000 7f7413e00700 1 -- 172.21.15.80:0/1109123380 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74140ce320 msgr2=0x7f74141592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:25.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.470+0000 7f7413e00700 1 --2- 172.21.15.80:0/1109123380 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74140ce320 0x7f74141592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:25.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.470+0000 7f7413e00700 1 -- 172.21.15.80:0/1109123380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74141f79a0 msgr2=0x7f74141f7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:25.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.470+0000 7f7413e00700 1 --2- 172.21.15.80:0/1109123380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74141f79a0 0x7f74141f7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:25.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.470+0000 7f7413e00700 1 -- 172.21.15.80:0/1109123380 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c009a70 con 0x7f74141434b0 2024-05-10T04:27:25.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.470+0000 7f7413e00700 1 --2- 172.21.15.80:0/1109123380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74141434b0 0x7f74141438c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7400001eb0 tx=0x7f740000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:25.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.470+0000 7f7410c00700 1 -- 172.21.15.80:0/1109123380 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400005d70 con 0x7f74141434b0 2024-05-10T04:27:25.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.470+0000 7f7410c00700 1 -- 172.21.15.80:0/1109123380 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f74000070d0 con 0x7f74141434b0 2024-05-10T04:27:25.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.470+0000 7f741a000700 1 -- 172.21.15.80:0/1109123380 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74080094a0 con 0x7f74141434b0 2024-05-10T04:27:25.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.470+0000 7f7410c00700 1 -- 172.21.15.80:0/1109123380 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400007480 con 0x7f74141434b0 2024-05-10T04:27:25.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.470+0000 7f741a000700 1 -- 172.21.15.80:0/1109123380 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74141444f0 con 0x7f74141434b0 2024-05-10T04:27:25.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.471+0000 7f741a000700 1 -- 172.21.15.80:0/1109123380 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74141447b0 con 0x7f74141434b0 2024-05-10T04:27:25.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.472+0000 7f7410c00700 1 -- 172.21.15.80:0/1109123380 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f74000075e0 con 0x7f74141434b0 2024-05-10T04:27:25.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.474+0000 7f7410c00700 1 --2- 172.21.15.80:0/1109123380 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f73f406acc0 0x7f73f406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:27:25.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.474+0000 7f7410c00700 1 -- 172.21.15.80:0/1109123380 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f74000886e0 con 0x7f74141434b0 2024-05-10T04:27:25.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.474+0000 7f7418c00700 1 --2- 172.21.15.80:0/1109123380 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f73f406acc0 0x7f73f406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:27:25.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.475+0000 7f7418c00700 1 --2- 172.21.15.80:0/1109123380 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f73f406acc0 0x7f73f406d1d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7408009840 tx=0x7f7408008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:27:25.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.478+0000 7f7410c00700 1 -- 172.21.15.80:0/1109123380 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7400053a00 con 0x7f74141434b0 2024-05-10T04:27:25.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.729+0000 7f741a000700 1 -- 172.21.15.80:0/1109123380 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7414074af0 con 0x7f74141434b0 2024-05-10T04:27:25.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.729+0000 7f7410c00700 1 -- 172.21.15.80:0/1109123380 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f7400017090 con 0x7f74141434b0 2024-05-10T04:27:25.730 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-10T04:27:25.731 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6834/607016626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":607016626},{"type":"v1","addr":"172.21.15.80:6834","nonce":607016626}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4981,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1819064685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1819064685},{"type":"v1","addr":"172.21.15.106:6836","nonce":1819064685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4984,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3006235418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3006235418},{"type":"v1","addr":"172.21.15.106:6837","nonce":3006235418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5409,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1262894267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1262894267},{"type":"v1","addr":"172.21.15.80:6835","nonce":1262894267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2024-05-10T04:27:25.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.732+0000 7f741a000700 1 -- 172.21.15.80:0/1109123380 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f73f406acc0 msgr2=0x7f73f406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:25.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.732+0000 7f741a000700 1 --2- 172.21.15.80:0/1109123380 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f73f406acc0 0x7f73f406d1d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7408009840 tx=0x7f7408008030 comp rx=0 tx=0).stop 2024-05-10T04:27:25.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.732+0000 7f741a000700 1 -- 172.21.15.80:0/1109123380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74141434b0 msgr2=0x7f74141438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:27:25.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.732+0000 7f741a000700 1 --2- 172.21.15.80:0/1109123380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74141434b0 0x7f74141438c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7400001eb0 tx=0x7f740000c860 comp rx=0 tx=0).stop 2024-05-10T04:27:25.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.732+0000 7f741a000700 1 -- 172.21.15.80:0/1109123380 shutdown_connections 2024-05-10T04:27:25.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.732+0000 7f741a000700 1 --2- 172.21.15.80:0/1109123380 >> [v2:172.21.15.106:6832/41218,v1:172.21.15.106:6833/41218] conn(0x7f73f406acc0 0x7f73f406d1d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:25.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.732+0000 7f741a000700 1 --2- 172.21.15.80:0/1109123380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74141f79a0 0x7f74141f7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:25.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.732+0000 7f741a000700 1 --2- 172.21.15.80:0/1109123380 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74140ce320 0x7f74141592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:25.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.732+0000 7f741a000700 1 --2- 172.21.15.80:0/1109123380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74141434b0 0x7f74141438c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:27:25.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.732+0000 7f741a000700 1 -- 172.21.15.80:0/1109123380 >> 172.21.15.80:0/1109123380 conn(0x7f74140b1dd0 msgr2=0x7f74140b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:27:25.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.732+0000 7f741a000700 1 -- 172.21.15.80:0/1109123380 shutdown_connections 2024-05-10T04:27:25.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-10T04:27:25.732+0000 7f741a000700 1 -- 172.21.15.80:0/1109123380 wait complete. 2024-05-10T04:27:25.735 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 18 2024-05-10T04:27:25.761 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-10T04:27:25.761 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-10T04:27:25.762 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T04:27:25.762 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:27:25.783 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T04:27:25.783 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T04:27:25.783 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:27:25.847 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T04:27:25.848 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T04:27:25.848 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:27:25.872 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T04:27:25.872 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T04:27:25.873 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:27:25.937 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T04:27:25.937 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-10T04:27:25.938 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-10T04:27:25.938 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:27:25.985 INFO:tasks.ceph.osd.0:Stopped 2024-05-10T04:27:25.985 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-10T04:27:25.985 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:27:26.051 INFO:tasks.ceph.osd.1:Stopped 2024-05-10T04:27:26.051 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-10T04:27:26.051 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:27:26.114 INFO:tasks.ceph.osd.2:Stopped 2024-05-10T04:27:26.115 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-10T04:27:26.115 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:27:26.176 INFO:tasks.ceph.osd.3:Stopped 2024-05-10T04:27:26.176 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-10T04:27:26.177 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:27:26.225 INFO:tasks.ceph.osd.4:Stopped 2024-05-10T04:27:26.226 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-10T04:27:26.226 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:27:26.275 INFO:tasks.ceph.osd.5:Stopped 2024-05-10T04:27:26.276 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-10T04:27:26.276 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:27:26.334 INFO:tasks.ceph.osd.6:Stopped 2024-05-10T04:27:26.334 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-10T04:27:26.334 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:27:26.393 INFO:tasks.ceph.osd.7:Stopped 2024-05-10T04:27:26.393 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-10T04:27:26.393 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-10T04:27:26.393 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:27:26.466 INFO:tasks.ceph.mgr.y:Stopped 2024-05-10T04:27:26.467 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-10T04:27:26.467 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:27:26.544 INFO:tasks.ceph.mgr.x:Stopped 2024-05-10T04:27:26.544 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-10T04:27:26.545 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-10T04:27:26.545 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:27:26.582 INFO:tasks.ceph.mon.a:Stopped 2024-05-10T04:27:26.582 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-10T04:27:26.582 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:27:26.608 INFO:tasks.ceph.mon.b:Stopped 2024-05-10T04:27:26.608 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-10T04:27:26.608 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:27:26.675 INFO:tasks.ceph.mon.c:Stopped 2024-05-10T04:27:26.676 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-10T04:27:26.676 DEBUG:teuthology.orchestra.run.smithi080:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-05-10T04:27:26.757 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-10T04:27:26.757 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-10T04:27:26.987 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-10T04:27:26.987 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-10T04:27:27.130 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-10T04:27:27.130 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-10T04:27:27.296 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-10T04:27:27.296 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-10T04:27:27.413 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-10T04:27:27.413 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-10T04:27:27.616 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-10T04:27:27.616 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-10T04:27:27.724 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-10T04:27:27.725 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-10T04:27:27.832 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-10T04:27:27.832 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-10T04:27:27.950 INFO:tasks.ceph:Archiving mon data... 2024-05-10T04:27:27.951 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700532/data/mon.a.tgz 2024-05-10T04:27:27.952 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-05-10T04:27:27.995 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.gSAWruhobb 2024-05-10T04:27:27.995 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.gSAWruhobb 2024-05-10T04:27:28.182 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.gSAWruhobb 2024-05-10T04:27:28.291 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.gSAWruhobb is 309KB 2024-05-10T04:27:28.387 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.gSAWruhobb 2024-05-10T04:27:28.428 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700532/data/mon.b.tgz 2024-05-10T04:27:28.428 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-05-10T04:27:28.471 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.NZEM1Yl58l 2024-05-10T04:27:28.471 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.NZEM1Yl58l 2024-05-10T04:27:28.661 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.NZEM1Yl58l 2024-05-10T04:27:28.771 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.NZEM1Yl58l is 409KB 2024-05-10T04:27:28.866 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.NZEM1Yl58l 2024-05-10T04:27:28.907 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700532/data/mon.c.tgz 2024-05-10T04:27:28.907 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-05-10T04:27:28.988 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.C6YMsIYQzj 2024-05-10T04:27:28.988 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.C6YMsIYQzj 2024-05-10T04:27:29.172 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.C6YMsIYQzj 2024-05-10T04:27:29.282 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.C6YMsIYQzj is 409KB 2024-05-10T04:27:29.379 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.C6YMsIYQzj 2024-05-10T04:27:29.420 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-10T04:27:29.420 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-10T04:27:29.425 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-10T04:27:29.525 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-05-10T04:27:29.525 DEBUG:teuthology.orchestra.run.smithi080:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-10T04:27:29.529 DEBUG:teuthology.orchestra.run.smithi106:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-10T04:27:29.601 INFO:teuthology.orchestra.run.smithi080.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-10T04:27:29.617 INFO:teuthology.orchestra.run.smithi106.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-10T04:27:29.632 INFO:tasks.ceph:Archiving crash dumps... 2024-05-10T04:27:29.634 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700532/remote/smithi080/crash 2024-05-10T04:27:29.635 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-10T04:27:29.699 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700532/remote/smithi106/crash 2024-05-10T04:27:29.700 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-10T04:27:29.764 INFO:tasks.ceph:Shutting down logrotate 2024-05-10T04:27:29.764 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:27:29.768 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:27:29.871 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-10T04:27:29.936 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-10T04:27:30.000 INFO:tasks.ceph:Compressing logs... 2024-05-10T04:27:30.001 DEBUG:teuthology.orchestra.run.smithi080:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T04:27:30.006 DEBUG:teuthology.orchestra.run.smithi106:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T04:27:31.391 INFO:tasks.ceph:Archiving logs... 2024-05-10T04:27:31.391 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700532/remote/smithi080/log 2024-05-10T04:27:31.392 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T04:27:31.783 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700532/remote/smithi106/log 2024-05-10T04:27:31.784 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T04:27:31.987 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-10T04:27:32.007 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-10T04:27:32.007 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T04:27:32.011 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T04:27:32.127 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-10T04:27:32.136 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-10T04:27:32.136 DEBUG:teuthology.orchestra.run.smithi080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T04:27:32.140 DEBUG:teuthology.orchestra.run.smithi106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T04:27:32.176 INFO:teuthology.orchestra.run.smithi080.stderr:bash: ntpq: command not found 2024-05-10T04:27:32.180 INFO:teuthology.orchestra.run.smithi106.stderr:bash: ntpq: command not found 2024-05-10T04:27:32.184 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T04:27:32.184 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-05-10T04:27:32.184 INFO:teuthology.orchestra.run.smithi080.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 +2466us[+2475us] +/- 54ms 2024-05-10T04:27:32.184 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 -2049us[-2049us] +/- 58ms 2024-05-10T04:27:32.184 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 -828us[ -819us] +/- 75ms 2024-05-10T04:27:32.185 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:27:32.188 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T04:27:32.189 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2024-05-10T04:27:32.189 INFO:teuthology.orchestra.run.smithi106.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 +2546us[+2526us] +/- 54ms 2024-05-10T04:27:32.189 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 43 -1961us[-1981us] +/- 58ms 2024-05-10T04:27:32.189 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 -727us[ -747us] +/- 75ms 2024-05-10T04:27:32.189 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:27:32.190 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-10T04:27:32.199 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-10T04:27:32.200 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-10T04:27:32.207 DEBUG:teuthology.orchestra.run.smithi080:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T04:27:32.357 DEBUG:teuthology.orchestra.run.smithi106:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T04:27:32.485 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T04:27:32.557 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:27:32.558 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T04:27:32.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:27:32.632 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-10T04:27:32.763 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-10T04:27:32.777 INFO:teuthology.task.internal:Duration was 1282.932591 seconds 2024-05-10T04:27:32.778 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-10T04:27:32.793 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-10T04:27:32.793 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T04:27:32.797 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T04:27:32.906 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T04:27:32.908 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T04:27:33.333 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-10T04:27:33.333 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi080.front.sepia.ceph.com 2024-05-10T04:27:33.334 DEBUG:teuthology.orchestra.run.smithi080:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T04:27:33.390 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi106.front.sepia.ceph.com 2024-05-10T04:27:33.390 DEBUG:teuthology.orchestra.run.smithi106:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T04:27:33.447 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-10T04:27:33.448 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T04:27:33.452 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T04:27:33.538 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-10T04:27:33.538 DEBUG:teuthology.orchestra.run.smithi080:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T04:27:33.542 DEBUG:teuthology.orchestra.run.smithi106:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T04:27:33.665 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-10T04:27:33.676 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-10T04:27:33.677 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T04:27:33.742 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T04:27:33.809 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-10T04:27:33.819 DEBUG:teuthology.orchestra.run.smithi080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T04:27:33.823 DEBUG:teuthology.orchestra.run.smithi106:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T04:27:33.883 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = core 2024-05-10T04:27:33.888 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = core 2024-05-10T04:27:33.922 DEBUG:teuthology.orchestra.run.smithi080:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T04:27:33.961 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:27:33.962 DEBUG:teuthology.orchestra.run.smithi106:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T04:27:34.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:27:34.002 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-10T04:27:34.012 INFO:teuthology.task.internal:Transferring archived files... 2024-05-10T04:27:34.013 DEBUG:teuthology.misc:Transferring archived files from smithi080:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700532/remote/smithi080 2024-05-10T04:27:34.013 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T04:27:34.099 DEBUG:teuthology.misc:Transferring archived files from smithi106:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700532/remote/smithi106 2024-05-10T04:27:34.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T04:27:34.176 INFO:teuthology.task.internal:Removing archive directory... 2024-05-10T04:27:34.176 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T04:27:34.180 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T04:27:34.221 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-10T04:27:34.241 INFO:teuthology.task.internal:Not uploading archives. 2024-05-10T04:27:34.241 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-10T04:27:34.252 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-10T04:27:34.252 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T04:27:34.263 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T04:27:34.302 INFO:teuthology.orchestra.run.smithi080.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 04:27 /home/ubuntu/cephtest 2024-05-10T04:27:34.304 INFO:teuthology.orchestra.run.smithi106.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 04:27 /home/ubuntu/cephtest 2024-05-10T04:27:34.307 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-10T04:27:34.318 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-10T04:27:34.345 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 client.1-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/acls} duration: 1282.9325907230377 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-10T04:27:34.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T04:27:34.422 INFO:teuthology.run:pass